Test Report: Docker_Linux_containerd_arm64 17044

                    
                      df168c2d81a1825740328057ca29cb976d1a3614:2023-08-12:30542
                    
                

Test fail (13/308)

x
+
TestAddons/parallel/Ingress (37.96s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:183: (dbg) Run:  kubectl --context addons-796714 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:208: (dbg) Run:  kubectl --context addons-796714 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context addons-796714 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [e7ec7034-657a-493b-bb03-16f5a8ce506d] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [e7ec7034-657a-493b-bb03-16f5a8ce506d] Running
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 8.023478301s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context addons-796714 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.067458514s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p addons-796714 addons disable ingress-dns --alsologtostderr -v=1: (1.041890247s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p addons-796714 addons disable ingress --alsologtostderr -v=1: (7.835225332s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-796714
helpers_test.go:235: (dbg) docker inspect addons-796714:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "f4056120f391c2d80f71e113527a466cdeb8153d3df51dfdc32af4739be3f459",
	        "Created": "2023-08-11T23:02:16.931504623Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 8722,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-08-11T23:02:17.301868116Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:abe4482d178dd08cce0cdcb8e444349673c3edfa8e7d6462144a8d9173479eb6",
	        "ResolvConfPath": "/var/lib/docker/containers/f4056120f391c2d80f71e113527a466cdeb8153d3df51dfdc32af4739be3f459/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/f4056120f391c2d80f71e113527a466cdeb8153d3df51dfdc32af4739be3f459/hostname",
	        "HostsPath": "/var/lib/docker/containers/f4056120f391c2d80f71e113527a466cdeb8153d3df51dfdc32af4739be3f459/hosts",
	        "LogPath": "/var/lib/docker/containers/f4056120f391c2d80f71e113527a466cdeb8153d3df51dfdc32af4739be3f459/f4056120f391c2d80f71e113527a466cdeb8153d3df51dfdc32af4739be3f459-json.log",
	        "Name": "/addons-796714",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "addons-796714:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-796714",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/c67b69a2b6137548a1b7803f37da583befb6bd91361bbafe48d20a287a3e14ef-init/diff:/var/lib/docker/overlay2/d97b84d3132f258dcb9c2a1a6f715ba5f60dbe710f2671cc920145c44f465eef/diff",
	                "MergedDir": "/var/lib/docker/overlay2/c67b69a2b6137548a1b7803f37da583befb6bd91361bbafe48d20a287a3e14ef/merged",
	                "UpperDir": "/var/lib/docker/overlay2/c67b69a2b6137548a1b7803f37da583befb6bd91361bbafe48d20a287a3e14ef/diff",
	                "WorkDir": "/var/lib/docker/overlay2/c67b69a2b6137548a1b7803f37da583befb6bd91361bbafe48d20a287a3e14ef/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "addons-796714",
	                "Source": "/var/lib/docker/volumes/addons-796714/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-796714",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-796714",
	                "name.minikube.sigs.k8s.io": "addons-796714",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "a3b0ac15f9454eed60d374bb8f6958caf4292bc3a28923b4f6dfacc52f7709bf",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32772"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32771"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32768"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32770"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32769"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/a3b0ac15f945",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-796714": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "f4056120f391",
	                        "addons-796714"
	                    ],
	                    "NetworkID": "14ce18513a6c10d46d11910e17073c4b2761b8a4f667247f8418cd80525bdfc3",
	                    "EndpointID": "e1e8c4f205a870220cd8f1a69abb48e614b423df2b2717865b21c1a5a06d5a67",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-796714 -n addons-796714
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-796714 logs -n 25: (1.776825383s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|-----------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |               Args                |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|-----------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only           | download-only-462841   | jenkins | v1.31.1 | 11 Aug 23 23:00 UTC |                     |
	|         | -p download-only-462841           |                        |         |         |                     |                     |
	|         | --force --alsologtostderr         |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	|         | --driver=docker                   |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	| start   | -o=json --download-only           | download-only-462841   | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC |                     |
	|         | -p download-only-462841           |                        |         |         |                     |                     |
	|         | --force --alsologtostderr         |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.27.4      |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	|         | --driver=docker                   |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	| start   | -o=json --download-only           | download-only-462841   | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC |                     |
	|         | -p download-only-462841           |                        |         |         |                     |                     |
	|         | --force --alsologtostderr         |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.0-rc.0 |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	|         | --driver=docker                   |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	| delete  | --all                             | minikube               | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC | 11 Aug 23 23:01 UTC |
	| delete  | -p download-only-462841           | download-only-462841   | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC | 11 Aug 23 23:01 UTC |
	| delete  | -p download-only-462841           | download-only-462841   | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC | 11 Aug 23 23:01 UTC |
	| start   | --download-only -p                | download-docker-818259 | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC |                     |
	|         | download-docker-818259            |                        |         |         |                     |                     |
	|         | --alsologtostderr                 |                        |         |         |                     |                     |
	|         | --driver=docker                   |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	| delete  | -p download-docker-818259         | download-docker-818259 | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC | 11 Aug 23 23:01 UTC |
	| start   | --download-only -p                | binary-mirror-045057   | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC |                     |
	|         | binary-mirror-045057              |                        |         |         |                     |                     |
	|         | --alsologtostderr                 |                        |         |         |                     |                     |
	|         | --binary-mirror                   |                        |         |         |                     |                     |
	|         | http://127.0.0.1:33227            |                        |         |         |                     |                     |
	|         | --driver=docker                   |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-045057           | binary-mirror-045057   | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC | 11 Aug 23 23:01 UTC |
	| start   | -p addons-796714                  | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC | 11 Aug 23 23:04 UTC |
	|         | --wait=true --memory=4000         |                        |         |         |                     |                     |
	|         | --alsologtostderr                 |                        |         |         |                     |                     |
	|         | --addons=registry                 |                        |         |         |                     |                     |
	|         | --addons=metrics-server           |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots          |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver      |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                 |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner            |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget         |                        |         |         |                     |                     |
	|         | --driver=docker                   |                        |         |         |                     |                     |
	|         | --container-runtime=containerd    |                        |         |         |                     |                     |
	|         | --addons=ingress                  |                        |         |         |                     |                     |
	|         | --addons=ingress-dns              |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p          | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:04 UTC | 11 Aug 23 23:04 UTC |
	|         | addons-796714                     |                        |         |         |                     |                     |
	| addons  | enable headlamp                   | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:04 UTC | 11 Aug 23 23:04 UTC |
	|         | -p addons-796714                  |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1            |                        |         |         |                     |                     |
	| ip      | addons-796714 ip                  | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:04 UTC | 11 Aug 23 23:04 UTC |
	| addons  | addons-796714 addons disable      | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:04 UTC | 11 Aug 23 23:04 UTC |
	|         | registry --alsologtostderr        |                        |         |         |                     |                     |
	|         | -v=1                              |                        |         |         |                     |                     |
	| addons  | addons-796714 addons              | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:04 UTC | 11 Aug 23 23:04 UTC |
	|         | disable metrics-server            |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1            |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p       | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:04 UTC | 11 Aug 23 23:04 UTC |
	|         | addons-796714                     |                        |         |         |                     |                     |
	| ssh     | addons-796714 ssh curl -s         | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:04 UTC | 11 Aug 23 23:04 UTC |
	|         | http://127.0.0.1/ -H 'Host:       |                        |         |         |                     |                     |
	|         | nginx.example.com'                |                        |         |         |                     |                     |
	| ip      | addons-796714 ip                  | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:05 UTC | 11 Aug 23 23:05 UTC |
	| addons  | addons-796714 addons disable      | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:05 UTC | 11 Aug 23 23:05 UTC |
	|         | ingress-dns --alsologtostderr     |                        |         |         |                     |                     |
	|         | -v=1                              |                        |         |         |                     |                     |
	| addons  | addons-796714 addons disable      | addons-796714          | jenkins | v1.31.1 | 11 Aug 23 23:05 UTC | 11 Aug 23 23:05 UTC |
	|         | ingress --alsologtostderr -v=1    |                        |         |         |                     |                     |
	|---------|-----------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/08/11 23:01:52
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0811 23:01:52.770238    8241 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:01:52.770419    8241 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:01:52.770429    8241 out.go:309] Setting ErrFile to fd 2...
	I0811 23:01:52.770435    8241 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:01:52.770691    8241 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:01:52.771130    8241 out.go:303] Setting JSON to false
	I0811 23:01:52.771863    8241 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":2659,"bootTime":1691792254,"procs":158,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:01:52.771933    8241 start.go:138] virtualization:  
	I0811 23:01:52.774642    8241 out.go:177] * [addons-796714] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:01:52.776841    8241 out.go:177]   - MINIKUBE_LOCATION=17044
	I0811 23:01:52.778969    8241 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:01:52.776953    8241 notify.go:220] Checking for updates...
	I0811 23:01:52.782874    8241 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:01:52.784588    8241 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:01:52.786396    8241 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0811 23:01:52.788450    8241 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0811 23:01:52.790722    8241 driver.go:373] Setting default libvirt URI to qemu:///system
	I0811 23:01:52.815691    8241 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:01:52.815798    8241 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:01:52.906836    8241 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-08-11 23:01:52.897303298 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:01:52.907005    8241 docker.go:294] overlay module found
	I0811 23:01:52.909007    8241 out.go:177] * Using the docker driver based on user configuration
	I0811 23:01:52.910652    8241 start.go:298] selected driver: docker
	I0811 23:01:52.910666    8241 start.go:901] validating driver "docker" against <nil>
	I0811 23:01:52.910692    8241 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0811 23:01:52.911457    8241 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:01:52.998805    8241 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-08-11 23:01:52.988959827 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:01:52.998990    8241 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0811 23:01:52.999266    8241 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0811 23:01:53.001120    8241 out.go:177] * Using Docker driver with root privileges
	I0811 23:01:53.005060    8241 cni.go:84] Creating CNI manager for ""
	I0811 23:01:53.005088    8241 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:01:53.005103    8241 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni
	I0811 23:01:53.005116    8241 start_flags.go:319] config:
	{Name:addons-796714 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:addons-796714 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containe
rd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:01:53.009392    8241 out.go:177] * Starting control plane node addons-796714 in cluster addons-796714
	I0811 23:01:53.011311    8241 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0811 23:01:53.013225    8241 out.go:177] * Pulling base image ...
	I0811 23:01:53.015116    8241 preload.go:132] Checking if preload exists for k8s version v1.27.4 and runtime containerd
	I0811 23:01:53.015181    8241 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4
	I0811 23:01:53.015193    8241 cache.go:57] Caching tarball of preloaded images
	I0811 23:01:53.015198    8241 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon
	I0811 23:01:53.015266    8241 preload.go:174] Found /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0811 23:01:53.015276    8241 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.4 on containerd
	I0811 23:01:53.015620    8241 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/config.json ...
	I0811 23:01:53.015649    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/config.json: {Name:mkdaaedfccff4a06254195f3547fc2c69dccc856 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:01:53.037108    8241 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 to local cache
	I0811 23:01:53.037209    8241 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local cache directory
	I0811 23:01:53.037230    8241 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local cache directory, skipping pull
	I0811 23:01:53.037235    8241 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 exists in cache, skipping pull
	I0811 23:01:53.037244    8241 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 as a tarball
	I0811 23:01:53.037249    8241 cache.go:163] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 from local cache
	I0811 23:02:08.822187    8241 cache.go:165] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 from cached tarball
	I0811 23:02:08.822222    8241 cache.go:195] Successfully downloaded all kic artifacts
	I0811 23:02:08.822287    8241 start.go:365] acquiring machines lock for addons-796714: {Name:mk1ea6ee131ad3d6fcce80a404fd4e3e84e2a238 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0811 23:02:08.822411    8241 start.go:369] acquired machines lock for "addons-796714" in 101.594µs
	I0811 23:02:08.822439    8241 start.go:93] Provisioning new machine with config: &{Name:addons-796714 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:addons-796714 Namespace:default APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:
false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0811 23:02:08.822532    8241 start.go:125] createHost starting for "" (driver="docker")
	I0811 23:02:08.825055    8241 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0811 23:02:08.825291    8241 start.go:159] libmachine.API.Create for "addons-796714" (driver="docker")
	I0811 23:02:08.825330    8241 client.go:168] LocalClient.Create starting
	I0811 23:02:08.825463    8241 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem
	I0811 23:02:09.163113    8241 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem
	I0811 23:02:10.282370    8241 cli_runner.go:164] Run: docker network inspect addons-796714 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0811 23:02:10.303254    8241 cli_runner.go:211] docker network inspect addons-796714 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0811 23:02:10.303331    8241 network_create.go:281] running [docker network inspect addons-796714] to gather additional debugging logs...
	I0811 23:02:10.303350    8241 cli_runner.go:164] Run: docker network inspect addons-796714
	W0811 23:02:10.323881    8241 cli_runner.go:211] docker network inspect addons-796714 returned with exit code 1
	I0811 23:02:10.323923    8241 network_create.go:284] error running [docker network inspect addons-796714]: docker network inspect addons-796714: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-796714 not found
	I0811 23:02:10.323941    8241 network_create.go:286] output of [docker network inspect addons-796714]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-796714 not found
	
	** /stderr **
	I0811 23:02:10.324000    8241 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0811 23:02:10.344190    8241 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40010fdc70}
	I0811 23:02:10.344235    8241 network_create.go:123] attempt to create docker network addons-796714 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0811 23:02:10.344306    8241 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-796714 addons-796714
	I0811 23:02:10.411917    8241 network_create.go:107] docker network addons-796714 192.168.49.0/24 created
	I0811 23:02:10.411950    8241 kic.go:117] calculated static IP "192.168.49.2" for the "addons-796714" container
	I0811 23:02:10.412020    8241 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0811 23:02:10.429046    8241 cli_runner.go:164] Run: docker volume create addons-796714 --label name.minikube.sigs.k8s.io=addons-796714 --label created_by.minikube.sigs.k8s.io=true
	I0811 23:02:10.448654    8241 oci.go:103] Successfully created a docker volume addons-796714
	I0811 23:02:10.448753    8241 cli_runner.go:164] Run: docker run --rm --name addons-796714-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-796714 --entrypoint /usr/bin/test -v addons-796714:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 -d /var/lib
	I0811 23:02:12.769366    8241 cli_runner.go:217] Completed: docker run --rm --name addons-796714-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-796714 --entrypoint /usr/bin/test -v addons-796714:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 -d /var/lib: (2.320566606s)
	I0811 23:02:12.769395    8241 oci.go:107] Successfully prepared a docker volume addons-796714
	I0811 23:02:12.769415    8241 preload.go:132] Checking if preload exists for k8s version v1.27.4 and runtime containerd
	I0811 23:02:12.769433    8241 kic.go:190] Starting extracting preloaded images to volume ...
	I0811 23:02:12.769516    8241 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-796714:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 -I lz4 -xf /preloaded.tar -C /extractDir
	I0811 23:02:16.840456    8241 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-796714:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 -I lz4 -xf /preloaded.tar -C /extractDir: (4.07089106s)
	I0811 23:02:16.840487    8241 kic.go:199] duration metric: took 4.071050 seconds to extract preloaded images to volume
	W0811 23:02:16.840640    8241 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0811 23:02:16.840761    8241 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0811 23:02:16.914488    8241 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-796714 --name addons-796714 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-796714 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-796714 --network addons-796714 --ip 192.168.49.2 --volume addons-796714:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37
	I0811 23:02:17.310051    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Running}}
	I0811 23:02:17.332528    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:17.354527    8241 cli_runner.go:164] Run: docker exec addons-796714 stat /var/lib/dpkg/alternatives/iptables
	I0811 23:02:17.449365    8241 oci.go:144] the created container "addons-796714" has a running status.
	I0811 23:02:17.449394    8241 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa...
	I0811 23:02:17.822222    8241 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0811 23:02:17.869013    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:17.899417    8241 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0811 23:02:17.899435    8241 kic_runner.go:114] Args: [docker exec --privileged addons-796714 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0811 23:02:18.013916    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:18.052267    8241 machine.go:88] provisioning docker machine ...
	I0811 23:02:18.052298    8241 ubuntu.go:169] provisioning hostname "addons-796714"
	I0811 23:02:18.052366    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:18.092638    8241 main.go:141] libmachine: Using SSH client type: native
	I0811 23:02:18.093099    8241 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I0811 23:02:18.093118    8241 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-796714 && echo "addons-796714" | sudo tee /etc/hostname
	I0811 23:02:18.093724    8241 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50478->127.0.0.1:32772: read: connection reset by peer
	I0811 23:02:21.255002    8241 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-796714
	
	I0811 23:02:21.255104    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:21.275209    8241 main.go:141] libmachine: Using SSH client type: native
	I0811 23:02:21.275655    8241 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I0811 23:02:21.275679    8241 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-796714' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-796714/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-796714' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0811 23:02:21.424696    8241 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0811 23:02:21.424720    8241 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0811 23:02:21.424740    8241 ubuntu.go:177] setting up certificates
	I0811 23:02:21.424749    8241 provision.go:83] configureAuth start
	I0811 23:02:21.424815    8241 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-796714
	I0811 23:02:21.444861    8241 provision.go:138] copyHostCerts
	I0811 23:02:21.444944    8241 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0811 23:02:21.445067    8241 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0811 23:02:21.445123    8241 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0811 23:02:21.445166    8241 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.addons-796714 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-796714]
	I0811 23:02:21.710271    8241 provision.go:172] copyRemoteCerts
	I0811 23:02:21.710340    8241 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0811 23:02:21.710410    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:21.733599    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:21.837739    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0811 23:02:21.868658    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I0811 23:02:21.896712    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0811 23:02:21.924896    8241 provision.go:86] duration metric: configureAuth took 500.133629ms
	I0811 23:02:21.924960    8241 ubuntu.go:193] setting minikube options for container-runtime
	I0811 23:02:21.925182    8241 config.go:182] Loaded profile config "addons-796714": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:02:21.925196    8241 machine.go:91] provisioned docker machine in 3.872908728s
	I0811 23:02:21.925203    8241 client.go:171] LocalClient.Create took 13.099863286s
	I0811 23:02:21.925219    8241 start.go:167] duration metric: libmachine.API.Create for "addons-796714" took 13.099927735s
	I0811 23:02:21.925231    8241 start.go:300] post-start starting for "addons-796714" (driver="docker")
	I0811 23:02:21.925239    8241 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0811 23:02:21.925299    8241 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0811 23:02:21.925342    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:21.944558    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:22.050901    8241 ssh_runner.go:195] Run: cat /etc/os-release
	I0811 23:02:22.055580    8241 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0811 23:02:22.055616    8241 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0811 23:02:22.055653    8241 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0811 23:02:22.055661    8241 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0811 23:02:22.055670    8241 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/addons for local assets ...
	I0811 23:02:22.055758    8241 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/files for local assets ...
	I0811 23:02:22.055788    8241 start.go:303] post-start completed in 130.551523ms
	I0811 23:02:22.056166    8241 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-796714
	I0811 23:02:22.074710    8241 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/config.json ...
	I0811 23:02:22.074991    8241 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:02:22.075081    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:22.093818    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:22.193118    8241 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0811 23:02:22.199111    8241 start.go:128] duration metric: createHost completed in 13.376564092s
	I0811 23:02:22.199134    8241 start.go:83] releasing machines lock for "addons-796714", held for 13.376711765s
	I0811 23:02:22.199209    8241 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-796714
	I0811 23:02:22.217494    8241 ssh_runner.go:195] Run: cat /version.json
	I0811 23:02:22.217546    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:22.217814    8241 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0811 23:02:22.217869    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:22.239947    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:22.248555    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:22.339523    8241 ssh_runner.go:195] Run: systemctl --version
	I0811 23:02:22.482112    8241 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0811 23:02:22.487762    8241 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0811 23:02:22.518923    8241 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0811 23:02:22.519002    8241 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0811 23:02:22.555279    8241 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0811 23:02:22.555308    8241 start.go:466] detecting cgroup driver to use...
	I0811 23:02:22.555341    8241 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0811 23:02:22.555393    8241 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0811 23:02:22.570146    8241 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0811 23:02:22.584098    8241 docker.go:196] disabling cri-docker service (if available) ...
	I0811 23:02:22.584180    8241 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0811 23:02:22.600900    8241 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0811 23:02:22.618363    8241 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0811 23:02:22.713940    8241 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0811 23:02:22.823153    8241 docker.go:212] disabling docker service ...
	I0811 23:02:22.823223    8241 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0811 23:02:22.844450    8241 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0811 23:02:22.858862    8241 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0811 23:02:22.949083    8241 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0811 23:02:23.042852    8241 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0811 23:02:23.056658    8241 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0811 23:02:23.077152    8241 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0811 23:02:23.089903    8241 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0811 23:02:23.102375    8241 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0811 23:02:23.102479    8241 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0811 23:02:23.115178    8241 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:02:23.128010    8241 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0811 23:02:23.140528    8241 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:02:23.152586    8241 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0811 23:02:23.163612    8241 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0811 23:02:23.175616    8241 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0811 23:02:23.186346    8241 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0811 23:02:23.196847    8241 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0811 23:02:23.287744    8241 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0811 23:02:23.381588    8241 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0811 23:02:23.381746    8241 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0811 23:02:23.387323    8241 start.go:534] Will wait 60s for crictl version
	I0811 23:02:23.387453    8241 ssh_runner.go:195] Run: which crictl
	I0811 23:02:23.392303    8241 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:02:23.442179    8241 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.21
	RuntimeApiVersion:  v1
	I0811 23:02:23.442336    8241 ssh_runner.go:195] Run: containerd --version
	I0811 23:02:23.470179    8241 ssh_runner.go:195] Run: containerd --version
	I0811 23:02:23.504911    8241 out.go:177] * Preparing Kubernetes v1.27.4 on containerd 1.6.21 ...
	I0811 23:02:23.507452    8241 cli_runner.go:164] Run: docker network inspect addons-796714 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0811 23:02:23.525401    8241 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0811 23:02:23.529767    8241 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0811 23:02:23.542978    8241 preload.go:132] Checking if preload exists for k8s version v1.27.4 and runtime containerd
	I0811 23:02:23.543066    8241 ssh_runner.go:195] Run: sudo crictl images --output json
	I0811 23:02:23.584635    8241 containerd.go:604] all images are preloaded for containerd runtime.
	I0811 23:02:23.584656    8241 containerd.go:518] Images already preloaded, skipping extraction
	I0811 23:02:23.584713    8241 ssh_runner.go:195] Run: sudo crictl images --output json
	I0811 23:02:23.626009    8241 containerd.go:604] all images are preloaded for containerd runtime.
	I0811 23:02:23.626032    8241 cache_images.go:84] Images are preloaded, skipping loading
	I0811 23:02:23.626145    8241 ssh_runner.go:195] Run: sudo crictl info
	I0811 23:02:23.667606    8241 cni.go:84] Creating CNI manager for ""
	I0811 23:02:23.667629    8241 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:02:23.667671    8241 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0811 23:02:23.667695    8241 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.27.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-796714 NodeName:addons-796714 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0811 23:02:23.667827    8241 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "addons-796714"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.27.4
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0811 23:02:23.667901    8241 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.27.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=addons-796714 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.27.4 ClusterName:addons-796714 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0811 23:02:23.667969    8241 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.4
	I0811 23:02:23.678611    8241 binaries.go:44] Found k8s binaries, skipping transfer
	I0811 23:02:23.678681    8241 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0811 23:02:23.689451    8241 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (385 bytes)
	I0811 23:02:23.711175    8241 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0811 23:02:23.732760    8241 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2102 bytes)
	I0811 23:02:23.754822    8241 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0811 23:02:23.759535    8241 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0811 23:02:23.773061    8241 certs.go:56] Setting up /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714 for IP: 192.168.49.2
	I0811 23:02:23.773090    8241 certs.go:190] acquiring lock for shared ca certs: {Name:mkb015b1abfb46823ddc64ddbe4b33bd353eab35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:23.773220    8241 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key
	I0811 23:02:24.567920    8241 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt ...
	I0811 23:02:24.567949    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt: {Name:mk29ec088e8ca57f425e9dc229cd69a15d9a0046 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:24.568144    8241 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key ...
	I0811 23:02:24.568160    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key: {Name:mkd35bb71cabbe17a703b378f34ed1427f2b65e2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:24.568241    8241 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key
	I0811 23:02:24.848834    8241 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.crt ...
	I0811 23:02:24.848860    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.crt: {Name:mkccd4cee2eeddf4771511e18ca40226a4203f54 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:24.849038    8241 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key ...
	I0811 23:02:24.849051    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key: {Name:mk08bc5d075b1b0a9c01f990a69641b468d1b3a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:24.849156    8241 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.key
	I0811 23:02:24.849172    8241 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt with IP's: []
	I0811 23:02:25.304101    8241 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt ...
	I0811 23:02:25.304132    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: {Name:mk4fac9d43694354910d573c9f4a007712373908 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:25.304320    8241 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.key ...
	I0811 23:02:25.304332    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.key: {Name:mk6daa095c3b99ad7805b13ec10281619ec0a02b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:25.304411    8241 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.key.dd3b5fb2
	I0811 23:02:25.304438    8241 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0811 23:02:26.623164    8241 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.crt.dd3b5fb2 ...
	I0811 23:02:26.623198    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.crt.dd3b5fb2: {Name:mkee96cc5640c9b0aa737e93a6794298cc2bbd00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:26.623379    8241 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.key.dd3b5fb2 ...
	I0811 23:02:26.623391    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.key.dd3b5fb2: {Name:mk7db3cc934634197d45e731dca255ca08b64d6e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:26.623475    8241 certs.go:337] copying /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.crt
	I0811 23:02:26.623548    8241 certs.go:341] copying /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.key
	I0811 23:02:26.623596    8241 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/proxy-client.key
	I0811 23:02:26.623614    8241 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/proxy-client.crt with IP's: []
	I0811 23:02:27.096896    8241 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/proxy-client.crt ...
	I0811 23:02:27.096936    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/proxy-client.crt: {Name:mk39cfcad92e0495f31738b31df5348da9f7a80c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:27.097178    8241 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/proxy-client.key ...
	I0811 23:02:27.097192    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/proxy-client.key: {Name:mk880ee510009f8d61edd54826246965541d59fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:27.097395    8241 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem (1675 bytes)
	I0811 23:02:27.097436    8241 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem (1078 bytes)
	I0811 23:02:27.097469    8241 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem (1123 bytes)
	I0811 23:02:27.097499    8241 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem (1675 bytes)
	I0811 23:02:27.098155    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0811 23:02:27.127915    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0811 23:02:27.158939    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0811 23:02:27.188535    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0811 23:02:27.218216    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0811 23:02:27.247183    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0811 23:02:27.276211    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0811 23:02:27.305694    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0811 23:02:27.335543    8241 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0811 23:02:27.364471    8241 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0811 23:02:27.385507    8241 ssh_runner.go:195] Run: openssl version
	I0811 23:02:27.392820    8241 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0811 23:02:27.404336    8241 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:02:27.408941    8241 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Aug 11 23:02 /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:02:27.409022    8241 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:02:27.417576    8241 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0811 23:02:27.429218    8241 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0811 23:02:27.433462    8241 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0811 23:02:27.433510    8241 kubeadm.go:404] StartCluster: {Name:addons-796714 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:addons-796714 Namespace:default APIServerName:minikubeCA APIServerNames:[] APISe
rverIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disa
bleMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:02:27.433593    8241 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0811 23:02:27.433662    8241 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0811 23:02:27.476321    8241 cri.go:89] found id: ""
	I0811 23:02:27.476390    8241 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0811 23:02:27.487045    8241 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0811 23:02:27.498096    8241 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0811 23:02:27.498159    8241 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0811 23:02:27.509272    8241 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0811 23:02:27.509323    8241 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0811 23:02:27.563781    8241 kubeadm.go:322] [init] Using Kubernetes version: v1.27.4
	I0811 23:02:27.564229    8241 kubeadm.go:322] [preflight] Running pre-flight checks
	I0811 23:02:27.611167    8241 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0811 23:02:27.611244    8241 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1040-aws
	I0811 23:02:27.611289    8241 kubeadm.go:322] OS: Linux
	I0811 23:02:27.611343    8241 kubeadm.go:322] CGROUPS_CPU: enabled
	I0811 23:02:27.611398    8241 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0811 23:02:27.611454    8241 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0811 23:02:27.611510    8241 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0811 23:02:27.611568    8241 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0811 23:02:27.611620    8241 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0811 23:02:27.611673    8241 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0811 23:02:27.611728    8241 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0811 23:02:27.611776    8241 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0811 23:02:27.687523    8241 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0811 23:02:27.687642    8241 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0811 23:02:27.687744    8241 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0811 23:02:27.933626    8241 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0811 23:02:27.935880    8241 out.go:204]   - Generating certificates and keys ...
	I0811 23:02:27.936100    8241 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0811 23:02:27.936204    8241 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0811 23:02:28.955120    8241 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0811 23:02:29.145901    8241 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0811 23:02:29.545922    8241 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0811 23:02:30.228049    8241 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0811 23:02:30.440878    8241 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0811 23:02:30.441349    8241 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-796714 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0811 23:02:30.587972    8241 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0811 23:02:30.588347    8241 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-796714 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0811 23:02:31.132825    8241 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0811 23:02:31.303222    8241 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0811 23:02:31.561848    8241 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0811 23:02:31.562172    8241 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0811 23:02:32.254733    8241 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0811 23:02:32.823064    8241 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0811 23:02:33.140709    8241 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0811 23:02:33.958209    8241 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0811 23:02:33.972948    8241 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0811 23:02:33.973816    8241 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0811 23:02:33.974142    8241 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0811 23:02:34.099385    8241 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0811 23:02:34.101918    8241 out.go:204]   - Booting up control plane ...
	I0811 23:02:34.102016    8241 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0811 23:02:34.102132    8241 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0811 23:02:34.102201    8241 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0811 23:02:34.103448    8241 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0811 23:02:34.106411    8241 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0811 23:02:42.111239    8241 kubeadm.go:322] [apiclient] All control plane components are healthy after 8.004219 seconds
	I0811 23:02:42.111601    8241 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0811 23:02:42.129420    8241 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0811 23:02:42.663201    8241 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0811 23:02:42.663434    8241 kubeadm.go:322] [mark-control-plane] Marking the node addons-796714 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0811 23:02:43.174875    8241 kubeadm.go:322] [bootstrap-token] Using token: 8q1ppa.nau1ez26jswuvgzs
	I0811 23:02:43.176995    8241 out.go:204]   - Configuring RBAC rules ...
	I0811 23:02:43.177125    8241 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0811 23:02:43.184861    8241 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0811 23:02:43.194034    8241 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0811 23:02:43.198041    8241 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0811 23:02:43.202195    8241 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0811 23:02:43.206116    8241 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0811 23:02:43.220764    8241 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0811 23:02:43.461279    8241 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0811 23:02:43.594741    8241 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0811 23:02:43.596102    8241 kubeadm.go:322] 
	I0811 23:02:43.596170    8241 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0811 23:02:43.596176    8241 kubeadm.go:322] 
	I0811 23:02:43.596247    8241 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0811 23:02:43.596252    8241 kubeadm.go:322] 
	I0811 23:02:43.596276    8241 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0811 23:02:43.596378    8241 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0811 23:02:43.596427    8241 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0811 23:02:43.596432    8241 kubeadm.go:322] 
	I0811 23:02:43.596482    8241 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0811 23:02:43.596486    8241 kubeadm.go:322] 
	I0811 23:02:43.596531    8241 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0811 23:02:43.596535    8241 kubeadm.go:322] 
	I0811 23:02:43.596584    8241 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0811 23:02:43.596654    8241 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0811 23:02:43.596719    8241 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0811 23:02:43.596723    8241 kubeadm.go:322] 
	I0811 23:02:43.596802    8241 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0811 23:02:43.596874    8241 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0811 23:02:43.596879    8241 kubeadm.go:322] 
	I0811 23:02:43.596957    8241 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 8q1ppa.nau1ez26jswuvgzs \
	I0811 23:02:43.597053    8241 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:bbf85a3fea899a66ee2fb9bfde62b7fa4a645e2f7bca9815ad7b4d5cc9dc9c3a \
	I0811 23:02:43.597107    8241 kubeadm.go:322] 	--control-plane 
	I0811 23:02:43.597112    8241 kubeadm.go:322] 
	I0811 23:02:43.597192    8241 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0811 23:02:43.597197    8241 kubeadm.go:322] 
	I0811 23:02:43.597278    8241 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 8q1ppa.nau1ez26jswuvgzs \
	I0811 23:02:43.597374    8241 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:bbf85a3fea899a66ee2fb9bfde62b7fa4a645e2f7bca9815ad7b4d5cc9dc9c3a 
	I0811 23:02:43.601733    8241 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1040-aws\n", err: exit status 1
	I0811 23:02:43.601845    8241 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0811 23:02:43.601859    8241 cni.go:84] Creating CNI manager for ""
	I0811 23:02:43.601865    8241 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:02:43.604244    8241 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0811 23:02:43.605958    8241 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0811 23:02:43.611633    8241 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.27.4/kubectl ...
	I0811 23:02:43.611656    8241 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0811 23:02:43.638885    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0811 23:02:44.623879    8241 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0811 23:02:44.623995    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:44.624069    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl label nodes minikube.k8s.io/version=v1.31.1 minikube.k8s.io/commit=0bff008270ec17d4e0c2c90a14e18ac31a0e01f5 minikube.k8s.io/name=addons-796714 minikube.k8s.io/updated_at=2023_08_11T23_02_44_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:44.851514    8241 ops.go:34] apiserver oom_adj: -16
	I0811 23:02:44.851598    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:44.958061    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:45.622124    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:46.122072    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:46.622033    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:47.122018    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:47.622249    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:48.121985    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:48.621960    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:49.121990    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:49.622019    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:50.122002    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:50.622053    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:51.122002    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:51.622491    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:52.121960    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:52.622555    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:53.122406    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:53.622761    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:54.122279    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:54.622028    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:55.122563    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:55.622832    8241 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:02:55.835862    8241 kubeadm.go:1081] duration metric: took 11.211912836s to wait for elevateKubeSystemPrivileges.
	I0811 23:02:55.835919    8241 kubeadm.go:406] StartCluster complete in 28.402411967s
	I0811 23:02:55.835936    8241 settings.go:142] acquiring lock: {Name:mk421b926e53f49ddfd3f30cfdf5667f56cebbb4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:55.836045    8241 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:02:55.836428    8241 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/kubeconfig: {Name:mka6624c250fdc5498ab30cb4943888e3cdba6af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:02:55.836760    8241 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0811 23:02:55.837031    8241 config.go:182] Loaded profile config "addons-796714": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:02:55.837066    8241 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]
	I0811 23:02:55.837139    8241 addons.go:69] Setting volumesnapshots=true in profile "addons-796714"
	I0811 23:02:55.837157    8241 addons.go:231] Setting addon volumesnapshots=true in "addons-796714"
	I0811 23:02:55.837191    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.837664    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.838014    8241 addons.go:69] Setting ingress=true in profile "addons-796714"
	I0811 23:02:55.838045    8241 addons.go:231] Setting addon ingress=true in "addons-796714"
	I0811 23:02:55.838087    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.838523    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.838643    8241 addons.go:69] Setting ingress-dns=true in profile "addons-796714"
	I0811 23:02:55.838655    8241 addons.go:231] Setting addon ingress-dns=true in "addons-796714"
	I0811 23:02:55.838692    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.839145    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.839212    8241 addons.go:69] Setting inspektor-gadget=true in profile "addons-796714"
	I0811 23:02:55.839222    8241 addons.go:231] Setting addon inspektor-gadget=true in "addons-796714"
	I0811 23:02:55.839253    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.839624    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.839683    8241 addons.go:69] Setting metrics-server=true in profile "addons-796714"
	I0811 23:02:55.839693    8241 addons.go:231] Setting addon metrics-server=true in "addons-796714"
	I0811 23:02:55.839717    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.840061    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.840208    8241 addons.go:69] Setting registry=true in profile "addons-796714"
	I0811 23:02:55.840221    8241 addons.go:231] Setting addon registry=true in "addons-796714"
	I0811 23:02:55.840249    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.840633    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.840692    8241 addons.go:69] Setting storage-provisioner=true in profile "addons-796714"
	I0811 23:02:55.840701    8241 addons.go:231] Setting addon storage-provisioner=true in "addons-796714"
	I0811 23:02:55.840728    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.841081    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.844449    8241 addons.go:69] Setting cloud-spanner=true in profile "addons-796714"
	I0811 23:02:55.844474    8241 addons.go:231] Setting addon cloud-spanner=true in "addons-796714"
	I0811 23:02:55.844521    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.844941    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.849641    8241 addons.go:69] Setting gcp-auth=true in profile "addons-796714"
	I0811 23:02:55.849668    8241 mustload.go:65] Loading cluster: addons-796714
	I0811 23:02:55.849865    8241 config.go:182] Loaded profile config "addons-796714": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:02:55.850100    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.850502    8241 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-796714"
	I0811 23:02:55.850573    8241 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-796714"
	I0811 23:02:55.850624    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:55.851160    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.851277    8241 addons.go:69] Setting default-storageclass=true in profile "addons-796714"
	I0811 23:02:55.851321    8241 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-796714"
	I0811 23:02:55.851585    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:55.980386    8241 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.8.1
	I0811 23:02:55.984736    8241 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0811 23:02:55.995144    8241 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0811 23:02:56.011223    8241 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0811 23:02:56.015937    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16083 bytes)
	I0811 23:02:56.016200    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.019554    8241 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.9
	I0811 23:02:56.025031    8241 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
	I0811 23:02:56.025162    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1003 bytes)
	I0811 23:02:56.025251    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.031222    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0811 23:02:56.040312    8241 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0811 23:02:56.040333    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0811 23:02:56.040390    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.031206    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:56.088801    8241 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I0811 23:02:56.095121    8241 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4
	I0811 23:02:56.097172    8241 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0811 23:02:56.097194    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0811 23:02:56.097261    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.095214    8241 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0811 23:02:56.102397    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0811 23:02:56.102468    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.095223    8241 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.19.0
	I0811 23:02:56.112489    8241 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0811 23:02:56.112513    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0811 23:02:56.112577    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.120272    8241 out.go:177]   - Using image docker.io/registry:2.8.1
	I0811 23:02:56.129563    8241 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I0811 23:02:56.147277    8241 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
	I0811 23:02:56.147369    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I0811 23:02:56.147522    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.157978    8241 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0811 23:02:56.151886    8241 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-796714" context rescaled to 1 replicas
	I0811 23:02:56.161707    8241 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0811 23:02:56.185493    8241 out.go:177] * Verifying Kubernetes components...
	I0811 23:02:56.195667    8241 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0811 23:02:56.185472    8241 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0811 23:02:56.197393    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0811 23:02:56.197507    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.206277    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0811 23:02:56.208218    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0811 23:02:56.212542    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0811 23:02:56.215061    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0811 23:02:56.217224    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0811 23:02:56.219501    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0811 23:02:56.221737    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0811 23:02:56.223868    8241 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0811 23:02:56.226560    8241 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0811 23:02:56.226577    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0811 23:02:56.226643    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.265494    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.269128    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.303794    8241 addons.go:231] Setting addon default-storageclass=true in "addons-796714"
	I0811 23:02:56.303839    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:02:56.304272    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:02:56.323149    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.335578    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.338333    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.403696    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.413632    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.424139    8241 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0811 23:02:56.424158    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0811 23:02:56.424233    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:02:56.453244    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.460962    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.503814    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:02:56.704708    8241 node_ready.go:35] waiting up to 6m0s for node "addons-796714" to be "Ready" ...
	I0811 23:02:56.705138    8241 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0811 23:02:56.709341    8241 node_ready.go:49] node "addons-796714" has status "Ready":"True"
	I0811 23:02:56.709366    8241 node_ready.go:38] duration metric: took 4.591664ms waiting for node "addons-796714" to be "Ready" ...
	I0811 23:02:56.709376    8241 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0811 23:02:56.718604    8241 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace to be "Ready" ...
	I0811 23:02:57.066411    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0811 23:02:57.075270    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0811 23:02:57.079108    8241 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
	I0811 23:02:57.079129    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0811 23:02:57.120268    8241 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0811 23:02:57.120292    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0811 23:02:57.143456    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0811 23:02:57.157700    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0811 23:02:57.211783    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0811 23:02:57.234025    8241 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0811 23:02:57.234049    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0811 23:02:57.253917    8241 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0811 23:02:57.253945    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0811 23:02:57.268049    8241 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0811 23:02:57.268126    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0811 23:02:57.286344    8241 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0811 23:02:57.286414    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0811 23:02:57.321846    8241 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0811 23:02:57.321914    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0811 23:02:57.334777    8241 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0811 23:02:57.334836    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0811 23:02:57.365440    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0811 23:02:57.392861    8241 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0811 23:02:57.392929    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0811 23:02:57.496136    8241 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
	I0811 23:02:57.496205    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0811 23:02:57.539119    8241 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0811 23:02:57.539188    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0811 23:02:57.572443    8241 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0811 23:02:57.572510    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0811 23:02:57.596840    8241 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0811 23:02:57.596906    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0811 23:02:57.661597    8241 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0811 23:02:57.661664    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0811 23:02:57.792330    8241 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0811 23:02:57.792401    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0811 23:02:57.808876    8241 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0811 23:02:57.808944    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0811 23:02:57.873731    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0811 23:02:57.973610    8241 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0811 23:02:57.973676    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0811 23:02:57.998567    8241 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0811 23:02:57.998637    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0811 23:02:58.016727    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0811 23:02:58.143575    8241 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0811 23:02:58.143645    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0811 23:02:58.182537    8241 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0811 23:02:58.182613    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0811 23:02:58.398553    8241 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0811 23:02:58.398619    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0811 23:02:58.453044    8241 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
	I0811 23:02:58.453135    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0811 23:02:58.761508    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:02:58.805499    8241 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0811 23:02:58.805519    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I0811 23:02:58.815522    8241 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0811 23:02:58.815552    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0811 23:02:58.973845    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0811 23:02:59.008086    8241 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0811 23:02:59.008180    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0811 23:02:59.047609    8241 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.342393812s)
	I0811 23:02:59.047708    8241 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0811 23:02:59.165923    8241 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0811 23:02:59.165998    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0811 23:02:59.332299    8241 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0811 23:02:59.332366    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0811 23:02:59.466170    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0811 23:03:00.867003    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:02.877196    8241 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0811 23:03:02.877335    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:03:02.904513    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:03:03.101818    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (6.035323918s)
	I0811 23:03:03.101850    8241 addons.go:467] Verifying addon ingress=true in "addons-796714"
	I0811 23:03:03.103915    8241 out.go:177] * Verifying ingress addon...
	I0811 23:03:03.102061    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (6.026767604s)
	I0811 23:03:03.102112    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (5.958630907s)
	I0811 23:03:03.102147    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (5.94442562s)
	I0811 23:03:03.102190    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (5.890384929s)
	I0811 23:03:03.102215    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (5.736708764s)
	I0811 23:03:03.102296    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (5.228502893s)
	I0811 23:03:03.102350    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (5.085552641s)
	I0811 23:03:03.102412    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.128482493s)
	I0811 23:03:03.106435    8241 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0811 23:03:03.106646    8241 addons.go:467] Verifying addon registry=true in "addons-796714"
	I0811 23:03:03.108697    8241 out.go:177] * Verifying registry addon...
	W0811 23:03:03.107220    8241 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0811 23:03:03.107235    8241 addons.go:467] Verifying addon metrics-server=true in "addons-796714"
	I0811 23:03:03.108859    8241 retry.go:31] will retry after 287.523665ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0811 23:03:03.114763    8241 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0811 23:03:03.120385    8241 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0811 23:03:03.120410    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:03.121984    8241 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0811 23:03:03.122043    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:03.127783    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:03.128567    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:03.213715    8241 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0811 23:03:03.242786    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:03.276246    8241 addons.go:231] Setting addon gcp-auth=true in "addons-796714"
	I0811 23:03:03.276338    8241 host.go:66] Checking if "addons-796714" exists ...
	I0811 23:03:03.276868    8241 cli_runner.go:164] Run: docker container inspect addons-796714 --format={{.State.Status}}
	I0811 23:03:03.317560    8241 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0811 23:03:03.317634    8241 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-796714
	I0811 23:03:03.350822    8241 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/addons-796714/id_rsa Username:docker}
	I0811 23:03:03.397046    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0811 23:03:03.635470    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:03.636300    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:04.142179    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:04.155357    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:04.361382    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.895107349s)
	I0811 23:03:04.361460    8241 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-796714"
	I0811 23:03:04.363767    8241 out.go:177] * Verifying csi-hostpath-driver addon...
	I0811 23:03:04.366371    8241 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0811 23:03:04.441359    8241 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0811 23:03:04.441429    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:04.499485    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:04.634797    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:04.635856    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:05.006378    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:05.139689    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:05.140230    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:05.219989    8241 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.822900607s)
	I0811 23:03:05.220072    8241 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (1.902490096s)
	I0811 23:03:05.225659    8241 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0811 23:03:05.227765    8241 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I0811 23:03:05.229894    8241 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0811 23:03:05.229923    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0811 23:03:05.263952    8241 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0811 23:03:05.263979    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0811 23:03:05.290807    8241 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0811 23:03:05.290831    8241 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)
	I0811 23:03:05.320818    8241 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0811 23:03:05.505442    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:05.635720    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:05.636877    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:05.743106    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:06.017871    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:06.136971    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:06.137707    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:06.148845    8241 addons.go:467] Verifying addon gcp-auth=true in "addons-796714"
	I0811 23:03:06.150997    8241 out.go:177] * Verifying gcp-auth addon...
	I0811 23:03:06.153993    8241 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0811 23:03:06.158069    8241 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0811 23:03:06.158095    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:06.161310    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:06.510077    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:06.635661    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:06.636349    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:06.665015    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:07.006637    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:07.135460    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:07.136204    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:07.165293    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:07.506357    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:07.634063    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:07.635859    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:07.666214    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:08.006885    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:08.134661    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:08.135597    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:08.166002    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:08.242977    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:08.509894    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:08.632835    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:08.636281    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:08.665882    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:09.010074    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:09.133604    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:09.137338    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:09.165718    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:09.505974    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:09.635548    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:09.636656    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:09.668911    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:10.006973    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:10.135653    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:10.137164    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:10.166383    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:10.243879    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:10.506138    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:10.633034    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:10.635638    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:10.665919    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:11.006646    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:11.136103    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:11.137778    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:11.166079    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:11.506311    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:11.639334    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:11.640898    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:11.665700    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:12.007350    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:12.136717    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:12.137745    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:12.166063    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:12.505603    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:12.634753    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:12.636323    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:12.665254    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:12.743557    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:13.007202    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:13.135710    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:13.138188    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:13.165468    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:13.508552    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:13.635246    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:13.637933    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:13.666898    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:14.010588    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:14.135557    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:14.135812    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:14.165589    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:14.506960    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:14.639189    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:14.640433    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:14.665917    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:14.743882    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:15.009760    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:15.134107    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:15.135993    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:15.164960    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:15.506443    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:15.634668    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:15.642674    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:15.675211    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:16.009264    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:16.133116    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:16.135613    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:16.165688    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:16.505771    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:16.636599    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:16.637711    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:16.665835    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:17.007222    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:17.134723    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:17.134788    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:17.165426    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:17.242096    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:17.512328    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:17.635972    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:17.636648    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:17.668238    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:18.006536    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:18.134267    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:18.134445    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:18.165059    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:18.506502    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:18.634191    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:18.634461    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:18.665922    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:19.005922    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:19.132485    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:19.134961    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:19.165135    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:19.242164    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:19.505504    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:19.634803    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:19.634839    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:19.665384    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:20.008487    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:20.134473    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:20.135353    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:20.165743    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:20.505645    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:20.634050    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:20.634918    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:20.665750    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:21.006680    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:21.133314    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:21.134986    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:21.165214    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:21.243051    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:21.505958    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:21.632575    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:21.636063    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:21.666499    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:22.008510    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:22.135809    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:22.136657    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:22.165330    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:22.507616    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:22.635487    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:22.636760    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:22.666036    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:23.009699    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:23.133939    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:23.135060    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:23.165106    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:23.505788    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:23.633554    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:23.639040    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:23.667680    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:23.742288    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:24.005824    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:24.133050    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:24.134148    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:24.165455    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:24.505830    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:24.634739    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:24.638892    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:24.664992    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:25.007925    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:25.134345    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:25.135173    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:25.165597    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:25.505216    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:25.636689    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:25.637236    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:25.665329    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:26.007596    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:26.133456    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:26.135308    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:26.170598    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:26.242337    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:26.506020    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:26.633794    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:26.635459    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:26.665503    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:27.005842    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:27.132497    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:27.135083    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:27.165958    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:27.505101    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:27.634060    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:27.636817    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:27.666125    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:28.006451    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:28.133452    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:28.134892    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:28.164785    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:28.243553    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:28.505229    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:28.634126    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:28.635542    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:28.665662    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:29.005878    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:29.136846    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:29.140790    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:29.165981    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:29.506627    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:29.633660    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:29.635975    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:29.666318    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:30.006091    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:30.138914    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:30.144049    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:30.166027    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:30.244430    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:30.507128    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:30.635183    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:30.636851    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:30.665747    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:31.006706    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:31.137497    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:31.139829    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:31.166101    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:31.506295    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:31.636633    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:31.637542    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:31.666225    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:32.008390    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:32.136361    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:32.136627    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:32.165191    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:32.505137    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:32.634590    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:32.634791    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:32.665125    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:32.742448    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:33.006820    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:33.142817    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:33.143360    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:33.166025    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:33.520896    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:33.634483    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:33.636929    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:33.665903    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:34.005846    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:34.133740    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:34.137042    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:34.166993    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:34.506953    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:34.637119    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:34.640497    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:34.666505    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:34.749660    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:35.007877    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:35.137452    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:35.139783    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:35.165859    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:35.507651    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:35.635576    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:35.637308    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:35.669221    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:36.031367    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:36.133326    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:36.135384    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:36.167104    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:36.505557    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:36.633644    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:36.633766    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:36.665416    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:37.008680    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:37.142299    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:37.143546    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:37.166342    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:37.245244    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:37.506511    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:37.635657    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:37.638182    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:37.666433    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:38.015564    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:38.134227    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:38.134548    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:38.164798    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:38.508748    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:38.638944    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:38.641146    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:38.671220    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:39.011147    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:39.133890    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:39.134823    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:39.165539    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:39.246309    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:39.506727    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:39.634970    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:39.635937    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:39.666602    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:40.023791    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:40.134235    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:40.137942    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:40.170882    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:40.506355    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:40.635554    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:40.636740    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:40.665482    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:41.005921    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:41.145189    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:41.146254    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:41.166401    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:41.505696    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:41.636724    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:41.637604    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:41.666696    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:41.742386    8241 pod_ready.go:102] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"False"
	I0811 23:03:42.012010    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:42.137251    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:42.139678    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:42.167052    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:42.246094    8241 pod_ready.go:92] pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace has status "Ready":"True"
	I0811 23:03:42.246183    8241 pod_ready.go:81] duration metric: took 45.527534988s waiting for pod "coredns-5d78c9869d-sm42t" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.246208    8241 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-tll59" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.255723    8241 pod_ready.go:97] error getting pod "coredns-5d78c9869d-tll59" in "kube-system" namespace (skipping!): pods "coredns-5d78c9869d-tll59" not found
	I0811 23:03:42.255801    8241 pod_ready.go:81] duration metric: took 9.573584ms waiting for pod "coredns-5d78c9869d-tll59" in "kube-system" namespace to be "Ready" ...
	E0811 23:03:42.255828    8241 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5d78c9869d-tll59" in "kube-system" namespace (skipping!): pods "coredns-5d78c9869d-tll59" not found
	I0811 23:03:42.255865    8241 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-796714" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.268709    8241 pod_ready.go:92] pod "etcd-addons-796714" in "kube-system" namespace has status "Ready":"True"
	I0811 23:03:42.268793    8241 pod_ready.go:81] duration metric: took 12.902701ms waiting for pod "etcd-addons-796714" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.268826    8241 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-796714" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.276797    8241 pod_ready.go:92] pod "kube-apiserver-addons-796714" in "kube-system" namespace has status "Ready":"True"
	I0811 23:03:42.276866    8241 pod_ready.go:81] duration metric: took 8.004711ms waiting for pod "kube-apiserver-addons-796714" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.276958    8241 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-796714" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.296097    8241 pod_ready.go:92] pod "kube-controller-manager-addons-796714" in "kube-system" namespace has status "Ready":"True"
	I0811 23:03:42.296181    8241 pod_ready.go:81] duration metric: took 19.195954ms waiting for pod "kube-controller-manager-addons-796714" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.296210    8241 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pdw4t" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.439425    8241 pod_ready.go:92] pod "kube-proxy-pdw4t" in "kube-system" namespace has status "Ready":"True"
	I0811 23:03:42.439451    8241 pod_ready.go:81] duration metric: took 143.219087ms waiting for pod "kube-proxy-pdw4t" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.439463    8241 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-796714" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.505739    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:42.639603    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:42.640982    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:42.665370    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:42.839958    8241 pod_ready.go:92] pod "kube-scheduler-addons-796714" in "kube-system" namespace has status "Ready":"True"
	I0811 23:03:42.839983    8241 pod_ready.go:81] duration metric: took 400.512452ms waiting for pod "kube-scheduler-addons-796714" in "kube-system" namespace to be "Ready" ...
	I0811 23:03:42.839993    8241 pod_ready.go:38] duration metric: took 46.130606534s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0811 23:03:42.840036    8241 api_server.go:52] waiting for apiserver process to appear ...
	I0811 23:03:42.840119    8241 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:03:42.858566    8241 api_server.go:72] duration metric: took 46.696652628s to wait for apiserver process to appear ...
	I0811 23:03:42.858590    8241 api_server.go:88] waiting for apiserver healthz status ...
	I0811 23:03:42.858607    8241 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0811 23:03:42.867917    8241 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0811 23:03:42.869214    8241 api_server.go:141] control plane version: v1.27.4
	I0811 23:03:42.869239    8241 api_server.go:131] duration metric: took 10.642149ms to wait for apiserver health ...
	I0811 23:03:42.869248    8241 system_pods.go:43] waiting for kube-system pods to appear ...
	I0811 23:03:43.006936    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:43.048468    8241 system_pods.go:59] 17 kube-system pods found
	I0811 23:03:43.048502    8241 system_pods.go:61] "coredns-5d78c9869d-sm42t" [bef7fa3e-57b9-4316-82eb-263014aded51] Running
	I0811 23:03:43.048509    8241 system_pods.go:61] "csi-hostpath-attacher-0" [99d2a191-24ff-4cfc-9e49-9116be161252] Running
	I0811 23:03:43.048540    8241 system_pods.go:61] "csi-hostpath-resizer-0" [8a1a8823-8748-4cdb-9fca-9ded81b4e8a8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0811 23:03:43.048559    8241 system_pods.go:61] "csi-hostpathplugin-4485d" [5f9fee99-159e-4633-b6ef-8ea542689ead] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0811 23:03:43.048566    8241 system_pods.go:61] "etcd-addons-796714" [e232037b-f17d-4a40-b0e0-96b46f37635e] Running
	I0811 23:03:43.048577    8241 system_pods.go:61] "kindnet-knm4f" [4d73fbc4-8ba1-4f7e-a510-0622f38b9f46] Running
	I0811 23:03:43.048583    8241 system_pods.go:61] "kube-apiserver-addons-796714" [7bca40ad-b77a-4509-aa2a-189b4cd88f8a] Running
	I0811 23:03:43.048589    8241 system_pods.go:61] "kube-controller-manager-addons-796714" [72777e02-ac07-4424-ba2a-dbd6d8457c37] Running
	I0811 23:03:43.048600    8241 system_pods.go:61] "kube-ingress-dns-minikube" [2840266f-5981-427c-a50c-9f59cafe54a4] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0811 23:03:43.048621    8241 system_pods.go:61] "kube-proxy-pdw4t" [6d168db2-1466-4fd5-afa2-1f7bb2be8513] Running
	I0811 23:03:43.048634    8241 system_pods.go:61] "kube-scheduler-addons-796714" [0f3ba3e7-6b22-4b29-a40c-ca1399d648ee] Running
	I0811 23:03:43.048640    8241 system_pods.go:61] "metrics-server-7746886d4f-pwr5j" [cce24f1f-d87f-4635-bd93-c72768e696f5] Running
	I0811 23:03:43.048659    8241 system_pods.go:61] "registry-5fq8t" [4938621f-1e3d-4416-8891-7e69e530de46] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0811 23:03:43.048673    8241 system_pods.go:61] "registry-proxy-qkpbr" [62399753-60b9-4d67-8c7f-0c5029bf1445] Running
	I0811 23:03:43.048680    8241 system_pods.go:61] "snapshot-controller-75bbb956b9-j767n" [740b9318-26ba-4f57-9b6e-9ff8c308b03f] Running
	I0811 23:03:43.048689    8241 system_pods.go:61] "snapshot-controller-75bbb956b9-qtnwv" [905b2e27-416c-4704-966d-0d5241e6a583] Running
	I0811 23:03:43.048695    8241 system_pods.go:61] "storage-provisioner" [47d0320a-6ccf-40e3-8826-823bf8420ffb] Running
	I0811 23:03:43.048701    8241 system_pods.go:74] duration metric: took 179.426585ms to wait for pod list to return data ...
	I0811 23:03:43.048709    8241 default_sa.go:34] waiting for default service account to be created ...
	I0811 23:03:43.135740    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:43.137484    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:43.165882    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:43.252437    8241 default_sa.go:45] found service account: "default"
	I0811 23:03:43.252508    8241 default_sa.go:55] duration metric: took 203.78788ms for default service account to be created ...
	I0811 23:03:43.252531    8241 system_pods.go:116] waiting for k8s-apps to be running ...
	I0811 23:03:43.449386    8241 system_pods.go:86] 17 kube-system pods found
	I0811 23:03:43.449421    8241 system_pods.go:89] "coredns-5d78c9869d-sm42t" [bef7fa3e-57b9-4316-82eb-263014aded51] Running
	I0811 23:03:43.449430    8241 system_pods.go:89] "csi-hostpath-attacher-0" [99d2a191-24ff-4cfc-9e49-9116be161252] Running
	I0811 23:03:43.449439    8241 system_pods.go:89] "csi-hostpath-resizer-0" [8a1a8823-8748-4cdb-9fca-9ded81b4e8a8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0811 23:03:43.449451    8241 system_pods.go:89] "csi-hostpathplugin-4485d" [5f9fee99-159e-4633-b6ef-8ea542689ead] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0811 23:03:43.449457    8241 system_pods.go:89] "etcd-addons-796714" [e232037b-f17d-4a40-b0e0-96b46f37635e] Running
	I0811 23:03:43.449462    8241 system_pods.go:89] "kindnet-knm4f" [4d73fbc4-8ba1-4f7e-a510-0622f38b9f46] Running
	I0811 23:03:43.449497    8241 system_pods.go:89] "kube-apiserver-addons-796714" [7bca40ad-b77a-4509-aa2a-189b4cd88f8a] Running
	I0811 23:03:43.449513    8241 system_pods.go:89] "kube-controller-manager-addons-796714" [72777e02-ac07-4424-ba2a-dbd6d8457c37] Running
	I0811 23:03:43.449521    8241 system_pods.go:89] "kube-ingress-dns-minikube" [2840266f-5981-427c-a50c-9f59cafe54a4] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0811 23:03:43.449533    8241 system_pods.go:89] "kube-proxy-pdw4t" [6d168db2-1466-4fd5-afa2-1f7bb2be8513] Running
	I0811 23:03:43.449539    8241 system_pods.go:89] "kube-scheduler-addons-796714" [0f3ba3e7-6b22-4b29-a40c-ca1399d648ee] Running
	I0811 23:03:43.449546    8241 system_pods.go:89] "metrics-server-7746886d4f-pwr5j" [cce24f1f-d87f-4635-bd93-c72768e696f5] Running
	I0811 23:03:43.449573    8241 system_pods.go:89] "registry-5fq8t" [4938621f-1e3d-4416-8891-7e69e530de46] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0811 23:03:43.449589    8241 system_pods.go:89] "registry-proxy-qkpbr" [62399753-60b9-4d67-8c7f-0c5029bf1445] Running
	I0811 23:03:43.449595    8241 system_pods.go:89] "snapshot-controller-75bbb956b9-j767n" [740b9318-26ba-4f57-9b6e-9ff8c308b03f] Running
	I0811 23:03:43.449600    8241 system_pods.go:89] "snapshot-controller-75bbb956b9-qtnwv" [905b2e27-416c-4704-966d-0d5241e6a583] Running
	I0811 23:03:43.449621    8241 system_pods.go:89] "storage-provisioner" [47d0320a-6ccf-40e3-8826-823bf8420ffb] Running
	I0811 23:03:43.449628    8241 system_pods.go:126] duration metric: took 197.080046ms to wait for k8s-apps to be running ...
	I0811 23:03:43.449635    8241 system_svc.go:44] waiting for kubelet service to be running ....
	I0811 23:03:43.449708    8241 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0811 23:03:43.467348    8241 system_svc.go:56] duration metric: took 17.703814ms WaitForService to wait for kubelet.
	I0811 23:03:43.467373    8241 kubeadm.go:581] duration metric: took 47.305463963s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0811 23:03:43.467392    8241 node_conditions.go:102] verifying NodePressure condition ...
	I0811 23:03:43.505942    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:43.634675    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:43.639396    8241 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0811 23:03:43.639432    8241 node_conditions.go:123] node cpu capacity is 2
	I0811 23:03:43.639448    8241 node_conditions.go:105] duration metric: took 172.048537ms to run NodePressure ...
	I0811 23:03:43.639459    8241 start.go:228] waiting for startup goroutines ...
	I0811 23:03:43.640664    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:43.665241    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:44.010102    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:44.135538    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:44.137094    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:44.165975    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:44.509721    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:44.638634    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:44.640192    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:44.666446    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:45.010202    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:45.135406    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:45.136426    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:45.169830    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:45.506288    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:45.633941    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:45.634790    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:45.666102    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:46.006005    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:46.133219    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:46.136149    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:46.166150    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:46.507167    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:46.639585    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:46.641555    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:46.665507    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:47.006827    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:47.141862    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:47.142543    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:47.166410    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:47.505357    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:47.636927    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:47.639215    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:47.667365    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:48.009685    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:48.134509    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:48.136630    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:48.166330    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:48.505917    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:48.635671    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0811 23:03:48.636804    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:48.665705    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:49.005926    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:49.133518    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:49.135536    8241 kapi.go:107] duration metric: took 46.020778245s to wait for kubernetes.io/minikube-addons=registry ...
	I0811 23:03:49.166122    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:49.506210    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:49.633088    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:49.665734    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:50.008961    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:50.133687    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:50.166787    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:50.506303    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:50.632239    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:50.664916    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:51.008524    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:51.133363    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:51.165239    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:51.505170    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:51.633895    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:51.672579    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:52.023358    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:52.133656    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:52.165415    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:52.505535    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:52.632782    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:52.665844    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:53.010760    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:53.132933    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:53.165744    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:53.505051    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:53.632376    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:53.665056    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:54.006943    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:54.132946    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:54.165969    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:54.509770    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:54.633518    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:54.665910    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:55.011145    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0811 23:03:55.134191    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:55.166244    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:55.505237    8241 kapi.go:107] duration metric: took 51.138865453s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0811 23:03:55.633108    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:55.666196    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:56.132333    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:56.173956    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:56.633058    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:56.666185    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:57.132763    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:57.168385    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:57.633553    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:57.665282    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:58.132105    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:58.167321    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:58.634147    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:58.665847    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:59.133156    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:59.165690    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:03:59.632862    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:03:59.665540    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:00.137054    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:00.172669    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:00.632599    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:00.665590    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:01.133575    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:01.165526    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:01.632215    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:01.668235    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:02.132844    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:02.165743    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:02.633392    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:02.665131    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:03.133122    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:03.165935    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:03.632369    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:03.665420    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:04.133209    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:04.164815    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:04.633024    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:04.665922    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:05.137902    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:05.165544    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:05.632066    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:05.665803    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:06.132481    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:06.165439    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:06.632805    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:06.666194    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:07.134060    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:07.165694    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:07.634355    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:07.665444    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:08.134475    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:08.166916    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:08.635730    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:08.665792    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:09.133675    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:09.166152    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:09.633219    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:09.665828    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:10.133583    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:10.165868    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:10.632917    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:10.666003    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:11.132586    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:11.165495    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:11.632526    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:11.665109    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:12.139958    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:12.165912    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:12.635790    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:12.666371    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:13.141327    8241 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0811 23:04:13.174026    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:13.633021    8241 kapi.go:107] duration metric: took 1m10.526583043s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0811 23:04:13.667042    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:14.165645    8241 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0811 23:04:14.666890    8241 kapi.go:107] duration metric: took 1m8.512896311s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0811 23:04:14.669326    8241 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-796714 cluster.
	I0811 23:04:14.671338    8241 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0811 23:04:14.673941    8241 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0811 23:04:14.676303    8241 out.go:177] * Enabled addons: inspektor-gadget, cloud-spanner, default-storageclass, ingress-dns, storage-provisioner, metrics-server, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I0811 23:04:14.678463    8241 addons.go:502] enable addons completed in 1m18.841390866s: enabled=[inspektor-gadget cloud-spanner default-storageclass ingress-dns storage-provisioner metrics-server volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I0811 23:04:14.678502    8241 start.go:233] waiting for cluster config update ...
	I0811 23:04:14.678518    8241 start.go:242] writing updated cluster config ...
	I0811 23:04:14.678820    8241 ssh_runner.go:195] Run: rm -f paused
	I0811 23:04:15.050641    8241 start.go:599] kubectl: 1.27.4, cluster: 1.27.4 (minor skew: 0)
	I0811 23:04:15.052859    8241 out.go:177] * Done! kubectl is now configured to use "addons-796714" cluster and "default" namespace by default
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                                     ATTEMPT             POD ID              POD
	2ec4130fecc90       13753a81eccfd       6 seconds ago        Exited              hello-world-app                          2                   d7f698ae4fa51       hello-world-app-65bdb79f98-4h9mm
	99e501af47c4a       ff78c7a65ec2b       6 seconds ago        Running             task-pv-container                        0                   f260ebc7d1343       task-pv-pod-restore
	233cd255e2629       7987e0c18af05       32 seconds ago       Running             nginx                                    0                   ccaf9570e4434       nginx
	f898229398f9a       71e15c1ff4390       59 seconds ago       Running             headlamp                                 0                   a713e01a3cf14       headlamp-5c78f74d8d-4wf74
	2251635ed716e       2a5f29343eb03       About a minute ago   Running             gcp-auth                                 0                   55d260cdb2bac       gcp-auth-58478865f7-bqpvw
	1405b2ab1d47f       b26fbddce4d07       About a minute ago   Exited              controller                               0                   de55385cdab46       ingress-nginx-controller-7799c6795f-wllbx
	ae17c9ee0b5b5       ee6d597e62dc8       About a minute ago   Running             csi-snapshotter                          0                   d753e499984b8       csi-hostpathplugin-4485d
	3ea5972e2fddb       642ded511e141       About a minute ago   Running             csi-provisioner                          0                   d753e499984b8       csi-hostpathplugin-4485d
	71dd89b8eb728       922312104da8a       About a minute ago   Running             liveness-probe                           0                   d753e499984b8       csi-hostpathplugin-4485d
	87e6975614f43       08f6b2990811a       About a minute ago   Running             hostpath                                 0                   d753e499984b8       csi-hostpathplugin-4485d
	c2bf2348791eb       0107d56dbc0be       About a minute ago   Running             node-driver-registrar                    0                   d753e499984b8       csi-hostpathplugin-4485d
	4001b44583655       487fa743e1e22       About a minute ago   Running             csi-resizer                              0                   85862d7b1a7ee       csi-hostpath-resizer-0
	107a031179b29       8f2588812ab29       About a minute ago   Exited              patch                                    0                   b481deb5e7f68       ingress-nginx-admission-patch-rfgrn
	2204e3992cc93       9a80d518f102c       About a minute ago   Running             csi-attacher                             0                   4b0f84521fc86       csi-hostpath-attacher-0
	9e13325edc6a5       97e04611ad434       About a minute ago   Running             coredns                                  0                   0aae52e08d15e       coredns-5d78c9869d-sm42t
	57f0eac0b326c       4d1e5c3e97420       About a minute ago   Running             volume-snapshot-controller               0                   fe2018117ffe0       snapshot-controller-75bbb956b9-qtnwv
	8703e76cae641       4d1e5c3e97420       About a minute ago   Running             volume-snapshot-controller               0                   8f975b53d2ab1       snapshot-controller-75bbb956b9-j767n
	571bd09305998       8f2588812ab29       About a minute ago   Exited              create                                   0                   9afc1a1f64a09       ingress-nginx-admission-create-xfz69
	ae1603b471a03       1461903ec4fe9       About a minute ago   Running             csi-external-health-monitor-controller   0                   d753e499984b8       csi-hostpathplugin-4485d
	dd106fc099643       ba04bb24b9575       2 minutes ago        Running             storage-provisioner                      0                   a024901b86247       storage-provisioner
	7cad60cb78dd1       b18bf71b941ba       2 minutes ago        Running             kindnet-cni                              0                   76af1cfb0a060       kindnet-knm4f
	e7865323a1814       532e5a30e948f       2 minutes ago        Running             kube-proxy                               0                   162813501211e       kube-proxy-pdw4t
	13a979fb2f5a5       24bc64e911039       2 minutes ago        Running             etcd                                     0                   0d54fe71ecec9       etcd-addons-796714
	c2e04f816bc4a       6eb63895cb67f       2 minutes ago        Running             kube-scheduler                           0                   05f42d523a55c       kube-scheduler-addons-796714
	d3dcb84b80a35       64aece92d6bde       2 minutes ago        Running             kube-apiserver                           0                   78f3e21576898       kube-apiserver-addons-796714
	cfdf1b3997313       389f6f052cf83       2 minutes ago        Running             kube-controller-manager                  0                   8d374c77ab252       kube-controller-manager-addons-796714
	
	* 
	* ==> containerd <==
	* Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.199316176Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.199643201Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/f260ebc7d134394ac4051e7d1e342458aedd6b0fe74646625e89342950ebe5f6 pid=9240 runtime=io.containerd.runc.v2
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.266547449Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:task-pv-pod-restore,Uid:d966c6ee-1335-43ae-853e-332ebe709c25,Namespace:default,Attempt:0,} returns sandbox id \"f260ebc7d134394ac4051e7d1e342458aedd6b0fe74646625e89342950ebe5f6\""
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.269185323Z" level=info msg="PullImage \"docker.io/nginx:latest\""
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.271541373Z" level=error msg="failed to decode hosts.toml" error="invalid `host` tree"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.437917649Z" level=error msg="failed to decode hosts.toml" error="invalid `host` tree"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.455294261Z" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/library/nginx:latest,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.459377637Z" level=info msg="ImageUpdate event &ImageUpdate{Name:sha256:ff78c7a65ec2b1fb09f58b27b0dd022ac1f4e16b9bcfe1cbdc18c36f2e0e1842,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.462498004Z" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/library/nginx:latest,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.471890588Z" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/library/nginx@sha256:67f9a4f10d147a6e04629340e6493c9703300ca23a2f7f3aa56fe615d75d31ca,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.472464526Z" level=info msg="PullImage \"docker.io/nginx:latest\" returns image reference \"sha256:ff78c7a65ec2b1fb09f58b27b0dd022ac1f4e16b9bcfe1cbdc18c36f2e0e1842\""
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.479314176Z" level=info msg="CreateContainer within sandbox \"f260ebc7d134394ac4051e7d1e342458aedd6b0fe74646625e89342950ebe5f6\" for container &ContainerMetadata{Name:task-pv-container,Attempt:0,}"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.496983943Z" level=info msg="CreateContainer within sandbox \"f260ebc7d134394ac4051e7d1e342458aedd6b0fe74646625e89342950ebe5f6\" for &ContainerMetadata{Name:task-pv-container,Attempt:0,} returns container id \"99e501af47c4a94802d9b7a494e442a86d1048ae36c8166b26d9bec88ea0d52d\""
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.499633714Z" level=info msg="StartContainer for \"99e501af47c4a94802d9b7a494e442a86d1048ae36c8166b26d9bec88ea0d52d\""
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.590527059Z" level=info msg="StartContainer for \"99e501af47c4a94802d9b7a494e442a86d1048ae36c8166b26d9bec88ea0d52d\" returns successfully"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.591293313Z" level=info msg="CreateContainer within sandbox \"d7f698ae4fa5109c2e40a635fd5c2438e54c897afa994868abea5ce7b3a99441\" for container &ContainerMetadata{Name:hello-world-app,Attempt:2,}"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.612364812Z" level=info msg="CreateContainer within sandbox \"d7f698ae4fa5109c2e40a635fd5c2438e54c897afa994868abea5ce7b3a99441\" for &ContainerMetadata{Name:hello-world-app,Attempt:2,} returns container id \"2ec4130fecc90837ada12ef38da8d561f39f8dcddb0baaee808c180f40a8393e\""
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.614696894Z" level=info msg="StartContainer for \"2ec4130fecc90837ada12ef38da8d561f39f8dcddb0baaee808c180f40a8393e\""
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.700336030Z" level=info msg="StartContainer for \"2ec4130fecc90837ada12ef38da8d561f39f8dcddb0baaee808c180f40a8393e\" returns successfully"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.729909619Z" level=info msg="shim disconnected" id=2ec4130fecc90837ada12ef38da8d561f39f8dcddb0baaee808c180f40a8393e
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.729967710Z" level=warning msg="cleaning up after shim disconnected" id=2ec4130fecc90837ada12ef38da8d561f39f8dcddb0baaee808c180f40a8393e namespace=k8s.io
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.729981938Z" level=info msg="cleaning up dead shim"
	Aug 11 23:05:19 addons-796714 containerd[741]: time="2023-08-11T23:05:19.741564740Z" level=warning msg="cleanup warnings time=\"2023-08-11T23:05:19Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=9370 runtime=io.containerd.runc.v2\n"
	Aug 11 23:05:20 addons-796714 containerd[741]: time="2023-08-11T23:05:20.580759560Z" level=info msg="RemoveContainer for \"1cc46c9c6028cacc6a242023b0fd99f6b9e1b680125b3d57fbcad7e36ff40af0\""
	Aug 11 23:05:20 addons-796714 containerd[741]: time="2023-08-11T23:05:20.586616458Z" level=info msg="RemoveContainer for \"1cc46c9c6028cacc6a242023b0fd99f6b9e1b680125b3d57fbcad7e36ff40af0\" returns successfully"
	
	* 
	* ==> coredns [9e13325edc6a575d688c39e377bc5cf96113b36a329f9cfa3f9fac38c5a12263] <==
	* [INFO] 10.244.0.16:44151 - 7991 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000065262s
	[INFO] 10.244.0.16:44151 - 53834 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002651396s
	[INFO] 10.244.0.16:39489 - 20095 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.003471778s
	[INFO] 10.244.0.16:39489 - 20373 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.003675475s
	[INFO] 10.244.0.16:44151 - 18582 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.003236967s
	[INFO] 10.244.0.16:44151 - 39057 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000258662s
	[INFO] 10.244.0.16:39489 - 29400 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000155731s
	[INFO] 10.244.0.16:59523 - 52649 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000105319s
	[INFO] 10.244.0.16:56417 - 4767 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.00005718s
	[INFO] 10.244.0.16:56417 - 56129 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000068684s
	[INFO] 10.244.0.16:59523 - 36329 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000042772s
	[INFO] 10.244.0.16:56417 - 37092 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000043897s
	[INFO] 10.244.0.16:59523 - 43866 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000047335s
	[INFO] 10.244.0.16:56417 - 47694 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000137203s
	[INFO] 10.244.0.16:59523 - 27395 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000041116s
	[INFO] 10.244.0.16:59523 - 63110 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000066509s
	[INFO] 10.244.0.16:56417 - 18276 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000040606s
	[INFO] 10.244.0.16:59523 - 47653 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000038695s
	[INFO] 10.244.0.16:56417 - 62 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000135669s
	[INFO] 10.244.0.16:56417 - 57471 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001674093s
	[INFO] 10.244.0.16:59523 - 37685 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001979112s
	[INFO] 10.244.0.16:56417 - 65161 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001945514s
	[INFO] 10.244.0.16:56417 - 19453 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000087654s
	[INFO] 10.244.0.16:59523 - 55827 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001500132s
	[INFO] 10.244.0.16:59523 - 4093 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000151775s
	
	* 
	* ==> describe nodes <==
	* Name:               addons-796714
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-796714
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=0bff008270ec17d4e0c2c90a14e18ac31a0e01f5
	                    minikube.k8s.io/name=addons-796714
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_08_11T23_02_44_0700
	                    minikube.k8s.io/version=v1.31.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-796714
	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-796714"}
	                    kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Fri, 11 Aug 2023 23:02:40 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-796714
	  AcquireTime:     <unset>
	  RenewTime:       Fri, 11 Aug 2023 23:05:16 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Fri, 11 Aug 2023 23:05:16 +0000   Fri, 11 Aug 2023 23:02:36 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Fri, 11 Aug 2023 23:05:16 +0000   Fri, 11 Aug 2023 23:02:36 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Fri, 11 Aug 2023 23:05:16 +0000   Fri, 11 Aug 2023 23:02:36 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Fri, 11 Aug 2023 23:05:16 +0000   Fri, 11 Aug 2023 23:02:43 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-796714
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022624Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022624Ki
	  pods:               110
	System Info:
	  Machine ID:                 ebcb13b1648f4489ab8c3c8cbf0c6e07
	  System UUID:                4387209f-a7be-47c0-9302-e59cef2ea946
	  Boot ID:                    9de47e29-690d-4729-8666-b04b4dd58706
	  Kernel Version:             5.15.0-1040-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.6.21
	  Kubelet Version:            v1.27.4
	  Kube-Proxy Version:         v1.27.4
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (18 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-65bdb79f98-4h9mm         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         36s
	  default                     task-pv-pod-restore                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8s
	  gcp-auth                    gcp-auth-58478865f7-bqpvw                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m20s
	  headlamp                    headlamp-5c78f74d8d-4wf74                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         64s
	  kube-system                 coredns-5d78c9869d-sm42t                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     2m31s
	  kube-system                 csi-hostpath-attacher-0                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m22s
	  kube-system                 csi-hostpath-resizer-0                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m22s
	  kube-system                 csi-hostpathplugin-4485d                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m22s
	  kube-system                 etcd-addons-796714                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         2m43s
	  kube-system                 kindnet-knm4f                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      2m31s
	  kube-system                 kube-apiserver-addons-796714             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m43s
	  kube-system                 kube-controller-manager-addons-796714    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m43s
	  kube-system                 kube-proxy-pdw4t                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m31s
	  kube-system                 kube-scheduler-addons-796714             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m43s
	  kube-system                 snapshot-controller-75bbb956b9-j767n     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m25s
	  kube-system                 snapshot-controller-75bbb956b9-qtnwv     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m25s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m26s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (42%!)(MISSING)  100m (5%!)(MISSING)
	  memory             220Mi (2%!)(MISSING)  220Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 2m29s                  kube-proxy       
	  Normal  NodeHasSufficientMemory  2m51s (x8 over 2m51s)  kubelet          Node addons-796714 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m51s (x8 over 2m51s)  kubelet          Node addons-796714 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m51s (x7 over 2m51s)  kubelet          Node addons-796714 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  2m51s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  2m43s                  kubelet          Node addons-796714 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m43s                  kubelet          Node addons-796714 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m43s                  kubelet          Node addons-796714 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             2m43s                  kubelet          Node addons-796714 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  2m43s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                2m43s                  kubelet          Node addons-796714 status is now: NodeReady
	  Normal  Starting                 2m43s                  kubelet          Starting kubelet.
	  Normal  RegisteredNode           2m31s                  node-controller  Node addons-796714 event: Registered Node addons-796714 in Controller
	
	* 
	* ==> dmesg <==
	* [Aug11 22:17] ACPI: SRAT not present
	[  +0.000000] ACPI: SRAT not present
	[  +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
	[  +0.014370] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
	[  +1.268781] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
	[  +6.446867] kauditd_printk_skb: 26 callbacks suppressed
	
	* 
	* ==> etcd [13a979fb2f5a51cd44cf8d6e8e7e1c367ef048fb7ec54cb61fb099c429654b1f] <==
	* {"level":"info","ts":"2023-08-11T23:02:36.543Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-08-11T23:02:36.547Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2023-08-11T23:02:36.547Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2023-08-11T23:02:36.548Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-08-11T23:02:36.548Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-08-11T23:02:36.548Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-08-11T23:02:36.548Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2023-08-11T23:02:37.382Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-08-11T23:02:37.382Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-08-11T23:02:37.382Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-08-11T23:02:37.382Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-08-11T23:02:37.382Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-08-11T23:02:37.382Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-08-11T23:02:37.383Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-08-11T23:02:37.384Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-796714 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-08-11T23:02:37.385Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-08-11T23:02:37.386Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2023-08-11T23:02:37.389Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-08-11T23:02:37.389Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-08-11T23:02:37.390Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2023-08-11T23:02:37.391Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-08-11T23:02:37.391Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-08-11T23:02:37.391Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-08-11T23:02:37.395Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-08-11T23:02:37.395Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	
	* 
	* ==> gcp-auth [2251635ed716e9dc0a9eba0c75f40f5c364d0af30d61fae162448a5936612cfe] <==
	* 2023/08/11 23:04:14 GCP Auth Webhook started!
	2023/08/11 23:04:22 Ready to marshal response ...
	2023/08/11 23:04:22 Ready to write response ...
	2023/08/11 23:04:22 Ready to marshal response ...
	2023/08/11 23:04:22 Ready to write response ...
	2023/08/11 23:04:22 Ready to marshal response ...
	2023/08/11 23:04:22 Ready to write response ...
	2023/08/11 23:04:25 Ready to marshal response ...
	2023/08/11 23:04:25 Ready to write response ...
	2023/08/11 23:04:46 Ready to marshal response ...
	2023/08/11 23:04:46 Ready to write response ...
	2023/08/11 23:04:50 Ready to marshal response ...
	2023/08/11 23:04:50 Ready to write response ...
	2023/08/11 23:04:59 Ready to marshal response ...
	2023/08/11 23:04:59 Ready to write response ...
	2023/08/11 23:05:18 Ready to marshal response ...
	2023/08/11 23:05:18 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  23:05:26 up 47 min,  0 users,  load average: 1.68, 1.39, 0.62
	Linux addons-796714 5.15.0-1040-aws #45~20.04.1-Ubuntu SMP Tue Jul 11 19:11:12 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kindnet [7cad60cb78dd151d1b7aa397a0466c70f2941a8891cdf080b4e610c33df676d5] <==
	* I0811 23:03:27.358717       1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: i/o timeout
	I0811 23:03:27.372895       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:03:27.372925       1 main.go:227] handling current node
	I0811 23:03:37.382767       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:03:37.382791       1 main.go:227] handling current node
	I0811 23:03:47.394702       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:03:47.394733       1 main.go:227] handling current node
	I0811 23:03:57.398762       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:03:57.398791       1 main.go:227] handling current node
	I0811 23:04:07.410752       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:04:07.410780       1 main.go:227] handling current node
	I0811 23:04:17.422778       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:04:17.422809       1 main.go:227] handling current node
	I0811 23:04:27.428104       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:04:27.428131       1 main.go:227] handling current node
	I0811 23:04:37.437066       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:04:37.437097       1 main.go:227] handling current node
	I0811 23:04:47.441532       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:04:47.441561       1 main.go:227] handling current node
	I0811 23:04:57.453659       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:04:57.453692       1 main.go:227] handling current node
	I0811 23:05:07.466692       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:05:07.466724       1 main.go:227] handling current node
	I0811 23:05:17.480635       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:05:17.480756       1 main.go:227] handling current node
	
	* 
	* ==> kube-apiserver [d3dcb84b80a35c5e13a00c222ca96caad3c119553c0fa9351c5ada820815f4ff] <==
	* I0811 23:03:02.512405       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0811 23:03:02.697609       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs=map[IPv4:10.104.208.159]
	I0811 23:03:02.723213       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs=map[IPv4:10.103.222.135]
	I0811 23:03:02.801200       1 controller.go:624] quota admission added evaluator for: jobs.batch
	I0811 23:03:03.956023       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-attacher" clusterIPs=map[IPv4:10.110.130.14]
	I0811 23:03:03.981986       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
	I0811 23:03:04.146000       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-resizer" clusterIPs=map[IPv4:10.109.210.47]
	I0811 23:03:05.942655       1 alloc.go:330] "allocated clusterIPs" service="gcp-auth/gcp-auth" clusterIPs=map[IPv4:10.108.138.40]
	I0811 23:03:35.934124       1 handler_discovery.go:325] DiscoveryManager: Failed to download discovery for kube-system/metrics-server:443: 503 error trying to reach service: dial tcp 10.101.221.148:443: connect: connection refused
	I0811 23:03:35.934162       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	E0811 23:03:35.936233       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.221.148:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.221.148:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.101.221.148:443: connect: connection refused
	E0811 23:03:35.937964       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.221.148:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.221.148:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.101.221.148:443: connect: connection refused
	E0811 23:03:35.943246       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.221.148:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.221.148:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.101.221.148:443: connect: connection refused
	I0811 23:03:36.057648       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0811 23:03:39.972441       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0811 23:04:22.646808       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs=map[IPv4:10.102.126.36]
	E0811 23:04:29.424614       1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0x4007e90d20), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0x4003375db0), ResponseWriter:(*httpsnoop.rw)(0x4003375db0), Flusher:(*httpsnoop.rw)(0x4003375db0), CloseNotifier:(*httpsnoop.rw)(0x4003375db0), Pusher:(*httpsnoop.rw)(0x4003375db0)}}, encoder:(*versioning.codec)(0x400e6d9b80), memAllocator:(*runtime.Allocator)(0x400d2558f0)})
	I0811 23:04:44.361496       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	I0811 23:04:44.385249       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W0811 23:04:45.406958       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I0811 23:04:50.250148       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
	I0811 23:04:50.808058       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs=map[IPv4:10.102.101.242]
	I0811 23:04:59.273253       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	I0811 23:04:59.988424       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs=map[IPv4:10.98.193.190]
	E0811 23:05:16.578998       1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0x40142a6060), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0x4009bfdc70), ResponseWriter:(*httpsnoop.rw)(0x4009bfdc70), Flusher:(*httpsnoop.rw)(0x4009bfdc70), CloseNotifier:(*httpsnoop.rw)(0x4009bfdc70), Pusher:(*httpsnoop.rw)(0x4009bfdc70)}}, encoder:(*versioning.codec)(0x400a446320), memAllocator:(*runtime.Allocator)(0x40080802d0)})
	
	* 
	* ==> kube-controller-manager [cfdf1b3997313fd0530dd5ecf8b43714fdcdf6c6d74211a91d450cebb7598797] <==
	* I0811 23:04:45.358696       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	E0811 23:04:45.411899       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource
	W0811 23:04:46.653093       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0811 23:04:46.653141       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0811 23:04:48.869701       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0811 23:04:48.869737       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0811 23:04:52.145178       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0811 23:04:52.145217       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0811 23:04:54.518495       1 namespace_controller.go:182] "Namespace has been deleted" namespace="gadget"
	I0811 23:04:55.896085       1 shared_informer.go:311] Waiting for caches to sync for resource quota
	I0811 23:04:55.896305       1 shared_informer.go:318] Caches are synced for resource quota
	I0811 23:04:56.262288       1 shared_informer.go:311] Waiting for caches to sync for garbage collector
	I0811 23:04:56.262334       1 shared_informer.go:318] Caches are synced for garbage collector
	W0811 23:04:59.396523       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0811 23:04:59.396740       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0811 23:04:59.637863       1 event.go:307] "Event occurred" object="default/hello-world-app" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-world-app-65bdb79f98 to 1"
	I0811 23:04:59.672435       1 event.go:307] "Event occurred" object="default/hello-world-app-65bdb79f98" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-world-app-65bdb79f98-4h9mm"
	I0811 23:05:02.109884       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	W0811 23:05:03.534530       1 endpointslice_controller.go:297] Error syncing endpoint slices for service "default/hello-world-app", retrying. Error: EndpointSlice informer cache is out of date
	I0811 23:05:10.583888       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	W0811 23:05:15.901677       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0811 23:05:15.901722       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0811 23:05:17.305592       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-create
	I0811 23:05:17.319975       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-patch
	I0811 23:05:18.256771       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	
	* 
	* ==> kube-proxy [e7865323a1814d559c4db4ced833d3d40cd3bde386e2628f8cbc28c3be0e67cf] <==
	* I0811 23:02:56.949264       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0811 23:02:56.949368       1 server_others.go:110] "Detected node IP" address="192.168.49.2"
	I0811 23:02:56.949404       1 server_others.go:554] "Using iptables proxy"
	I0811 23:02:56.997079       1 server_others.go:192] "Using iptables Proxier"
	I0811 23:02:56.997113       1 server_others.go:199] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0811 23:02:56.997122       1 server_others.go:200] "Creating dualStackProxier for iptables"
	I0811 23:02:56.997144       1 server_others.go:484] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, defaulting to no-op detect-local for IPv6"
	I0811 23:02:56.997207       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0811 23:02:56.997778       1 server.go:658] "Version info" version="v1.27.4"
	I0811 23:02:56.997790       1 server.go:660] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0811 23:02:56.999141       1 config.go:188] "Starting service config controller"
	I0811 23:02:56.999152       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0811 23:02:56.999169       1 config.go:97] "Starting endpoint slice config controller"
	I0811 23:02:56.999173       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0811 23:02:57.003398       1 config.go:315] "Starting node config controller"
	I0811 23:02:57.003443       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0811 23:02:57.099933       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0811 23:02:57.099993       1 shared_informer.go:318] Caches are synced for service config
	I0811 23:02:57.104637       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [c2e04f816bc4a31ca79659bc176499f318baeaff1437167f50a6bd12f6197c98] <==
	* W0811 23:02:40.198326       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0811 23:02:40.198544       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0811 23:02:40.198398       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0811 23:02:40.198842       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0811 23:02:40.198457       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0811 23:02:40.198977       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0811 23:02:40.198234       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0811 23:02:40.199097       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0811 23:02:41.029670       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0811 23:02:41.029707       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0811 23:02:41.095902       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0811 23:02:41.095952       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0811 23:02:41.111562       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0811 23:02:41.111780       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0811 23:02:41.213135       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0811 23:02:41.213392       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0811 23:02:41.247453       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0811 23:02:41.247694       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0811 23:02:41.249301       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0811 23:02:41.250175       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0811 23:02:41.333767       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0811 23:02:41.334038       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0811 23:02:41.566306       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0811 23:02:41.566561       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0811 23:02:43.571482       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Aug 11 23:05:18 addons-796714 kubelet[1343]: I0811 23:05:18.828690    1343 memory_manager.go:346] "RemoveStaleState removing state" podUID="ba05162f-c786-4620-afa0-0686a538db0f" containerName="task-pv-container"
	Aug 11 23:05:18 addons-796714 kubelet[1343]: I0811 23:05:18.828699    1343 memory_manager.go:346] "RemoveStaleState removing state" podUID="2840266f-5981-427c-a50c-9f59cafe54a4" containerName="minikube-ingress-dns"
	Aug 11 23:05:18 addons-796714 kubelet[1343]: I0811 23:05:18.828707    1343 memory_manager.go:346] "RemoveStaleState removing state" podUID="a980e52b-fa7b-47b5-b066-d1e5142241d3" containerName="controller"
	Aug 11 23:05:18 addons-796714 kubelet[1343]: I0811 23:05:18.828716    1343 memory_manager.go:346] "RemoveStaleState removing state" podUID="2840266f-5981-427c-a50c-9f59cafe54a4" containerName="minikube-ingress-dns"
	Aug 11 23:05:18 addons-796714 kubelet[1343]: I0811 23:05:18.985243    1343 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-1d96fdef-79d3-46b7-bf31-fe4fd928c1c1\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^8a143d1b-389b-11ee-a7fd-d65565747b0f\") pod \"task-pv-pod-restore\" (UID: \"d966c6ee-1335-43ae-853e-332ebe709c25\") " pod="default/task-pv-pod-restore"
	Aug 11 23:05:18 addons-796714 kubelet[1343]: I0811 23:05:18.985314    1343 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv8h7\" (UniqueName: \"kubernetes.io/projected/d966c6ee-1335-43ae-853e-332ebe709c25-kube-api-access-pv8h7\") pod \"task-pv-pod-restore\" (UID: \"d966c6ee-1335-43ae-853e-332ebe709c25\") " pod="default/task-pv-pod-restore"
	Aug 11 23:05:18 addons-796714 kubelet[1343]: I0811 23:05:18.985355    1343 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/d966c6ee-1335-43ae-853e-332ebe709c25-gcp-creds\") pod \"task-pv-pod-restore\" (UID: \"d966c6ee-1335-43ae-853e-332ebe709c25\") " pod="default/task-pv-pod-restore"
	Aug 11 23:05:19 addons-796714 kubelet[1343]: I0811 23:05:19.094445    1343 operation_generator.go:661] "MountVolume.MountDevice succeeded for volume \"pvc-1d96fdef-79d3-46b7-bf31-fe4fd928c1c1\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^8a143d1b-389b-11ee-a7fd-d65565747b0f\") pod \"task-pv-pod-restore\" (UID: \"d966c6ee-1335-43ae-853e-332ebe709c25\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/hostpath.csi.k8s.io/c5f9181f88679c641ca5eca9604f29dfeb77e9a2a522e430339beb9845c689b2/globalmount\"" pod="default/task-pv-pod-restore"
	Aug 11 23:05:19 addons-796714 kubelet[1343]: I0811 23:05:19.579375    1343 scope.go:115] "RemoveContainer" containerID="1cc46c9c6028cacc6a242023b0fd99f6b9e1b680125b3d57fbcad7e36ff40af0"
	Aug 11 23:05:19 addons-796714 kubelet[1343]: I0811 23:05:19.598410    1343 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=a980e52b-fa7b-47b5-b066-d1e5142241d3 path="/var/lib/kubelet/pods/a980e52b-fa7b-47b5-b066-d1e5142241d3/volumes"
	Aug 11 23:05:20 addons-796714 kubelet[1343]: I0811 23:05:20.576844    1343 scope.go:115] "RemoveContainer" containerID="1cc46c9c6028cacc6a242023b0fd99f6b9e1b680125b3d57fbcad7e36ff40af0"
	Aug 11 23:05:20 addons-796714 kubelet[1343]: I0811 23:05:20.577633    1343 scope.go:115] "RemoveContainer" containerID="2ec4130fecc90837ada12ef38da8d561f39f8dcddb0baaee808c180f40a8393e"
	Aug 11 23:05:20 addons-796714 kubelet[1343]: E0811 23:05:20.578037    1343 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 20s restarting failed container=hello-world-app pod=hello-world-app-65bdb79f98-4h9mm_default(87fe3b05-5a0e-49ef-bfab-271284c312ca)\"" pod="default/hello-world-app-65bdb79f98-4h9mm" podUID=87fe3b05-5a0e-49ef-bfab-271284c312ca
	Aug 11 23:05:25 addons-796714 kubelet[1343]: I0811 23:05:25.974953    1343 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="default/task-pv-pod-restore" podStartSLOduration=7.770526404 podCreationTimestamp="2023-08-11 23:05:18 +0000 UTC" firstStartedPulling="2023-08-11 23:05:19.268422778 +0000 UTC m=+155.860411951" lastFinishedPulling="2023-08-11 23:05:19.472804179 +0000 UTC m=+156.064793360" observedRunningTime="2023-08-11 23:05:20.608019249 +0000 UTC m=+157.200008422" watchObservedRunningTime="2023-08-11 23:05:25.974907813 +0000 UTC m=+162.566896994"
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.348506    1343 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv8h7\" (UniqueName: \"kubernetes.io/projected/d966c6ee-1335-43ae-853e-332ebe709c25-kube-api-access-pv8h7\") pod \"d966c6ee-1335-43ae-853e-332ebe709c25\" (UID: \"d966c6ee-1335-43ae-853e-332ebe709c25\") "
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.348572    1343 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/d966c6ee-1335-43ae-853e-332ebe709c25-gcp-creds\") pod \"d966c6ee-1335-43ae-853e-332ebe709c25\" (UID: \"d966c6ee-1335-43ae-853e-332ebe709c25\") "
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.349218    1343 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"task-pv-storage\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^8a143d1b-389b-11ee-a7fd-d65565747b0f\") pod \"d966c6ee-1335-43ae-853e-332ebe709c25\" (UID: \"d966c6ee-1335-43ae-853e-332ebe709c25\") "
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.349627    1343 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d966c6ee-1335-43ae-853e-332ebe709c25-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "d966c6ee-1335-43ae-853e-332ebe709c25" (UID: "d966c6ee-1335-43ae-853e-332ebe709c25"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.353045    1343 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/hostpath.csi.k8s.io^8a143d1b-389b-11ee-a7fd-d65565747b0f" (OuterVolumeSpecName: "task-pv-storage") pod "d966c6ee-1335-43ae-853e-332ebe709c25" (UID: "d966c6ee-1335-43ae-853e-332ebe709c25"). InnerVolumeSpecName "pvc-1d96fdef-79d3-46b7-bf31-fe4fd928c1c1". PluginName "kubernetes.io/csi", VolumeGidValue ""
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.355377    1343 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d966c6ee-1335-43ae-853e-332ebe709c25-kube-api-access-pv8h7" (OuterVolumeSpecName: "kube-api-access-pv8h7") pod "d966c6ee-1335-43ae-853e-332ebe709c25" (UID: "d966c6ee-1335-43ae-853e-332ebe709c25"). InnerVolumeSpecName "kube-api-access-pv8h7". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.449968    1343 reconciler_common.go:300] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/d966c6ee-1335-43ae-853e-332ebe709c25-gcp-creds\") on node \"addons-796714\" DevicePath \"\""
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.450044    1343 reconciler_common.go:293] "operationExecutor.UnmountDevice started for volume \"pvc-1d96fdef-79d3-46b7-bf31-fe4fd928c1c1\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^8a143d1b-389b-11ee-a7fd-d65565747b0f\") on node \"addons-796714\" "
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.450061    1343 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-pv8h7\" (UniqueName: \"kubernetes.io/projected/d966c6ee-1335-43ae-853e-332ebe709c25-kube-api-access-pv8h7\") on node \"addons-796714\" DevicePath \"\""
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.454758    1343 operation_generator.go:992] UnmountDevice succeeded for volume "pvc-1d96fdef-79d3-46b7-bf31-fe4fd928c1c1" (UniqueName: "kubernetes.io/csi/hostpath.csi.k8s.io^8a143d1b-389b-11ee-a7fd-d65565747b0f") on node "addons-796714"
	Aug 11 23:05:26 addons-796714 kubelet[1343]: I0811 23:05:26.550515    1343 reconciler_common.go:300] "Volume detached for volume \"pvc-1d96fdef-79d3-46b7-bf31-fe4fd928c1c1\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^8a143d1b-389b-11ee-a7fd-d65565747b0f\") on node \"addons-796714\" DevicePath \"\""
	
	* 
	* ==> storage-provisioner [dd106fc099643648efb1e5f0742e454e483d453ea6c6e738e44c9d5f2127c069] <==
	* I0811 23:03:01.143650       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0811 23:03:01.171280       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0811 23:03:01.171365       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0811 23:03:01.216275       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0811 23:03:01.216549       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-796714_6c13127c-4cab-4595-a61f-bc20a4ed73d7!
	I0811 23:03:01.217647       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"2b9b9751-30fe-4e9e-ac0d-4e9ab5498d43", APIVersion:"v1", ResourceVersion:"549", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-796714_6c13127c-4cab-4595-a61f-bc20a4ed73d7 became leader
	I0811 23:03:01.317127       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-796714_6c13127c-4cab-4595-a61f-bc20a4ed73d7!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-796714 -n addons-796714
helpers_test.go:261: (dbg) Run:  kubectl --context addons-796714 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (37.96s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image load --daemon gcr.io/google-containers/addon-resizer:functional-582653 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 image load --daemon gcr.io/google-containers/addon-resizer:functional-582653 --alsologtostderr: (3.743894714s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-582653" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.01s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (3.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image load --daemon gcr.io/google-containers/addon-resizer:functional-582653 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 image load --daemon gcr.io/google-containers/addon-resizer:functional-582653 --alsologtostderr: (3.403696376s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-582653" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (3.64s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.771755754s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-582653
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image load --daemon gcr.io/google-containers/addon-resizer:functional-582653 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 image load --daemon gcr.io/google-containers/addon-resizer:functional-582653 --alsologtostderr: (3.443127676s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-582653" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.57s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image save gcr.io/google-containers/addon-resizer:functional-582653 /home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:385: expected "/home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image load /home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:410: loading image into minikube from file: <nil>

                                                
                                                
** stderr ** 
	I0811 23:15:04.495808   47043 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:15:04.496065   47043 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:15:04.496095   47043 out.go:309] Setting ErrFile to fd 2...
	I0811 23:15:04.496114   47043 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:15:04.496403   47043 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:15:04.497044   47043 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:15:04.497240   47043 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:15:04.497745   47043 cli_runner.go:164] Run: docker container inspect functional-582653 --format={{.State.Status}}
	I0811 23:15:04.521894   47043 ssh_runner.go:195] Run: systemctl --version
	I0811 23:15:04.521949   47043 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-582653
	I0811 23:15:04.581150   47043 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/functional-582653/id_rsa Username:docker}
	I0811 23:15:04.685052   47043 cache_images.go:286] Loading image from: /home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar
	W0811 23:15:04.685103   47043 cache_images.go:254] Failed to load cached images for profile functional-582653. make sure the profile is running. loading images: stat /home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar: no such file or directory
	I0811 23:15:04.685120   47043 cache_images.go:262] succeeded pushing to: 
	I0811 23:15:04.685123   47043 cache_images.go:263] failed pushing to: functional-582653

                                                
                                                
** /stderr **
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.26s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (54.01s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-508070 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:183: (dbg) Done: kubectl --context ingress-addon-legacy-508070 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (13.564021367s)
addons_test.go:208: (dbg) Run:  kubectl --context ingress-addon-legacy-508070 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context ingress-addon-legacy-508070 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [f00b2ab6-328d-4279-a63d-d7fff9e717d0] Pending
helpers_test.go:344: "nginx" [f00b2ab6-328d-4279-a63d-d7fff9e717d0] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [f00b2ab6-328d-4279-a63d-d7fff9e717d0] Running
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 9.033403922s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-508070 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context ingress-addon-legacy-508070 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-508070 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.014582426s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-508070 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-508070 addons disable ingress-dns --alsologtostderr -v=1: (4.938871039s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-508070 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-508070 addons disable ingress --alsologtostderr -v=1: (7.610829746s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-508070
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-508070:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "dd93f906c0c12bafe8c95e218698e45b908437d207bcfaaf10486c5c35d02b47",
	        "Created": "2023-08-11T23:16:07.852604691Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 51646,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-08-11T23:16:08.225840301Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:abe4482d178dd08cce0cdcb8e444349673c3edfa8e7d6462144a8d9173479eb6",
	        "ResolvConfPath": "/var/lib/docker/containers/dd93f906c0c12bafe8c95e218698e45b908437d207bcfaaf10486c5c35d02b47/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/dd93f906c0c12bafe8c95e218698e45b908437d207bcfaaf10486c5c35d02b47/hostname",
	        "HostsPath": "/var/lib/docker/containers/dd93f906c0c12bafe8c95e218698e45b908437d207bcfaaf10486c5c35d02b47/hosts",
	        "LogPath": "/var/lib/docker/containers/dd93f906c0c12bafe8c95e218698e45b908437d207bcfaaf10486c5c35d02b47/dd93f906c0c12bafe8c95e218698e45b908437d207bcfaaf10486c5c35d02b47-json.log",
	        "Name": "/ingress-addon-legacy-508070",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ingress-addon-legacy-508070:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "ingress-addon-legacy-508070",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/3f0f7e3f8811a7ce341d2834fa573b4c0d868811bb87773a6d3891bec3d8d62c-init/diff:/var/lib/docker/overlay2/d97b84d3132f258dcb9c2a1a6f715ba5f60dbe710f2671cc920145c44f465eef/diff",
	                "MergedDir": "/var/lib/docker/overlay2/3f0f7e3f8811a7ce341d2834fa573b4c0d868811bb87773a6d3891bec3d8d62c/merged",
	                "UpperDir": "/var/lib/docker/overlay2/3f0f7e3f8811a7ce341d2834fa573b4c0d868811bb87773a6d3891bec3d8d62c/diff",
	                "WorkDir": "/var/lib/docker/overlay2/3f0f7e3f8811a7ce341d2834fa573b4c0d868811bb87773a6d3891bec3d8d62c/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-508070",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-508070/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-508070",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-508070",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-508070",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "b046a62df302ea043b4f27a63511f43d5e75ca18cf91073df5d0c804f4370275",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32793"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32792"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32789"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32791"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32790"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/b046a62df302",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-508070": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "dd93f906c0c1",
	                        "ingress-addon-legacy-508070"
	                    ],
	                    "NetworkID": "46d4b6c11a9da01c36918bae3df1bfe2aeb8fd7414117d3a1556e1814d16f304",
	                    "EndpointID": "a3882ffcfd8d1b1d7c7c0f23b84cd0aac31933c4763afa9331f1616a66a1e9b2",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p ingress-addon-legacy-508070 -n ingress-addon-legacy-508070
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-508070 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-508070 logs -n 25: (1.42352562s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |----------------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	|    Command     |                                  Args                                  |           Profile           |  User   | Version |     Start Time      |      End Time       |
	|----------------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| mount          | -p functional-582653                                                   | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC |                     |
	|                | /tmp/TestFunctionalparallelMountCmdVerifyCleanup3177799101/001:/mount3 |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| mount          | -p functional-582653                                                   | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC |                     |
	|                | /tmp/TestFunctionalparallelMountCmdVerifyCleanup3177799101/001:/mount1 |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| ssh            | functional-582653 ssh findmnt                                          | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC |                     |
	|                | -T /mount1                                                             |                             |         |         |                     |                     |
	| ssh            | functional-582653 ssh findmnt                                          | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | -T /mount1                                                             |                             |         |         |                     |                     |
	| ssh            | functional-582653 ssh findmnt                                          | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | -T /mount2                                                             |                             |         |         |                     |                     |
	| ssh            | functional-582653 ssh findmnt                                          | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | -T /mount3                                                             |                             |         |         |                     |                     |
	| mount          | -p functional-582653                                                   | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC |                     |
	|                | --kill=true                                                            |                             |         |         |                     |                     |
	| update-context | functional-582653                                                      | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | update-context                                                         |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                                                 |                             |         |         |                     |                     |
	| update-context | functional-582653                                                      | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | update-context                                                         |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                                                 |                             |         |         |                     |                     |
	| update-context | functional-582653                                                      | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | update-context                                                         |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                                                 |                             |         |         |                     |                     |
	| image          | functional-582653                                                      | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | image ls --format short                                                |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| image          | functional-582653                                                      | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | image ls --format yaml                                                 |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| ssh            | functional-582653 ssh pgrep                                            | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC |                     |
	|                | buildkitd                                                              |                             |         |         |                     |                     |
	| image          | functional-582653 image build -t                                       | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | localhost/my-image:functional-582653                                   |                             |         |         |                     |                     |
	|                | testdata/build --alsologtostderr                                       |                             |         |         |                     |                     |
	| image          | functional-582653                                                      | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | image ls --format json                                                 |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| image          | functional-582653                                                      | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	|                | image ls --format table                                                |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| image          | functional-582653 image ls                                             | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	| delete         | -p functional-582653                                                   | functional-582653           | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:15 UTC |
	| start          | -p ingress-addon-legacy-508070                                         | ingress-addon-legacy-508070 | jenkins | v1.31.1 | 11 Aug 23 23:15 UTC | 11 Aug 23 23:17 UTC |
	|                | --kubernetes-version=v1.18.20                                          |                             |         |         |                     |                     |
	|                | --memory=4096 --wait=true                                              |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	|                | -v=5 --driver=docker                                                   |                             |         |         |                     |                     |
	|                | --container-runtime=containerd                                         |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-508070                                            | ingress-addon-legacy-508070 | jenkins | v1.31.1 | 11 Aug 23 23:17 UTC | 11 Aug 23 23:17 UTC |
	|                | addons enable ingress                                                  |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                                                 |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-508070                                            | ingress-addon-legacy-508070 | jenkins | v1.31.1 | 11 Aug 23 23:17 UTC | 11 Aug 23 23:17 UTC |
	|                | addons enable ingress-dns                                              |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                                                 |                             |         |         |                     |                     |
	| ssh            | ingress-addon-legacy-508070                                            | ingress-addon-legacy-508070 | jenkins | v1.31.1 | 11 Aug 23 23:18 UTC | 11 Aug 23 23:18 UTC |
	|                | ssh curl -s http://127.0.0.1/                                          |                             |         |         |                     |                     |
	|                | -H 'Host: nginx.example.com'                                           |                             |         |         |                     |                     |
	| ip             | ingress-addon-legacy-508070 ip                                         | ingress-addon-legacy-508070 | jenkins | v1.31.1 | 11 Aug 23 23:18 UTC | 11 Aug 23 23:18 UTC |
	| addons         | ingress-addon-legacy-508070                                            | ingress-addon-legacy-508070 | jenkins | v1.31.1 | 11 Aug 23 23:18 UTC | 11 Aug 23 23:18 UTC |
	|                | addons disable ingress-dns                                             |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-508070                                            | ingress-addon-legacy-508070 | jenkins | v1.31.1 | 11 Aug 23 23:18 UTC | 11 Aug 23 23:18 UTC |
	|                | addons disable ingress                                                 |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	|----------------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/08/11 23:15:46
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0811 23:15:46.453982   51168 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:15:46.454183   51168 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:15:46.454212   51168 out.go:309] Setting ErrFile to fd 2...
	I0811 23:15:46.454234   51168 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:15:46.454506   51168 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:15:46.454935   51168 out.go:303] Setting JSON to false
	I0811 23:15:46.455741   51168 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":3493,"bootTime":1691792254,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:15:46.455824   51168 start.go:138] virtualization:  
	I0811 23:15:46.460175   51168 out.go:177] * [ingress-addon-legacy-508070] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:15:46.462559   51168 out.go:177]   - MINIKUBE_LOCATION=17044
	I0811 23:15:46.464692   51168 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:15:46.462535   51168 notify.go:220] Checking for updates...
	I0811 23:15:46.466768   51168 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:15:46.468667   51168 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:15:46.470613   51168 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0811 23:15:46.472353   51168 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0811 23:15:46.474526   51168 driver.go:373] Setting default libvirt URI to qemu:///system
	I0811 23:15:46.497514   51168 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:15:46.497618   51168 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:15:46.600043   51168 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-08-11 23:15:46.59080388 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:15:46.600233   51168 docker.go:294] overlay module found
	I0811 23:15:46.602397   51168 out.go:177] * Using the docker driver based on user configuration
	I0811 23:15:46.604330   51168 start.go:298] selected driver: docker
	I0811 23:15:46.604351   51168 start.go:901] validating driver "docker" against <nil>
	I0811 23:15:46.604364   51168 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0811 23:15:46.604992   51168 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:15:46.677595   51168 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-08-11 23:15:46.667199674 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:15:46.677775   51168 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0811 23:15:46.678075   51168 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0811 23:15:46.680246   51168 out.go:177] * Using Docker driver with root privileges
	I0811 23:15:46.682167   51168 cni.go:84] Creating CNI manager for ""
	I0811 23:15:46.682186   51168 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:15:46.682203   51168 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni
	I0811 23:15:46.682217   51168 start_flags.go:319] config:
	{Name:ingress-addon-legacy-508070 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-508070 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.lo
cal ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:15:46.684490   51168 out.go:177] * Starting control plane node ingress-addon-legacy-508070 in cluster ingress-addon-legacy-508070
	I0811 23:15:46.686190   51168 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0811 23:15:46.687757   51168 out.go:177] * Pulling base image ...
	I0811 23:15:46.689622   51168 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime containerd
	I0811 23:15:46.689651   51168 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon
	I0811 23:15:46.707761   51168 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon, skipping pull
	I0811 23:15:46.707787   51168 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 exists in daemon, skipping load
	I0811 23:15:46.761198   51168 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4
	I0811 23:15:46.761236   51168 cache.go:57] Caching tarball of preloaded images
	I0811 23:15:46.761403   51168 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime containerd
	I0811 23:15:46.763839   51168 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I0811 23:15:46.766003   51168 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:15:46.915650   51168 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4?checksum=md5:9e505be2989b8c051b1372c317471064 -> /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4
	I0811 23:15:59.909764   51168 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:15:59.909866   51168 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:16:01.081327   51168 cache.go:60] Finished verifying existence of preloaded tar for  v1.18.20 on containerd
	I0811 23:16:01.081695   51168 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/config.json ...
	I0811 23:16:01.081731   51168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/config.json: {Name:mkdecbe408087561e196093c86042a0d33770616 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:16:01.081915   51168 cache.go:195] Successfully downloaded all kic artifacts
	I0811 23:16:01.081974   51168 start.go:365] acquiring machines lock for ingress-addon-legacy-508070: {Name:mke8f242393e2cba00e2716f8414103fee995a47 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0811 23:16:01.082024   51168 start.go:369] acquired machines lock for "ingress-addon-legacy-508070" in 36.053µs
	I0811 23:16:01.082042   51168 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-508070 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-508070 Namespace:defau
lt APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Binar
yMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0811 23:16:01.082110   51168 start.go:125] createHost starting for "" (driver="docker")
	I0811 23:16:01.084590   51168 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I0811 23:16:01.084849   51168 start.go:159] libmachine.API.Create for "ingress-addon-legacy-508070" (driver="docker")
	I0811 23:16:01.084878   51168 client.go:168] LocalClient.Create starting
	I0811 23:16:01.085016   51168 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem
	I0811 23:16:01.085055   51168 main.go:141] libmachine: Decoding PEM data...
	I0811 23:16:01.085075   51168 main.go:141] libmachine: Parsing certificate...
	I0811 23:16:01.085134   51168 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem
	I0811 23:16:01.085156   51168 main.go:141] libmachine: Decoding PEM data...
	I0811 23:16:01.085170   51168 main.go:141] libmachine: Parsing certificate...
	I0811 23:16:01.085527   51168 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-508070 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0811 23:16:01.104212   51168 cli_runner.go:211] docker network inspect ingress-addon-legacy-508070 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0811 23:16:01.104303   51168 network_create.go:281] running [docker network inspect ingress-addon-legacy-508070] to gather additional debugging logs...
	I0811 23:16:01.104326   51168 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-508070
	W0811 23:16:01.123473   51168 cli_runner.go:211] docker network inspect ingress-addon-legacy-508070 returned with exit code 1
	I0811 23:16:01.123502   51168 network_create.go:284] error running [docker network inspect ingress-addon-legacy-508070]: docker network inspect ingress-addon-legacy-508070: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-508070 not found
	I0811 23:16:01.123524   51168 network_create.go:286] output of [docker network inspect ingress-addon-legacy-508070]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-508070 not found
	
	** /stderr **
	I0811 23:16:01.123585   51168 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0811 23:16:01.142351   51168 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000d4a210}
	I0811 23:16:01.142389   51168 network_create.go:123] attempt to create docker network ingress-addon-legacy-508070 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0811 23:16:01.142456   51168 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-508070 ingress-addon-legacy-508070
	I0811 23:16:01.221650   51168 network_create.go:107] docker network ingress-addon-legacy-508070 192.168.49.0/24 created
	I0811 23:16:01.221677   51168 kic.go:117] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-508070" container
	I0811 23:16:01.221756   51168 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0811 23:16:01.239799   51168 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-508070 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-508070 --label created_by.minikube.sigs.k8s.io=true
	I0811 23:16:01.258190   51168 oci.go:103] Successfully created a docker volume ingress-addon-legacy-508070
	I0811 23:16:01.258277   51168 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-508070-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-508070 --entrypoint /usr/bin/test -v ingress-addon-legacy-508070:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 -d /var/lib
	I0811 23:16:02.770421   51168 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-508070-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-508070 --entrypoint /usr/bin/test -v ingress-addon-legacy-508070:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 -d /var/lib: (1.512095099s)
	I0811 23:16:02.770453   51168 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-508070
	I0811 23:16:02.770477   51168 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime containerd
	I0811 23:16:02.770497   51168 kic.go:190] Starting extracting preloaded images to volume ...
	I0811 23:16:02.770584   51168 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-508070:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 -I lz4 -xf /preloaded.tar -C /extractDir
	I0811 23:16:07.761018   51168 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-508070:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 -I lz4 -xf /preloaded.tar -C /extractDir: (4.990389562s)
	I0811 23:16:07.761053   51168 kic.go:199] duration metric: took 4.990551 seconds to extract preloaded images to volume
	W0811 23:16:07.761194   51168 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0811 23:16:07.761313   51168 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0811 23:16:07.833779   51168 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-508070 --name ingress-addon-legacy-508070 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-508070 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-508070 --network ingress-addon-legacy-508070 --ip 192.168.49.2 --volume ingress-addon-legacy-508070:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37
	I0811 23:16:08.235361   51168 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-508070 --format={{.State.Running}}
	I0811 23:16:08.262301   51168 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-508070 --format={{.State.Status}}
	I0811 23:16:08.287383   51168 cli_runner.go:164] Run: docker exec ingress-addon-legacy-508070 stat /var/lib/dpkg/alternatives/iptables
	I0811 23:16:08.373195   51168 oci.go:144] the created container "ingress-addon-legacy-508070" has a running status.
	I0811 23:16:08.373224   51168 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa...
	I0811 23:16:09.407267   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0811 23:16:09.407319   51168 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0811 23:16:09.440178   51168 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-508070 --format={{.State.Status}}
	I0811 23:16:09.474160   51168 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0811 23:16:09.474180   51168 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-508070 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0811 23:16:09.557303   51168 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-508070 --format={{.State.Status}}
	I0811 23:16:09.589544   51168 machine.go:88] provisioning docker machine ...
	I0811 23:16:09.589585   51168 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-508070"
	I0811 23:16:09.589653   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:16:09.609808   51168 main.go:141] libmachine: Using SSH client type: native
	I0811 23:16:09.610264   51168 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0811 23:16:09.610285   51168 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-508070 && echo "ingress-addon-legacy-508070" | sudo tee /etc/hostname
	I0811 23:16:09.795375   51168 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-508070
	
	I0811 23:16:09.795449   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:16:09.813937   51168 main.go:141] libmachine: Using SSH client type: native
	I0811 23:16:09.814369   51168 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0811 23:16:09.814394   51168 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-508070' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-508070/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-508070' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0811 23:16:09.960232   51168 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0811 23:16:09.960257   51168 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0811 23:16:09.960278   51168 ubuntu.go:177] setting up certificates
	I0811 23:16:09.960288   51168 provision.go:83] configureAuth start
	I0811 23:16:09.960346   51168 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-508070
	I0811 23:16:09.979312   51168 provision.go:138] copyHostCerts
	I0811 23:16:09.979355   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0811 23:16:09.979388   51168 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0811 23:16:09.979399   51168 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0811 23:16:09.979479   51168 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0811 23:16:09.979562   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0811 23:16:09.979582   51168 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0811 23:16:09.979587   51168 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0811 23:16:09.979614   51168 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0811 23:16:09.979661   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0811 23:16:09.979681   51168 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0811 23:16:09.979689   51168 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0811 23:16:09.979713   51168 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0811 23:16:09.979767   51168 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-508070 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-508070]
	I0811 23:16:10.662571   51168 provision.go:172] copyRemoteCerts
	I0811 23:16:10.662639   51168 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0811 23:16:10.662680   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:16:10.680959   51168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa Username:docker}
	I0811 23:16:10.786556   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0811 23:16:10.786646   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)
	I0811 23:16:10.815924   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0811 23:16:10.815983   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0811 23:16:10.844639   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0811 23:16:10.844704   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0811 23:16:10.876079   51168 provision.go:86] duration metric: configureAuth took 915.777919ms
	I0811 23:16:10.876116   51168 ubuntu.go:193] setting minikube options for container-runtime
	I0811 23:16:10.876347   51168 config.go:182] Loaded profile config "ingress-addon-legacy-508070": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.18.20
	I0811 23:16:10.876362   51168 machine.go:91] provisioned docker machine in 1.286793369s
	I0811 23:16:10.876369   51168 client.go:171] LocalClient.Create took 9.791481299s
	I0811 23:16:10.876385   51168 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-508070" took 9.791535542s
	I0811 23:16:10.876394   51168 start.go:300] post-start starting for "ingress-addon-legacy-508070" (driver="docker")
	I0811 23:16:10.876401   51168 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0811 23:16:10.876453   51168 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0811 23:16:10.876499   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:16:10.896687   51168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa Username:docker}
	I0811 23:16:11.002484   51168 ssh_runner.go:195] Run: cat /etc/os-release
	I0811 23:16:11.008003   51168 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0811 23:16:11.008045   51168 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0811 23:16:11.008057   51168 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0811 23:16:11.008065   51168 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0811 23:16:11.008080   51168 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/addons for local assets ...
	I0811 23:16:11.008154   51168 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/files for local assets ...
	I0811 23:16:11.008245   51168 filesync.go:149] local asset: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem -> 76702.pem in /etc/ssl/certs
	I0811 23:16:11.008258   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem -> /etc/ssl/certs/76702.pem
	I0811 23:16:11.008379   51168 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0811 23:16:11.019803   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem --> /etc/ssl/certs/76702.pem (1708 bytes)
	I0811 23:16:11.048539   51168 start.go:303] post-start completed in 172.129966ms
	I0811 23:16:11.048941   51168 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-508070
	I0811 23:16:11.068952   51168 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/config.json ...
	I0811 23:16:11.069261   51168 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:16:11.069320   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:16:11.087621   51168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa Username:docker}
	I0811 23:16:11.189486   51168 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0811 23:16:11.195629   51168 start.go:128] duration metric: createHost completed in 10.113505455s
	I0811 23:16:11.195654   51168 start.go:83] releasing machines lock for "ingress-addon-legacy-508070", held for 10.113621941s
	I0811 23:16:11.195731   51168 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-508070
	I0811 23:16:11.213931   51168 ssh_runner.go:195] Run: cat /version.json
	I0811 23:16:11.213990   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:16:11.214065   51168 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0811 23:16:11.214135   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:16:11.233988   51168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa Username:docker}
	I0811 23:16:11.239369   51168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa Username:docker}
	I0811 23:16:11.335925   51168 ssh_runner.go:195] Run: systemctl --version
	I0811 23:16:11.483937   51168 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0811 23:16:11.489814   51168 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0811 23:16:11.520951   51168 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0811 23:16:11.521051   51168 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0811 23:16:11.554870   51168 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0811 23:16:11.554931   51168 start.go:466] detecting cgroup driver to use...
	I0811 23:16:11.554977   51168 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0811 23:16:11.555111   51168 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0811 23:16:11.569798   51168 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0811 23:16:11.583788   51168 docker.go:196] disabling cri-docker service (if available) ...
	I0811 23:16:11.583903   51168 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0811 23:16:11.600388   51168 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0811 23:16:11.617227   51168 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0811 23:16:11.738806   51168 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0811 23:16:11.870771   51168 docker.go:212] disabling docker service ...
	I0811 23:16:11.871826   51168 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0811 23:16:11.896946   51168 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0811 23:16:11.912102   51168 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0811 23:16:12.019308   51168 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0811 23:16:12.124451   51168 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0811 23:16:12.139796   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0811 23:16:12.161966   51168 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0811 23:16:12.175552   51168 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0811 23:16:12.188593   51168 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0811 23:16:12.188730   51168 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0811 23:16:12.201244   51168 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:16:12.213829   51168 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0811 23:16:12.226328   51168 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:16:12.238819   51168 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0811 23:16:12.251188   51168 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0811 23:16:12.264105   51168 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0811 23:16:12.274914   51168 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0811 23:16:12.285738   51168 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0811 23:16:12.379054   51168 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0811 23:16:12.469374   51168 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0811 23:16:12.469442   51168 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0811 23:16:12.475610   51168 start.go:534] Will wait 60s for crictl version
	I0811 23:16:12.475672   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:12.480614   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:16:12.528312   51168 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.21
	RuntimeApiVersion:  v1
	I0811 23:16:12.528380   51168 ssh_runner.go:195] Run: containerd --version
	I0811 23:16:12.556230   51168 ssh_runner.go:195] Run: containerd --version
	I0811 23:16:12.592989   51168 out.go:177] * Preparing Kubernetes v1.18.20 on containerd 1.6.21 ...
	I0811 23:16:12.594861   51168 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-508070 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0811 23:16:12.613384   51168 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0811 23:16:12.617930   51168 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0811 23:16:12.631219   51168 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime containerd
	I0811 23:16:12.631297   51168 ssh_runner.go:195] Run: sudo crictl images --output json
	I0811 23:16:12.670387   51168 containerd.go:600] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.18.20". assuming images are not preloaded.
	I0811 23:16:12.670457   51168 ssh_runner.go:195] Run: which lz4
	I0811 23:16:12.676008   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4
	I0811 23:16:12.676130   51168 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0811 23:16:12.680821   51168 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0811 23:16:12.680857   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (489149349 bytes)
	I0811 23:16:14.876199   51168 containerd.go:547] Took 2.200106 seconds to copy over tarball
	I0811 23:16:14.876324   51168 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0811 23:16:17.569335   51168 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.692984613s)
	I0811 23:16:17.569359   51168 containerd.go:554] Took 2.693137 seconds to extract the tarball
	I0811 23:16:17.569368   51168 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0811 23:16:17.698288   51168 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0811 23:16:17.805434   51168 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0811 23:16:17.897595   51168 ssh_runner.go:195] Run: sudo crictl images --output json
	I0811 23:16:17.954124   51168 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0811 23:16:17.954212   51168 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0811 23:16:17.954399   51168 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I0811 23:16:17.954483   51168 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0811 23:16:17.954554   51168 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I0811 23:16:17.954635   51168 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I0811 23:16:17.954704   51168 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I0811 23:16:17.954774   51168 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I0811 23:16:17.954850   51168 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I0811 23:16:17.955830   51168 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I0811 23:16:17.956213   51168 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	I0811 23:16:17.956398   51168 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0811 23:16:17.956623   51168 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	I0811 23:16:17.956766   51168 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I0811 23:16:17.956893   51168 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I0811 23:16:17.957028   51168 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	I0811 23:16:17.957931   51168 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	W0811 23:16:18.372789   51168 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0811 23:16:18.372921   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/kube-scheduler:v1.18.20"
	W0811 23:16:18.392330   51168 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing
	I0811 23:16:18.392485   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/etcd:3.4.3-0"
	W0811 23:16:18.400775   51168 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing
	I0811 23:16:18.400908   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/coredns:1.6.7"
	W0811 23:16:18.401087   51168 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0811 23:16:18.401176   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/kube-apiserver:v1.18.20"
	I0811 23:16:18.417476   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/pause:3.2"
	W0811 23:16:18.420988   51168 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0811 23:16:18.421258   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/kube-proxy:v1.18.20"
	W0811 23:16:18.461183   51168 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0811 23:16:18.461373   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/kube-controller-manager:v1.18.20"
	W0811 23:16:18.587604   51168 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0811 23:16:18.587743   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5"
	I0811 23:16:18.676075   51168 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime
	I0811 23:16:18.676213   51168 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I0811 23:16:18.676282   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:19.121524   51168 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime
	I0811 23:16:19.121564   51168 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.3-0
	I0811 23:16:19.121609   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:19.222305   51168 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime
	I0811 23:16:19.222348   51168 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I0811 23:16:19.222405   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:19.222462   51168 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime
	I0811 23:16:19.222485   51168 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.7
	I0811 23:16:19.222505   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:19.222562   51168 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime
	I0811 23:16:19.222580   51168 cri.go:218] Removing image: registry.k8s.io/pause:3.2
	I0811 23:16:19.222597   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:19.222642   51168 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime
	I0811 23:16:19.222659   51168 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I0811 23:16:19.222686   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:19.236329   51168 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime
	I0811 23:16:19.236369   51168 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0811 23:16:19.236417   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:19.298498   51168 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0811 23:16:19.298543   51168 cri.go:218] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0811 23:16:19.298589   51168 ssh_runner.go:195] Run: which crictl
	I0811 23:16:19.298665   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.18.20
	I0811 23:16:19.298718   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.3-0
	I0811 23:16:19.298776   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.7
	I0811 23:16:19.298826   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.18.20
	I0811 23:16:19.298876   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
	I0811 23:16:19.298926   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.18.20
	I0811 23:16:19.298969   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I0811 23:16:19.487191   51168 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20
	I0811 23:16:19.487270   51168 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0811 23:16:19.487349   51168 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20
	I0811 23:16:19.487382   51168 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0
	I0811 23:16:19.487425   51168 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7
	I0811 23:16:19.487461   51168 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20
	I0811 23:16:19.487496   51168 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2
	I0811 23:16:19.487535   51168 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20
	I0811 23:16:19.540955   51168 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0811 23:16:19.541038   51168 cache_images.go:92] LoadImages completed in 1.586887097s
	W0811 23:16:19.541114   51168 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17044-2342/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20: no such file or directory
	I0811 23:16:19.541166   51168 ssh_runner.go:195] Run: sudo crictl info
	I0811 23:16:19.583606   51168 cni.go:84] Creating CNI manager for ""
	I0811 23:16:19.583678   51168 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:16:19.583723   51168 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0811 23:16:19.583772   51168 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-508070 NodeName:ingress-addon-legacy-508070 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/ce
rts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0811 23:16:19.583957   51168 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "ingress-addon-legacy-508070"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0811 23:16:19.584075   51168 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=ingress-addon-legacy-508070 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-508070 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0811 23:16:19.584183   51168 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I0811 23:16:19.595198   51168 binaries.go:44] Found k8s binaries, skipping transfer
	I0811 23:16:19.595269   51168 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0811 23:16:19.605631   51168 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (448 bytes)
	I0811 23:16:19.626824   51168 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I0811 23:16:19.648590   51168 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2131 bytes)
	I0811 23:16:19.669734   51168 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0811 23:16:19.674023   51168 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0811 23:16:19.687600   51168 certs.go:56] Setting up /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070 for IP: 192.168.49.2
	I0811 23:16:19.687679   51168 certs.go:190] acquiring lock for shared ca certs: {Name:mkb015b1abfb46823ddc64ddbe4b33bd353eab35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:16:19.687856   51168 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key
	I0811 23:16:19.687921   51168 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key
	I0811 23:16:19.687981   51168 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.key
	I0811 23:16:19.687995   51168 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt with IP's: []
	I0811 23:16:20.256555   51168 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt ...
	I0811 23:16:20.256587   51168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: {Name:mkf1eec2cff8a989949019950c8c838c9a9bc9eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:16:20.256792   51168 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.key ...
	I0811 23:16:20.256806   51168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.key: {Name:mk566336d53a68523966643866d6ecbee0593d2d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:16:20.256897   51168 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.key.dd3b5fb2
	I0811 23:16:20.256913   51168 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0811 23:16:20.492644   51168 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.crt.dd3b5fb2 ...
	I0811 23:16:20.492677   51168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.crt.dd3b5fb2: {Name:mk627bba751825b1658927475d020f4a3e6b1d99 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:16:20.492876   51168 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.key.dd3b5fb2 ...
	I0811 23:16:20.492888   51168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.key.dd3b5fb2: {Name:mkc4b3db945b48acaa74992cb9bf8fb427df9e31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:16:20.492980   51168 certs.go:337] copying /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.crt
	I0811 23:16:20.493060   51168 certs.go:341] copying /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.key
	I0811 23:16:20.493121   51168 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.key
	I0811 23:16:20.493137   51168 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.crt with IP's: []
	I0811 23:16:20.766218   51168 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.crt ...
	I0811 23:16:20.766253   51168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.crt: {Name:mk3d3566ebd635f3f56ed05cd85b74f27de4e6f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:16:20.766437   51168 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.key ...
	I0811 23:16:20.766450   51168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.key: {Name:mk1540fd97c9b872b3cacc4318e8f11326d5b139 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:16:20.766532   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0811 23:16:20.766553   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0811 23:16:20.766565   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0811 23:16:20.766583   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0811 23:16:20.766598   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0811 23:16:20.766613   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0811 23:16:20.766631   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0811 23:16:20.766656   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0811 23:16:20.766711   51168 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/7670.pem (1338 bytes)
	W0811 23:16:20.766755   51168 certs.go:433] ignoring /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/7670_empty.pem, impossibly tiny 0 bytes
	I0811 23:16:20.766768   51168 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem (1675 bytes)
	I0811 23:16:20.766798   51168 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem (1078 bytes)
	I0811 23:16:20.766827   51168 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem (1123 bytes)
	I0811 23:16:20.766865   51168 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem (1675 bytes)
	I0811 23:16:20.766923   51168 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem (1708 bytes)
	I0811 23:16:20.766969   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/7670.pem -> /usr/share/ca-certificates/7670.pem
	I0811 23:16:20.766991   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem -> /usr/share/ca-certificates/76702.pem
	I0811 23:16:20.767007   51168 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:16:20.767646   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0811 23:16:20.797002   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0811 23:16:20.825309   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0811 23:16:20.853630   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0811 23:16:20.882082   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0811 23:16:20.910684   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0811 23:16:20.938881   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0811 23:16:20.967843   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0811 23:16:20.997345   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/7670.pem --> /usr/share/ca-certificates/7670.pem (1338 bytes)
	I0811 23:16:21.028482   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem --> /usr/share/ca-certificates/76702.pem (1708 bytes)
	I0811 23:16:21.058116   51168 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0811 23:16:21.088639   51168 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0811 23:16:21.111187   51168 ssh_runner.go:195] Run: openssl version
	I0811 23:16:21.118434   51168 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7670.pem && ln -fs /usr/share/ca-certificates/7670.pem /etc/ssl/certs/7670.pem"
	I0811 23:16:21.130651   51168 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7670.pem
	I0811 23:16:21.135902   51168 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Aug 11 23:07 /usr/share/ca-certificates/7670.pem
	I0811 23:16:21.136018   51168 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7670.pem
	I0811 23:16:21.144858   51168 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7670.pem /etc/ssl/certs/51391683.0"
	I0811 23:16:21.157143   51168 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/76702.pem && ln -fs /usr/share/ca-certificates/76702.pem /etc/ssl/certs/76702.pem"
	I0811 23:16:21.169020   51168 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/76702.pem
	I0811 23:16:21.173694   51168 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Aug 11 23:07 /usr/share/ca-certificates/76702.pem
	I0811 23:16:21.173809   51168 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/76702.pem
	I0811 23:16:21.182563   51168 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/76702.pem /etc/ssl/certs/3ec20f2e.0"
	I0811 23:16:21.194078   51168 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0811 23:16:21.205687   51168 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:16:21.210799   51168 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Aug 11 23:02 /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:16:21.210885   51168 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:16:21.219493   51168 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0811 23:16:21.231378   51168 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0811 23:16:21.235755   51168 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0811 23:16:21.235830   51168 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-508070 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-508070 Namespace:default APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:16:21.235931   51168 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0811 23:16:21.235994   51168 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0811 23:16:21.279210   51168 cri.go:89] found id: ""
	I0811 23:16:21.279289   51168 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0811 23:16:21.290396   51168 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0811 23:16:21.301066   51168 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0811 23:16:21.301151   51168 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0811 23:16:21.312023   51168 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0811 23:16:21.312067   51168 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0811 23:16:21.367137   51168 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I0811 23:16:21.367394   51168 kubeadm.go:322] [preflight] Running pre-flight checks
	I0811 23:16:21.421530   51168 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0811 23:16:21.421648   51168 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1040-aws
	I0811 23:16:21.421719   51168 kubeadm.go:322] OS: Linux
	I0811 23:16:21.421800   51168 kubeadm.go:322] CGROUPS_CPU: enabled
	I0811 23:16:21.421879   51168 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0811 23:16:21.421957   51168 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0811 23:16:21.422046   51168 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0811 23:16:21.422117   51168 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0811 23:16:21.422205   51168 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0811 23:16:21.516203   51168 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0811 23:16:21.516308   51168 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0811 23:16:21.516401   51168 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0811 23:16:21.756505   51168 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0811 23:16:21.758129   51168 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0811 23:16:21.758383   51168 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0811 23:16:21.865493   51168 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0811 23:16:21.868258   51168 out.go:204]   - Generating certificates and keys ...
	I0811 23:16:21.868362   51168 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0811 23:16:21.868431   51168 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0811 23:16:22.666886   51168 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0811 23:16:23.044483   51168 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0811 23:16:23.496387   51168 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0811 23:16:24.450417   51168 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0811 23:16:25.296207   51168 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0811 23:16:25.296511   51168 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-508070 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0811 23:16:26.612903   51168 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0811 23:16:26.613403   51168 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-508070 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0811 23:16:26.812459   51168 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0811 23:16:27.420944   51168 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0811 23:16:27.682279   51168 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0811 23:16:27.682595   51168 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0811 23:16:28.911944   51168 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0811 23:16:29.297243   51168 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0811 23:16:30.167451   51168 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0811 23:16:30.692250   51168 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0811 23:16:30.693247   51168 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0811 23:16:30.695637   51168 out.go:204]   - Booting up control plane ...
	I0811 23:16:30.695770   51168 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0811 23:16:30.707911   51168 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0811 23:16:30.707998   51168 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0811 23:16:30.708080   51168 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0811 23:16:30.708234   51168 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0811 23:16:43.210775   51168 kubeadm.go:322] [apiclient] All control plane components are healthy after 12.503321 seconds
	I0811 23:16:43.210892   51168 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0811 23:16:43.225047   51168 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I0811 23:16:43.751105   51168 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0811 23:16:43.751254   51168 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-508070 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I0811 23:16:44.260727   51168 kubeadm.go:322] [bootstrap-token] Using token: 5krdpv.7y5164el2j22ngam
	I0811 23:16:44.264019   51168 out.go:204]   - Configuring RBAC rules ...
	I0811 23:16:44.264137   51168 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0811 23:16:44.267725   51168 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0811 23:16:44.277085   51168 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0811 23:16:44.280526   51168 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0811 23:16:44.284751   51168 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0811 23:16:44.290528   51168 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0811 23:16:44.305773   51168 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0811 23:16:44.564989   51168 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0811 23:16:44.681946   51168 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0811 23:16:44.684324   51168 kubeadm.go:322] 
	I0811 23:16:44.684416   51168 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0811 23:16:44.684429   51168 kubeadm.go:322] 
	I0811 23:16:44.684523   51168 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0811 23:16:44.684533   51168 kubeadm.go:322] 
	I0811 23:16:44.684562   51168 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0811 23:16:44.685497   51168 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0811 23:16:44.685574   51168 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0811 23:16:44.685580   51168 kubeadm.go:322] 
	I0811 23:16:44.685642   51168 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0811 23:16:44.685760   51168 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0811 23:16:44.685846   51168 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0811 23:16:44.685854   51168 kubeadm.go:322] 
	I0811 23:16:44.686312   51168 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0811 23:16:44.686396   51168 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0811 23:16:44.686405   51168 kubeadm.go:322] 
	I0811 23:16:44.686530   51168 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 5krdpv.7y5164el2j22ngam \
	I0811 23:16:44.686736   51168 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:bbf85a3fea899a66ee2fb9bfde62b7fa4a645e2f7bca9815ad7b4d5cc9dc9c3a \
	I0811 23:16:44.687074   51168 kubeadm.go:322]     --control-plane 
	I0811 23:16:44.687090   51168 kubeadm.go:322] 
	I0811 23:16:44.687534   51168 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0811 23:16:44.687548   51168 kubeadm.go:322] 
	I0811 23:16:44.687960   51168 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 5krdpv.7y5164el2j22ngam \
	I0811 23:16:44.688435   51168 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:bbf85a3fea899a66ee2fb9bfde62b7fa4a645e2f7bca9815ad7b4d5cc9dc9c3a 
	I0811 23:16:44.693729   51168 kubeadm.go:322] W0811 23:16:21.366491    1101 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I0811 23:16:44.693967   51168 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1040-aws\n", err: exit status 1
	I0811 23:16:44.694124   51168 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0811 23:16:44.694327   51168 kubeadm.go:322] W0811 23:16:30.702621    1101 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0811 23:16:44.694530   51168 kubeadm.go:322] W0811 23:16:30.703935    1101 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0811 23:16:44.694559   51168 cni.go:84] Creating CNI manager for ""
	I0811 23:16:44.694572   51168 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:16:44.697799   51168 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0811 23:16:44.699777   51168 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0811 23:16:44.707158   51168 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.18.20/kubectl ...
	I0811 23:16:44.707211   51168 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0811 23:16:44.730902   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0811 23:16:45.260561   51168 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0811 23:16:45.260706   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:45.260786   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.31.1 minikube.k8s.io/commit=0bff008270ec17d4e0c2c90a14e18ac31a0e01f5 minikube.k8s.io/name=ingress-addon-legacy-508070 minikube.k8s.io/updated_at=2023_08_11T23_16_45_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:45.456679   51168 ops.go:34] apiserver oom_adj: -16
	I0811 23:16:45.456889   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:45.551708   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:46.167811   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:46.667541   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:47.168127   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:47.667266   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:48.168226   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:48.667885   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:49.167637   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:49.667280   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:50.167663   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:50.667382   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:51.167215   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:51.667515   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:52.167758   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:52.667327   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:53.168194   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:53.667857   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:54.168017   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:54.667883   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:55.167369   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:55.668257   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:56.167903   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:56.667470   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:57.167587   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:57.668147   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:58.168262   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:58.667468   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:59.167544   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:16:59.667926   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:17:00.168216   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:17:00.667888   51168 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0811 23:17:00.859796   51168 kubeadm.go:1081] duration metric: took 15.599147713s to wait for elevateKubeSystemPrivileges.
	I0811 23:17:00.859832   51168 kubeadm.go:406] StartCluster complete in 39.624008626s
	I0811 23:17:00.859850   51168 settings.go:142] acquiring lock: {Name:mk421b926e53f49ddfd3f30cfdf5667f56cebbb4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:17:00.859918   51168 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:17:00.860706   51168 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/kubeconfig: {Name:mka6624c250fdc5498ab30cb4943888e3cdba6af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:17:00.861571   51168 kapi.go:59] client config for ingress-addon-legacy-508070: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt", KeyFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.key", CAFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(ni
l), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16eb290), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0811 23:17:00.863006   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0811 23:17:00.863476   51168 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
	I0811 23:17:00.863913   51168 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-508070"
	I0811 23:17:00.863746   51168 config.go:182] Loaded profile config "ingress-addon-legacy-508070": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.18.20
	I0811 23:17:00.863960   51168 addons.go:231] Setting addon storage-provisioner=true in "ingress-addon-legacy-508070"
	I0811 23:17:00.863763   51168 cert_rotation.go:137] Starting client certificate rotation controller
	I0811 23:17:00.864002   51168 host.go:66] Checking if "ingress-addon-legacy-508070" exists ...
	I0811 23:17:00.864025   51168 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-508070"
	I0811 23:17:00.864040   51168 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-508070"
	I0811 23:17:00.864356   51168 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-508070 --format={{.State.Status}}
	I0811 23:17:00.864486   51168 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-508070 --format={{.State.Status}}
	I0811 23:17:00.912309   51168 kapi.go:59] client config for ingress-addon-legacy-508070: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt", KeyFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.key", CAFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(ni
l), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16eb290), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0811 23:17:00.926337   51168 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-508070" context rescaled to 1 replicas
	I0811 23:17:00.926385   51168 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0811 23:17:00.931118   51168 out.go:177] * Verifying Kubernetes components...
	I0811 23:17:00.933889   51168 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0811 23:17:00.945813   51168 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0811 23:17:00.948651   51168 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0811 23:17:00.948685   51168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0811 23:17:00.948788   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:17:00.978219   51168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa Username:docker}
	I0811 23:17:00.983184   51168 addons.go:231] Setting addon default-storageclass=true in "ingress-addon-legacy-508070"
	I0811 23:17:00.983234   51168 host.go:66] Checking if "ingress-addon-legacy-508070" exists ...
	I0811 23:17:00.983696   51168 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-508070 --format={{.State.Status}}
	I0811 23:17:01.017663   51168 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0811 23:17:01.017690   51168 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0811 23:17:01.017756   51168 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-508070
	I0811 23:17:01.064659   51168 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/ingress-addon-legacy-508070/id_rsa Username:docker}
	I0811 23:17:01.255489   51168 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0811 23:17:01.256373   51168 kapi.go:59] client config for ingress-addon-legacy-508070: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt", KeyFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.key", CAFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(ni
l), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16eb290), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0811 23:17:01.256733   51168 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-508070" to be "Ready" ...
	I0811 23:17:01.261213   51168 node_ready.go:49] node "ingress-addon-legacy-508070" has status "Ready":"True"
	I0811 23:17:01.261236   51168 node_ready.go:38] duration metric: took 4.48269ms waiting for node "ingress-addon-legacy-508070" to be "Ready" ...
	I0811 23:17:01.261247   51168 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0811 23:17:01.271677   51168 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-2nddc" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:01.315882   51168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0811 23:17:01.372638   51168 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0811 23:17:01.842224   51168 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0811 23:17:02.080823   51168 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0811 23:17:02.082733   51168 addons.go:502] enable addons completed in 1.219243415s: enabled=[storage-provisioner default-storageclass]
	I0811 23:17:03.401388   51168 pod_ready.go:102] pod "coredns-66bff467f8-2nddc" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:05.895877   51168 pod_ready.go:102] pod "coredns-66bff467f8-2nddc" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:07.896900   51168 pod_ready.go:102] pod "coredns-66bff467f8-2nddc" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:08.392196   51168 pod_ready.go:97] error getting pod "coredns-66bff467f8-2nddc" in "kube-system" namespace (skipping!): pods "coredns-66bff467f8-2nddc" not found
	I0811 23:17:08.392229   51168 pod_ready.go:81] duration metric: took 7.120511648s waiting for pod "coredns-66bff467f8-2nddc" in "kube-system" namespace to be "Ready" ...
	E0811 23:17:08.392239   51168 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-66bff467f8-2nddc" in "kube-system" namespace (skipping!): pods "coredns-66bff467f8-2nddc" not found
	I0811 23:17:08.392249   51168 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:10.406956   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:12.407254   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:14.407858   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:16.907229   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:18.907819   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:21.407675   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:23.407831   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:25.906893   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:28.407914   51168 pod_ready.go:102] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"False"
	I0811 23:17:28.907423   51168 pod_ready.go:92] pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace has status "Ready":"True"
	I0811 23:17:28.907449   51168 pod_ready.go:81] duration metric: took 20.515193536s waiting for pod "coredns-66bff467f8-qz8rz" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.907461   51168 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-508070" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.912249   51168 pod_ready.go:92] pod "etcd-ingress-addon-legacy-508070" in "kube-system" namespace has status "Ready":"True"
	I0811 23:17:28.912274   51168 pod_ready.go:81] duration metric: took 4.80495ms waiting for pod "etcd-ingress-addon-legacy-508070" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.912288   51168 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-508070" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.917160   51168 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-508070" in "kube-system" namespace has status "Ready":"True"
	I0811 23:17:28.917186   51168 pod_ready.go:81] duration metric: took 4.85879ms waiting for pod "kube-apiserver-ingress-addon-legacy-508070" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.917198   51168 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-508070" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.922056   51168 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-508070" in "kube-system" namespace has status "Ready":"True"
	I0811 23:17:28.922079   51168 pod_ready.go:81] duration metric: took 4.873379ms waiting for pod "kube-controller-manager-ingress-addon-legacy-508070" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.922092   51168 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-2f8mv" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.926826   51168 pod_ready.go:92] pod "kube-proxy-2f8mv" in "kube-system" namespace has status "Ready":"True"
	I0811 23:17:28.926853   51168 pod_ready.go:81] duration metric: took 4.75348ms waiting for pod "kube-proxy-2f8mv" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:28.926869   51168 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-508070" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:29.102196   51168 request.go:628] Waited for 175.242793ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-508070
	I0811 23:17:29.302580   51168 request.go:628] Waited for 197.356487ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-508070
	I0811 23:17:29.305325   51168 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-508070" in "kube-system" namespace has status "Ready":"True"
	I0811 23:17:29.305351   51168 pod_ready.go:81] duration metric: took 378.449633ms waiting for pod "kube-scheduler-ingress-addon-legacy-508070" in "kube-system" namespace to be "Ready" ...
	I0811 23:17:29.305361   51168 pod_ready.go:38] duration metric: took 28.044104035s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0811 23:17:29.305375   51168 api_server.go:52] waiting for apiserver process to appear ...
	I0811 23:17:29.305432   51168 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:17:29.318716   51168 api_server.go:72] duration metric: took 28.392280711s to wait for apiserver process to appear ...
	I0811 23:17:29.318788   51168 api_server.go:88] waiting for apiserver healthz status ...
	I0811 23:17:29.318818   51168 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0811 23:17:29.327997   51168 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0811 23:17:29.328909   51168 api_server.go:141] control plane version: v1.18.20
	I0811 23:17:29.328934   51168 api_server.go:131] duration metric: took 10.126886ms to wait for apiserver health ...
	I0811 23:17:29.328942   51168 system_pods.go:43] waiting for kube-system pods to appear ...
	I0811 23:17:29.502242   51168 request.go:628] Waited for 173.222801ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0811 23:17:29.508122   51168 system_pods.go:59] 8 kube-system pods found
	I0811 23:17:29.508157   51168 system_pods.go:61] "coredns-66bff467f8-qz8rz" [2dd1836b-2d90-4b36-acf9-fe783652bdc4] Running
	I0811 23:17:29.508166   51168 system_pods.go:61] "etcd-ingress-addon-legacy-508070" [3d27421e-6089-4e1d-bf90-10327d0c593b] Running
	I0811 23:17:29.508172   51168 system_pods.go:61] "kindnet-smtpb" [ad58c8b1-4678-4e1c-9db6-6611ea083d4f] Running
	I0811 23:17:29.508178   51168 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-508070" [ba110689-f70a-4354-b06e-d1144a434b32] Running
	I0811 23:17:29.508183   51168 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-508070" [b1df7cfc-6049-4bab-adf5-9f849e0f9a0d] Running
	I0811 23:17:29.508188   51168 system_pods.go:61] "kube-proxy-2f8mv" [62813ca0-971c-4a02-a4e9-e6394771a4c9] Running
	I0811 23:17:29.508193   51168 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-508070" [7b0c42c7-892f-4c3a-8725-1dfdf5cec8ee] Running
	I0811 23:17:29.508205   51168 system_pods.go:61] "storage-provisioner" [280c016f-5a2c-4cec-ba9b-13e29b44e9c1] Running
	I0811 23:17:29.508213   51168 system_pods.go:74] duration metric: took 179.265825ms to wait for pod list to return data ...
	I0811 23:17:29.508221   51168 default_sa.go:34] waiting for default service account to be created ...
	I0811 23:17:29.702664   51168 request.go:628] Waited for 194.351553ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I0811 23:17:29.705242   51168 default_sa.go:45] found service account: "default"
	I0811 23:17:29.705270   51168 default_sa.go:55] duration metric: took 197.04021ms for default service account to be created ...
	I0811 23:17:29.705280   51168 system_pods.go:116] waiting for k8s-apps to be running ...
	I0811 23:17:29.902679   51168 request.go:628] Waited for 197.340429ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0811 23:17:29.908599   51168 system_pods.go:86] 8 kube-system pods found
	I0811 23:17:29.908634   51168 system_pods.go:89] "coredns-66bff467f8-qz8rz" [2dd1836b-2d90-4b36-acf9-fe783652bdc4] Running
	I0811 23:17:29.908641   51168 system_pods.go:89] "etcd-ingress-addon-legacy-508070" [3d27421e-6089-4e1d-bf90-10327d0c593b] Running
	I0811 23:17:29.908646   51168 system_pods.go:89] "kindnet-smtpb" [ad58c8b1-4678-4e1c-9db6-6611ea083d4f] Running
	I0811 23:17:29.908673   51168 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-508070" [ba110689-f70a-4354-b06e-d1144a434b32] Running
	I0811 23:17:29.908684   51168 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-508070" [b1df7cfc-6049-4bab-adf5-9f849e0f9a0d] Running
	I0811 23:17:29.908695   51168 system_pods.go:89] "kube-proxy-2f8mv" [62813ca0-971c-4a02-a4e9-e6394771a4c9] Running
	I0811 23:17:29.908704   51168 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-508070" [7b0c42c7-892f-4c3a-8725-1dfdf5cec8ee] Running
	I0811 23:17:29.908709   51168 system_pods.go:89] "storage-provisioner" [280c016f-5a2c-4cec-ba9b-13e29b44e9c1] Running
	I0811 23:17:29.908721   51168 system_pods.go:126] duration metric: took 203.436236ms to wait for k8s-apps to be running ...
	I0811 23:17:29.908729   51168 system_svc.go:44] waiting for kubelet service to be running ....
	I0811 23:17:29.908813   51168 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0811 23:17:29.922950   51168 system_svc.go:56] duration metric: took 14.210889ms WaitForService to wait for kubelet.
	I0811 23:17:29.922976   51168 kubeadm.go:581] duration metric: took 28.996556223s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0811 23:17:29.922995   51168 node_conditions.go:102] verifying NodePressure condition ...
	I0811 23:17:30.102378   51168 request.go:628] Waited for 179.267071ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I0811 23:17:30.105725   51168 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0811 23:17:30.105761   51168 node_conditions.go:123] node cpu capacity is 2
	I0811 23:17:30.105774   51168 node_conditions.go:105] duration metric: took 182.773772ms to run NodePressure ...
	I0811 23:17:30.105786   51168 start.go:228] waiting for startup goroutines ...
	I0811 23:17:30.105793   51168 start.go:233] waiting for cluster config update ...
	I0811 23:17:30.105835   51168 start.go:242] writing updated cluster config ...
	I0811 23:17:30.106194   51168 ssh_runner.go:195] Run: rm -f paused
	I0811 23:17:30.168692   51168 start.go:599] kubectl: 1.27.4, cluster: 1.18.20 (minor skew: 9)
	I0811 23:17:30.171203   51168 out.go:177] 
	W0811 23:17:30.173169   51168 out.go:239] ! /usr/local/bin/kubectl is version 1.27.4, which may have incompatibilities with Kubernetes 1.18.20.
	I0811 23:17:30.175221   51168 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I0811 23:17:30.177455   51168 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-508070" cluster and "default" namespace by default
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	5ce27c5c9b203       13753a81eccfd       13 seconds ago       Exited              hello-world-app           2                   cd46f5339ea0f       hello-world-app-5f5d8b66bb-kqj6c
	5b04e99312cc5       7987e0c18af05       36 seconds ago       Running             nginx                     0                   aebaf2fd16974       nginx
	521f1050490a2       d7f0cba3aa5bf       53 seconds ago       Exited              controller                0                   350c6bf1192d3       ingress-nginx-controller-7fcf777cb7-dpcht
	4960b5d4de721       a883f7fc35610       58 seconds ago       Exited              patch                     0                   9bed883a2be35       ingress-nginx-admission-patch-z75kp
	57e4d5c8cfeb2       a883f7fc35610       58 seconds ago       Exited              create                    0                   1a24b07439f41       ingress-nginx-admission-create-j5x5t
	f8fa010343b0e       6e17ba78cf3eb       About a minute ago   Running             coredns                   0                   ddf14daf240a2       coredns-66bff467f8-qz8rz
	109263020077b       ba04bb24b9575       About a minute ago   Running             storage-provisioner       0                   2ad54d0ce53e8       storage-provisioner
	f3a221ced7bb0       b18bf71b941ba       About a minute ago   Running             kindnet-cni               0                   5e86c41b6b68a       kindnet-smtpb
	392ff559bb4cd       565297bc6f7d4       About a minute ago   Running             kube-proxy                0                   4d43863d6dfcb       kube-proxy-2f8mv
	8fe1b36ad0509       ab707b0a0ea33       About a minute ago   Running             etcd                      0                   c1f8f1d314795       etcd-ingress-addon-legacy-508070
	cc9d1b3b3cd6a       095f37015706d       About a minute ago   Running             kube-scheduler            0                   663825af23313       kube-scheduler-ingress-addon-legacy-508070
	4aa482869f6c5       68a4fac29a865       About a minute ago   Running             kube-controller-manager   0                   3c15d543bdf24       kube-controller-manager-ingress-addon-legacy-508070
	7bfe4ffbd69f9       2694cf044d665       About a minute ago   Running             kube-apiserver            0                   1d5f79363bc89       kube-apiserver-ingress-addon-legacy-508070
	
	* 
	* ==> containerd <==
	* Aug 11 23:18:20 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:20.350145520Z" level=info msg="RemoveContainer for \"88c45152f8c324ffd22d134ab95507e0359d61a04640eba43b522de183dd3b1a\" returns successfully"
	Aug 11 23:18:23 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:23.946742329Z" level=info msg="StopContainer for \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\" with timeout 2 (s)"
	Aug 11 23:18:23 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:23.947245368Z" level=info msg="Stop container \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\" with signal terminated"
	Aug 11 23:18:23 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:23.960752862Z" level=info msg="StopContainer for \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\" with timeout 2 (s)"
	Aug 11 23:18:23 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:23.965130603Z" level=info msg="Skipping the sending of signal terminated to container \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\" because a prior stop with timeout>0 request already sent the signal"
	Aug 11 23:18:25 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:25.961690194Z" level=info msg="Kill container \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\""
	Aug 11 23:18:25 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:25.965385322Z" level=info msg="Kill container \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\""
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.066040630Z" level=info msg="shim disconnected" id=521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.066100732Z" level=warning msg="cleaning up after shim disconnected" id=521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98 namespace=k8s.io
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.066113007Z" level=info msg="cleaning up dead shim"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.077325108Z" level=warning msg="cleanup warnings time=\"2023-08-11T23:18:26Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4623 runtime=io.containerd.runc.v2\n"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.080654237Z" level=info msg="StopContainer for \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\" returns successfully"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.080657043Z" level=info msg="StopContainer for \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\" returns successfully"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.081398396Z" level=info msg="StopPodSandbox for \"350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a\""
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.081446871Z" level=info msg="StopPodSandbox for \"350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a\""
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.081666543Z" level=info msg="Container to stop \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\" must be in running or unknown state, current state \"CONTAINER_EXITED\""
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.081595578Z" level=info msg="Container to stop \"521f1050490a2d838fa182edfbfab680e8b4f5a4f2de8494a5a3df03952c6e98\" must be in running or unknown state, current state \"CONTAINER_EXITED\""
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.121316005Z" level=info msg="shim disconnected" id=350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.121692056Z" level=warning msg="cleaning up after shim disconnected" id=350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a namespace=k8s.io
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.121717163Z" level=info msg="cleaning up dead shim"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.133597716Z" level=warning msg="cleanup warnings time=\"2023-08-11T23:18:26Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4660 runtime=io.containerd.runc.v2\n"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.200253551Z" level=info msg="TearDown network for sandbox \"350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a\" successfully"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.200446540Z" level=info msg="StopPodSandbox for \"350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a\" returns successfully"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.203799914Z" level=info msg="TearDown network for sandbox \"350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a\" successfully"
	Aug 11 23:18:26 ingress-addon-legacy-508070 containerd[821]: time="2023-08-11T23:18:26.203844861Z" level=info msg="StopPodSandbox for \"350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a\" returns successfully"
	
	* 
	* ==> coredns [f8fa010343b0eec6d4b8be6410c2ab287150ef805e9dc05dcdd6fedd2adb00a3] <==
	* [INFO] 10.244.0.5:52953 - 36466 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000046415s
	[INFO] 10.244.0.5:52953 - 5282 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001959292s
	[INFO] 10.244.0.5:50977 - 46511 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002346009s
	[INFO] 10.244.0.5:52953 - 16044 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.003587832s
	[INFO] 10.244.0.5:50977 - 20919 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.003593813s
	[INFO] 10.244.0.5:50977 - 27268 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000152555s
	[INFO] 10.244.0.5:52953 - 34723 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000099116s
	[INFO] 10.244.0.5:47210 - 53924 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000102267s
	[INFO] 10.244.0.5:36993 - 37488 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.00020487s
	[INFO] 10.244.0.5:47210 - 48996 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.00004338s
	[INFO] 10.244.0.5:36993 - 46321 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000034149s
	[INFO] 10.244.0.5:47210 - 19627 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000033665s
	[INFO] 10.244.0.5:36993 - 9375 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032853s
	[INFO] 10.244.0.5:47210 - 52577 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00003319s
	[INFO] 10.244.0.5:36993 - 35235 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000031154s
	[INFO] 10.244.0.5:47210 - 30613 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000050083s
	[INFO] 10.244.0.5:47210 - 1775 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000033862s
	[INFO] 10.244.0.5:36993 - 59977 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00005874s
	[INFO] 10.244.0.5:36993 - 133 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000034707s
	[INFO] 10.244.0.5:36993 - 63650 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002464726s
	[INFO] 10.244.0.5:47210 - 58353 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.003528411s
	[INFO] 10.244.0.5:36993 - 56381 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001087249s
	[INFO] 10.244.0.5:47210 - 13516 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001165828s
	[INFO] 10.244.0.5:47210 - 38418 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000206561s
	[INFO] 10.244.0.5:36993 - 65252 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000079547s
	
	* 
	* ==> describe nodes <==
	* Name:               ingress-addon-legacy-508070
	Roles:              master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=ingress-addon-legacy-508070
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=0bff008270ec17d4e0c2c90a14e18ac31a0e01f5
	                    minikube.k8s.io/name=ingress-addon-legacy-508070
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_08_11T23_16_45_0700
	                    minikube.k8s.io/version=v1.31.1
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Fri, 11 Aug 2023 23:16:41 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-508070
	  AcquireTime:     <unset>
	  RenewTime:       Fri, 11 Aug 2023 23:18:28 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Fri, 11 Aug 2023 23:18:18 +0000   Fri, 11 Aug 2023 23:16:34 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Fri, 11 Aug 2023 23:18:18 +0000   Fri, 11 Aug 2023 23:16:34 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Fri, 11 Aug 2023 23:18:18 +0000   Fri, 11 Aug 2023 23:16:34 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Fri, 11 Aug 2023 23:18:18 +0000   Fri, 11 Aug 2023 23:16:58 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-508070
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022624Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022624Ki
	  pods:               110
	System Info:
	  Machine ID:                 8a9341060ee641c5bf02e24c200e703f
	  System UUID:                529dd776-05be-4365-a779-11e63c757884
	  Boot ID:                    9de47e29-690d-4729-8666-b04b4dd58706
	  Kernel Version:             5.15.0-1040-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.6.21
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-kqj6c                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39s
	  kube-system                 coredns-66bff467f8-qz8rz                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     92s
	  kube-system                 etcd-ingress-addon-legacy-508070                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         104s
	  kube-system                 kindnet-smtpb                                          100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      92s
	  kube-system                 kube-apiserver-ingress-addon-legacy-508070             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         104s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-508070    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         104s
	  kube-system                 kube-proxy-2f8mv                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s
	  kube-system                 kube-scheduler-ingress-addon-legacy-508070             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         104s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         90s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)
	  memory             120Mi (1%!)(MISSING)  220Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age              From        Message
	  ----    ------                   ----             ----        -------
	  Normal  Starting                 2m               kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m (x4 over 2m)  kubelet     Node ingress-addon-legacy-508070 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m (x4 over 2m)  kubelet     Node ingress-addon-legacy-508070 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m (x4 over 2m)  kubelet     Node ingress-addon-legacy-508070 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  2m               kubelet     Updated Node Allocatable limit across pods
	  Normal  Starting                 105s             kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  104s             kubelet     Node ingress-addon-legacy-508070 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    104s             kubelet     Node ingress-addon-legacy-508070 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     104s             kubelet     Node ingress-addon-legacy-508070 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  104s             kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                94s              kubelet     Node ingress-addon-legacy-508070 status is now: NodeReady
	  Normal  Starting                 91s              kube-proxy  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +0.000715] FS-Cache: N-cookie c=0000000c [p=00000003 fl=2 nc=0 na=1]
	[  +0.000949] FS-Cache: N-cookie d=000000002fd8c7ff{9p.inode} n=00000000699cacf4
	[  +0.001047] FS-Cache: N-key=[8] '9e385c0100000000'
	[  +0.003043] FS-Cache: Duplicate cookie detected
	[  +0.000729] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000978] FS-Cache: O-cookie d=000000002fd8c7ff{9p.inode} n=00000000db345718
	[  +0.001134] FS-Cache: O-key=[8] '9e385c0100000000'
	[  +0.000715] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
	[  +0.000972] FS-Cache: N-cookie d=000000002fd8c7ff{9p.inode} n=0000000043789e40
	[  +0.001075] FS-Cache: N-key=[8] '9e385c0100000000'
	[  +2.726009] FS-Cache: Duplicate cookie detected
	[  +0.000765] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000977] FS-Cache: O-cookie d=000000002fd8c7ff{9p.inode} n=000000005421d4ac
	[  +0.001109] FS-Cache: O-key=[8] '9d385c0100000000'
	[  +0.000721] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
	[  +0.000978] FS-Cache: N-cookie d=000000002fd8c7ff{9p.inode} n=0000000016d32580
	[  +0.001105] FS-Cache: N-key=[8] '9d385c0100000000'
	[  +0.435245] FS-Cache: Duplicate cookie detected
	[  +0.000737] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000949] FS-Cache: O-cookie d=000000002fd8c7ff{9p.inode} n=00000000eb575120
	[  +0.001036] FS-Cache: O-key=[8] 'a5385c0100000000'
	[  +0.000739] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
	[  +0.000924] FS-Cache: N-cookie d=000000002fd8c7ff{9p.inode} n=00000000f0e81b88
	[  +0.001050] FS-Cache: N-key=[8] 'a5385c0100000000'
	[Aug11 23:16] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
	
	* 
	* ==> etcd [8fe1b36ad050965818175ce099ffd21fd0e2b92060d6d519f5d7c18fe0b583c5] <==
	* raft2023/08/11 23:16:36 INFO: aec36adc501070cc became follower at term 0
	raft2023/08/11 23:16:36 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	raft2023/08/11 23:16:36 INFO: aec36adc501070cc became follower at term 1
	raft2023/08/11 23:16:36 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-08-11 23:16:36.808743 W | auth: simple token is not cryptographically signed
	2023-08-11 23:16:36.811656 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	2023-08-11 23:16:36.813725 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2023-08-11 23:16:36.814058 I | embed: listening for metrics on http://127.0.0.1:2381
	2023-08-11 23:16:36.814486 I | embed: listening for peers on 192.168.49.2:2380
	raft2023/08/11 23:16:36 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-08-11 23:16:36.815126 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	2023-08-11 23:16:36.815678 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	raft2023/08/11 23:16:36 INFO: aec36adc501070cc is starting a new election at term 1
	raft2023/08/11 23:16:36 INFO: aec36adc501070cc became candidate at term 2
	raft2023/08/11 23:16:36 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2023/08/11 23:16:36 INFO: aec36adc501070cc became leader at term 2
	raft2023/08/11 23:16:36 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2023-08-11 23:16:36.903241 I | etcdserver: setting up the initial cluster version to 3.4
	2023-08-11 23:16:36.903458 I | etcdserver: published {Name:ingress-addon-legacy-508070 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2023-08-11 23:16:36.903873 I | embed: ready to serve client requests
	2023-08-11 23:16:36.905419 I | embed: serving client requests on 192.168.49.2:2379
	2023-08-11 23:16:36.911052 I | embed: ready to serve client requests
	2023-08-11 23:16:36.912506 N | etcdserver/membership: set the initial cluster version to 3.4
	2023-08-11 23:16:36.912758 I | embed: serving client requests on 127.0.0.1:2379
	2023-08-11 23:16:36.912861 I | etcdserver/api: enabled capabilities for version 3.4
	
	* 
	* ==> kernel <==
	*  23:18:32 up  1:00,  0 users,  load average: 1.32, 1.27, 0.93
	Linux ingress-addon-legacy-508070 5.15.0-1040-aws #45~20.04.1-Ubuntu SMP Tue Jul 11 19:11:12 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kindnet [f3a221ced7bb0c423e35dea692c17ff3d1c60313e5201909e5cfcad85cc9d985] <==
	* I0811 23:17:03.534890       1 main.go:102] connected to apiserver: https://10.96.0.1:443
	I0811 23:17:03.535060       1 main.go:107] hostIP = 192.168.49.2
	podIP = 192.168.49.2
	I0811 23:17:03.535233       1 main.go:116] setting mtu 1500 for CNI 
	I0811 23:17:03.535264       1 main.go:146] kindnetd IP family: "ipv4"
	I0811 23:17:03.535276       1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
	I0811 23:17:03.934734       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:17:03.934779       1 main.go:227] handling current node
	I0811 23:17:14.043441       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:17:14.043473       1 main.go:227] handling current node
	I0811 23:17:24.054575       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:17:24.054605       1 main.go:227] handling current node
	I0811 23:17:34.059244       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:17:34.059271       1 main.go:227] handling current node
	I0811 23:17:44.072201       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:17:44.072231       1 main.go:227] handling current node
	I0811 23:17:54.079895       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:17:54.079930       1 main.go:227] handling current node
	I0811 23:18:04.092014       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:18:04.092044       1 main.go:227] handling current node
	I0811 23:18:14.103101       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:18:14.103189       1 main.go:227] handling current node
	I0811 23:18:24.107547       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0811 23:18:24.107580       1 main.go:227] handling current node
	
	* 
	* ==> kube-apiserver [7bfe4ffbd69f9fab98972531d9bed30ad67f1bf10d49685341dfcc04552a8f69] <==
	* I0811 23:16:41.416915       1 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/minikube/certs/ca.crt
	I0811 23:16:41.417110       1 dynamic_cafile_content.go:167] Starting request-header::/var/lib/minikube/certs/front-proxy-ca.crt
	I0811 23:16:41.535923       1 cache.go:39] Caches are synced for autoregister controller
	I0811 23:16:41.537093       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I0811 23:16:41.537229       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0811 23:16:41.538952       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0811 23:16:41.543331       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I0811 23:16:42.333360       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0811 23:16:42.333622       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0811 23:16:42.339926       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I0811 23:16:42.345048       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I0811 23:16:42.345077       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I0811 23:16:42.767757       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0811 23:16:42.806541       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0811 23:16:42.935888       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0811 23:16:42.937029       1 controller.go:609] quota admission added evaluator for: endpoints
	I0811 23:16:42.941216       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0811 23:16:43.772994       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I0811 23:16:44.552398       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I0811 23:16:44.669298       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I0811 23:16:47.983263       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I0811 23:17:00.434723       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I0811 23:17:00.498121       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I0811 23:17:31.028709       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I0811 23:17:53.051892       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	
	* 
	* ==> kube-controller-manager [4aa482869f6c5ed3ccd94448b7588ad68d060a9f5a80825cd1ae20e8f34d73c5] <==
	* I0811 23:17:00.618629       1 event.go:278] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kindnet", UID:"810e9fd2-f6b2-4990-8d23-4923bd4f4272", APIVersion:"apps/v1", ResourceVersion:"240", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kindnet-smtpb
	I0811 23:17:00.620114       1 event.go:278] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"801250f0-d007-4112-82b0-e28efff6e06a", APIVersion:"apps/v1", ResourceVersion:"226", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-2f8mv
	I0811 23:17:00.620088       1 shared_informer.go:230] Caches are synced for bootstrap_signer 
	I0811 23:17:00.738106       1 shared_informer.go:230] Caches are synced for persistent volume 
	I0811 23:17:00.792605       1 shared_informer.go:230] Caches are synced for ReplicationController 
	I0811 23:17:00.821532       1 shared_informer.go:230] Caches are synced for resource quota 
	I0811 23:17:00.823266       1 shared_informer.go:230] Caches are synced for endpoint 
	I0811 23:17:00.832630       1 shared_informer.go:230] Caches are synced for resource quota 
	I0811 23:17:00.841007       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0811 23:17:00.841035       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0811 23:17:00.874561       1 shared_informer.go:230] Caches are synced for disruption 
	I0811 23:17:00.874587       1 disruption.go:339] Sending events to api server.
	I0811 23:17:00.918884       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"2ce76b54-4c76-4233-acf2-1596d7215f82", APIVersion:"apps/v1", ResourceVersion:"378", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled down replica set coredns-66bff467f8 to 1
	I0811 23:17:00.999849       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"a8464bb2-6682-4359-b6e2-2a86eaf17572", APIVersion:"apps/v1", ResourceVersion:"379", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: coredns-66bff467f8-2nddc
	I0811 23:17:01.082760       1 request.go:621] Throttling request took 1.002998162s, request: GET:https://control-plane.minikube.internal:8443/apis/storage.k8s.io/v1beta1?timeout=32s
	I0811 23:17:01.534742       1 shared_informer.go:223] Waiting for caches to sync for garbage collector
	I0811 23:17:01.534827       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0811 23:17:30.996143       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"d74364c3-5323-4888-a5a5-3932fb62a575", APIVersion:"apps/v1", ResourceVersion:"492", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I0811 23:17:31.016623       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"0866e958-eb52-4a42-a2fe-bebe320a6611", APIVersion:"apps/v1", ResourceVersion:"493", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-dpcht
	I0811 23:17:31.068571       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"f6b626ff-1893-49ca-b2fd-d4de9c558767", APIVersion:"batch/v1", ResourceVersion:"498", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-j5x5t
	I0811 23:17:31.098598       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"753237b1-d358-446e-b45e-18bcc7c29f4c", APIVersion:"batch/v1", ResourceVersion:"508", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-z75kp
	I0811 23:17:34.194144       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"753237b1-d358-446e-b45e-18bcc7c29f4c", APIVersion:"batch/v1", ResourceVersion:"516", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0811 23:17:34.216932       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"f6b626ff-1893-49ca-b2fd-d4de9c558767", APIVersion:"batch/v1", ResourceVersion:"514", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0811 23:18:02.808831       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"e8e1d349-36e4-4c07-ae99-02f818f5d232", APIVersion:"apps/v1", ResourceVersion:"628", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	I0811 23:18:02.825292       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"157f8d72-6e91-4883-ad99-d489a36b74cc", APIVersion:"apps/v1", ResourceVersion:"629", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-kqj6c
	
	* 
	* ==> kube-proxy [392ff559bb4cd160aef3c93e8b5a2bf99d7512d51344bfa7eef5b6aa572d7b4d] <==
	* W0811 23:17:01.781955       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I0811 23:17:01.802106       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I0811 23:17:01.802157       1 server_others.go:186] Using iptables Proxier.
	I0811 23:17:01.804040       1 server.go:583] Version: v1.18.20
	I0811 23:17:01.805401       1 config.go:315] Starting service config controller
	I0811 23:17:01.805440       1 shared_informer.go:223] Waiting for caches to sync for service config
	I0811 23:17:01.807406       1 config.go:133] Starting endpoints config controller
	I0811 23:17:01.807421       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I0811 23:17:01.905703       1 shared_informer.go:230] Caches are synced for service config 
	I0811 23:17:01.907933       1 shared_informer.go:230] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [cc9d1b3b3cd6a386a892cb50e29387c94b030dafe195de4c27aaeadae2e0193e] <==
	* W0811 23:16:41.519783       1 authentication.go:298] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0811 23:16:41.519836       1 authentication.go:299] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0811 23:16:41.540650       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0811 23:16:41.540678       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0811 23:16:41.549375       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
	I0811 23:16:41.553769       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0811 23:16:41.553856       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0811 23:16:41.553928       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0811 23:16:41.563451       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0811 23:16:41.563591       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0811 23:16:41.563850       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0811 23:16:41.571435       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0811 23:16:41.572269       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0811 23:16:41.572403       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0811 23:16:41.572601       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0811 23:16:41.572813       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0811 23:16:41.573021       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0811 23:16:41.574233       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0811 23:16:41.574446       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0811 23:16:41.577871       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0811 23:16:42.415152       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0811 23:16:42.611248       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0811 23:16:42.637777       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0811 23:16:42.796276       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0811 23:16:45.954040       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* Aug 11 23:18:06 ingress-addon-legacy-508070 kubelet[1664]: E0811 23:18:06.309069    1664 pod_workers.go:191] Error syncing pod b67733f6-3976-4fc9-a05e-36aa5531bdb2 ("hello-world-app-5f5d8b66bb-kqj6c_default(b67733f6-3976-4fc9-a05e-36aa5531bdb2)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-kqj6c_default(b67733f6-3976-4fc9-a05e-36aa5531bdb2)"
	Aug 11 23:18:07 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:07.311865    1664 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 84b77213a4b3f24d71f353db8a18f03256f13046a1a83b1ac81907bf11420afb
	Aug 11 23:18:07 ingress-addon-legacy-508070 kubelet[1664]: E0811 23:18:07.312107    1664 pod_workers.go:191] Error syncing pod b67733f6-3976-4fc9-a05e-36aa5531bdb2 ("hello-world-app-5f5d8b66bb-kqj6c_default(b67733f6-3976-4fc9-a05e-36aa5531bdb2)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-kqj6c_default(b67733f6-3976-4fc9-a05e-36aa5531bdb2)"
	Aug 11 23:18:11 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:11.035497    1664 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 88c45152f8c324ffd22d134ab95507e0359d61a04640eba43b522de183dd3b1a
	Aug 11 23:18:11 ingress-addon-legacy-508070 kubelet[1664]: E0811 23:18:11.036410    1664 pod_workers.go:191] Error syncing pod 2df27f51-0443-4855-a04a-4f9e022a81fb ("kube-ingress-dns-minikube_kube-system(2df27f51-0443-4855-a04a-4f9e022a81fb)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with CrashLoopBackOff: "back-off 20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(2df27f51-0443-4855-a04a-4f9e022a81fb)"
	Aug 11 23:18:18 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:18.036060    1664 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 84b77213a4b3f24d71f353db8a18f03256f13046a1a83b1ac81907bf11420afb
	Aug 11 23:18:18 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:18.335408    1664 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 84b77213a4b3f24d71f353db8a18f03256f13046a1a83b1ac81907bf11420afb
	Aug 11 23:18:18 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:18.335781    1664 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 5ce27c5c9b2034a79a7c0e911454c8e2f89675b67513f3340c5fc6597c842609
	Aug 11 23:18:18 ingress-addon-legacy-508070 kubelet[1664]: E0811 23:18:18.336023    1664 pod_workers.go:191] Error syncing pod b67733f6-3976-4fc9-a05e-36aa5531bdb2 ("hello-world-app-5f5d8b66bb-kqj6c_default(b67733f6-3976-4fc9-a05e-36aa5531bdb2)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-kqj6c_default(b67733f6-3976-4fc9-a05e-36aa5531bdb2)"
	Aug 11 23:18:18 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:18.779796    1664 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-mr4t4" (UniqueName: "kubernetes.io/secret/2df27f51-0443-4855-a04a-4f9e022a81fb-minikube-ingress-dns-token-mr4t4") pod "2df27f51-0443-4855-a04a-4f9e022a81fb" (UID: "2df27f51-0443-4855-a04a-4f9e022a81fb")
	Aug 11 23:18:18 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:18.784418    1664 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df27f51-0443-4855-a04a-4f9e022a81fb-minikube-ingress-dns-token-mr4t4" (OuterVolumeSpecName: "minikube-ingress-dns-token-mr4t4") pod "2df27f51-0443-4855-a04a-4f9e022a81fb" (UID: "2df27f51-0443-4855-a04a-4f9e022a81fb"). InnerVolumeSpecName "minikube-ingress-dns-token-mr4t4". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Aug 11 23:18:18 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:18.880313    1664 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-mr4t4" (UniqueName: "kubernetes.io/secret/2df27f51-0443-4855-a04a-4f9e022a81fb-minikube-ingress-dns-token-mr4t4") on node "ingress-addon-legacy-508070" DevicePath ""
	Aug 11 23:18:20 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:20.343105    1664 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 88c45152f8c324ffd22d134ab95507e0359d61a04640eba43b522de183dd3b1a
	Aug 11 23:18:23 ingress-addon-legacy-508070 kubelet[1664]: E0811 23:18:23.951108    1664 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-dpcht.177a77693f2e58c6", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-dpcht", UID:"aaa3c0e4-a417-4ad1-ae10-c839e1497220", APIVersion:"v1", ResourceVersion:"497", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-508070"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc12dce4ff867a2c6, ext:99454013573, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc12dce4ff867a2c6, ext:99454013573, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-dpcht.177a77693f2e58c6" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Aug 11 23:18:23 ingress-addon-legacy-508070 kubelet[1664]: E0811 23:18:23.969928    1664 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-dpcht.177a77693f2e58c6", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-dpcht", UID:"aaa3c0e4-a417-4ad1-ae10-c839e1497220", APIVersion:"v1", ResourceVersion:"497", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-508070"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc12dce4ff867a2c6, ext:99454013573, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc12dce4ff926df91, ext:99466546512, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-dpcht.177a77693f2e58c6" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Aug 11 23:18:26 ingress-addon-legacy-508070 kubelet[1664]: W0811 23:18:26.355861    1664 pod_container_deletor.go:77] Container "350c6bf1192d398b642ad1d9c8a4abe19d3b7d07947fc522c12f378a7d2fe31a" not found in pod's containers
	Aug 11 23:18:28 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:28.012780    1664 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-lgr4l" (UniqueName: "kubernetes.io/secret/aaa3c0e4-a417-4ad1-ae10-c839e1497220-ingress-nginx-token-lgr4l") pod "aaa3c0e4-a417-4ad1-ae10-c839e1497220" (UID: "aaa3c0e4-a417-4ad1-ae10-c839e1497220")
	Aug 11 23:18:28 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:28.012841    1664 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/aaa3c0e4-a417-4ad1-ae10-c839e1497220-webhook-cert") pod "aaa3c0e4-a417-4ad1-ae10-c839e1497220" (UID: "aaa3c0e4-a417-4ad1-ae10-c839e1497220")
	Aug 11 23:18:28 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:28.017344    1664 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa3c0e4-a417-4ad1-ae10-c839e1497220-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "aaa3c0e4-a417-4ad1-ae10-c839e1497220" (UID: "aaa3c0e4-a417-4ad1-ae10-c839e1497220"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Aug 11 23:18:28 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:28.019581    1664 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa3c0e4-a417-4ad1-ae10-c839e1497220-ingress-nginx-token-lgr4l" (OuterVolumeSpecName: "ingress-nginx-token-lgr4l") pod "aaa3c0e4-a417-4ad1-ae10-c839e1497220" (UID: "aaa3c0e4-a417-4ad1-ae10-c839e1497220"). InnerVolumeSpecName "ingress-nginx-token-lgr4l". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Aug 11 23:18:28 ingress-addon-legacy-508070 kubelet[1664]: W0811 23:18:28.043886    1664 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/aaa3c0e4-a417-4ad1-ae10-c839e1497220/volumes" does not exist
	Aug 11 23:18:28 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:28.113167    1664 reconciler.go:319] Volume detached for volume "ingress-nginx-token-lgr4l" (UniqueName: "kubernetes.io/secret/aaa3c0e4-a417-4ad1-ae10-c839e1497220-ingress-nginx-token-lgr4l") on node "ingress-addon-legacy-508070" DevicePath ""
	Aug 11 23:18:28 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:28.113211    1664 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/aaa3c0e4-a417-4ad1-ae10-c839e1497220-webhook-cert") on node "ingress-addon-legacy-508070" DevicePath ""
	Aug 11 23:18:30 ingress-addon-legacy-508070 kubelet[1664]: I0811 23:18:30.035664    1664 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 5ce27c5c9b2034a79a7c0e911454c8e2f89675b67513f3340c5fc6597c842609
	Aug 11 23:18:30 ingress-addon-legacy-508070 kubelet[1664]: E0811 23:18:30.036002    1664 pod_workers.go:191] Error syncing pod b67733f6-3976-4fc9-a05e-36aa5531bdb2 ("hello-world-app-5f5d8b66bb-kqj6c_default(b67733f6-3976-4fc9-a05e-36aa5531bdb2)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-kqj6c_default(b67733f6-3976-4fc9-a05e-36aa5531bdb2)"
	
	* 
	* ==> storage-provisioner [109263020077b36e4e5329be68327377f4fc9db9fcede02f50313df2a68002c3] <==
	* I0811 23:17:04.714016       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0811 23:17:04.726920       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0811 23:17:04.727201       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0811 23:17:04.734961       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0811 23:17:04.735377       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-508070_17de0139-3fda-4565-b213-ddaf96f99bc1!
	I0811 23:17:04.738140       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"ab71cb39-442f-4fea-aac1-1b797990ffdc", APIVersion:"v1", ResourceVersion:"424", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-508070_17de0139-3fda-4565-b213-ddaf96f99bc1 became leader
	I0811 23:17:04.836566       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-508070_17de0139-3fda-4565-b213-ddaf96f99bc1!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-508070 -n ingress-addon-legacy-508070
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-508070 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (54.01s)

                                                
                                    
x
+
TestMissingContainerUpgrade (217.41s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:321: (dbg) Run:  /tmp/minikube-v1.22.0.295780959.exe start -p missing-upgrade-770859 --memory=2200 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:321: (dbg) Done: /tmp/minikube-v1.22.0.295780959.exe start -p missing-upgrade-770859 --memory=2200 --driver=docker  --container-runtime=containerd: (1m52.021881467s)
version_upgrade_test.go:330: (dbg) Run:  docker stop missing-upgrade-770859
version_upgrade_test.go:330: (dbg) Done: docker stop missing-upgrade-770859: (11.792384578s)
version_upgrade_test.go:335: (dbg) Run:  docker rm missing-upgrade-770859
version_upgrade_test.go:341: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-770859 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0811 23:39:51.380690    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
version_upgrade_test.go:341: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p missing-upgrade-770859 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: exit status 90 (1m27.618605322s)

                                                
                                                
-- stdout --
	* [missing-upgrade-770859] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17044
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.27.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.27.4
	* Using the docker driver based on existing profile
	* Starting control plane node missing-upgrade-770859 in cluster missing-upgrade-770859
	* Pulling base image ...
	* Downloading Kubernetes v1.21.2 preload ...
	* docker "missing-upgrade-770859" container is missing, will recreate.
	* Creating docker container (CPUs=2, Memory=2200MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0811 23:39:46.266592  134361 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:39:46.266774  134361 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:39:46.266779  134361 out.go:309] Setting ErrFile to fd 2...
	I0811 23:39:46.266785  134361 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:39:46.267048  134361 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:39:46.267408  134361 out.go:303] Setting JSON to false
	I0811 23:39:46.268354  134361 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":4933,"bootTime":1691792254,"procs":269,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:39:46.268416  134361 start.go:138] virtualization:  
	I0811 23:39:46.274349  134361 out.go:177] * [missing-upgrade-770859] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:39:46.276829  134361 out.go:177]   - MINIKUBE_LOCATION=17044
	I0811 23:39:46.278779  134361 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:39:46.277021  134361 notify.go:220] Checking for updates...
	I0811 23:39:46.283053  134361 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:39:46.284790  134361 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:39:46.286547  134361 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0811 23:39:46.288367  134361 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0811 23:39:46.290993  134361 config.go:182] Loaded profile config "missing-upgrade-770859": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0811 23:39:46.293614  134361 out.go:177] * Kubernetes 1.27.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.27.4
	I0811 23:39:46.295470  134361 driver.go:373] Setting default libvirt URI to qemu:///system
	I0811 23:39:46.322269  134361 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:39:46.322377  134361 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:39:46.476693  134361 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:53 SystemTime:2023-08-11 23:39:46.463875217 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:39:46.476795  134361 docker.go:294] overlay module found
	I0811 23:39:46.479339  134361 out.go:177] * Using the docker driver based on existing profile
	I0811 23:39:46.481538  134361 start.go:298] selected driver: docker
	I0811 23:39:46.481559  134361 start.go:901] validating driver "docker" against &{Name:missing-upgrade-770859 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:missing-upgrade-770859 Namespace:default APIServerName:minikubeCA APIServer
Names:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.21.2 ContainerRuntime: ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID: BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:39:46.481681  134361 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0811 23:39:46.482356  134361 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:39:46.595702  134361 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:53 SystemTime:2023-08-11 23:39:46.583847705 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:39:46.596019  134361 cni.go:84] Creating CNI manager for ""
	I0811 23:39:46.596036  134361 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:39:46.596045  134361 start_flags.go:319] config:
	{Name:missing-upgrade-770859 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:missing-upgrade-770859 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.21.2 ContainerRuntime: ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID: BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAut
hSock: SSHAgentPID:0}
	I0811 23:39:46.598835  134361 out.go:177] * Starting control plane node missing-upgrade-770859 in cluster missing-upgrade-770859
	I0811 23:39:46.600823  134361 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0811 23:39:46.602816  134361 out.go:177] * Pulling base image ...
	I0811 23:39:46.604742  134361 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0811 23:39:46.604922  134361 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon
	I0811 23:39:46.627947  134361 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon, skipping pull
	I0811 23:39:46.627973  134361 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 exists in daemon, skipping load
	I0811 23:39:46.682552  134361 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.21.2/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4
	I0811 23:39:46.682584  134361 cache.go:57] Caching tarball of preloaded images
	I0811 23:39:46.682852  134361 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0811 23:39:46.687167  134361 out.go:177] * Downloading Kubernetes v1.21.2 preload ...
	I0811 23:39:46.688989  134361 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:39:46.818269  134361 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.21.2/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4?checksum=md5:f1e1f7bdb5d08690c839f70306158850 -> /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4
	I0811 23:40:01.219179  134361 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:40:01.219342  134361 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:40:02.423748  134361 cache.go:60] Finished verifying existence of preloaded tar for  v1.21.2 on containerd
	I0811 23:40:02.423982  134361 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/missing-upgrade-770859/config.json ...
	I0811 23:40:02.424250  134361 cache.go:195] Successfully downloaded all kic artifacts
	I0811 23:40:02.424332  134361 start.go:365] acquiring machines lock for missing-upgrade-770859: {Name:mk08339455cffb227ae5c99b0cda4d4dfbdfe394 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0811 23:40:02.424425  134361 start.go:369] acquired machines lock for "missing-upgrade-770859" in 49.082µs
	I0811 23:40:02.424469  134361 start.go:96] Skipping create...Using existing machine configuration
	I0811 23:40:02.424485  134361 fix.go:54] fixHost starting: 
	I0811 23:40:02.424802  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:02.456578  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:02.456635  134361 fix.go:102] recreateIfNeeded on missing-upgrade-770859: state= err=unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:02.456655  134361 fix.go:107] machineExists: false. err=machine does not exist
	I0811 23:40:02.459533  134361 out.go:177] * docker "missing-upgrade-770859" container is missing, will recreate.
	I0811 23:40:02.461666  134361 delete.go:124] DEMOLISHING missing-upgrade-770859 ...
	I0811 23:40:02.461781  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:02.496470  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	W0811 23:40:02.496529  134361 stop.go:75] unable to get state: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:02.496547  134361 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:02.496987  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:02.538945  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:02.539007  134361 delete.go:82] Unable to get host status for missing-upgrade-770859, assuming it has already been deleted: state: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:02.539094  134361 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-770859
	W0811 23:40:02.565006  134361 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-770859 returned with exit code 1
	I0811 23:40:02.565041  134361 kic.go:367] could not find the container missing-upgrade-770859 to remove it. will try anyways
	I0811 23:40:02.565098  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:02.586632  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	W0811 23:40:02.586707  134361 oci.go:84] error getting container status, will try to delete anyways: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:02.586770  134361 cli_runner.go:164] Run: docker exec --privileged -t missing-upgrade-770859 /bin/bash -c "sudo init 0"
	W0811 23:40:02.608678  134361 cli_runner.go:211] docker exec --privileged -t missing-upgrade-770859 /bin/bash -c "sudo init 0" returned with exit code 1
	I0811 23:40:02.608711  134361 oci.go:647] error shutdown missing-upgrade-770859: docker exec --privileged -t missing-upgrade-770859 /bin/bash -c "sudo init 0": exit status 1
	stdout:
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:03.608924  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:03.625926  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:03.625997  134361 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:03.626011  134361 oci.go:661] temporary error: container missing-upgrade-770859 status is  but expect it to be exited
	I0811 23:40:03.626037  134361 retry.go:31] will retry after 708.932473ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:04.335543  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:04.360101  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:04.360175  134361 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:04.360186  134361 oci.go:661] temporary error: container missing-upgrade-770859 status is  but expect it to be exited
	I0811 23:40:04.360209  134361 retry.go:31] will retry after 398.984326ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:04.760134  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:04.778538  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:04.778598  134361 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:04.778607  134361 oci.go:661] temporary error: container missing-upgrade-770859 status is  but expect it to be exited
	I0811 23:40:04.778630  134361 retry.go:31] will retry after 1.661473054s: couldn't verify container is exited. %v: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:06.440777  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:06.457718  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:06.457780  134361 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:06.457794  134361 oci.go:661] temporary error: container missing-upgrade-770859 status is  but expect it to be exited
	I0811 23:40:06.457819  134361 retry.go:31] will retry after 1.069401965s: couldn't verify container is exited. %v: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:07.528223  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:07.559245  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:07.559306  134361 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:07.559316  134361 oci.go:661] temporary error: container missing-upgrade-770859 status is  but expect it to be exited
	I0811 23:40:07.559339  134361 retry.go:31] will retry after 2.131993089s: couldn't verify container is exited. %v: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:09.691535  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:09.708541  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:09.708603  134361 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:09.708616  134361 oci.go:661] temporary error: container missing-upgrade-770859 status is  but expect it to be exited
	I0811 23:40:09.708645  134361 retry.go:31] will retry after 4.948195987s: couldn't verify container is exited. %v: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:14.657048  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:14.674272  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:14.674334  134361 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:14.674348  134361 oci.go:661] temporary error: container missing-upgrade-770859 status is  but expect it to be exited
	I0811 23:40:14.674372  134361 retry.go:31] will retry after 5.180502617s: couldn't verify container is exited. %v: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:19.856095  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:19.888408  134361 cli_runner.go:211] docker container inspect missing-upgrade-770859 --format={{.State.Status}} returned with exit code 1
	I0811 23:40:19.888467  134361 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	I0811 23:40:19.888484  134361 oci.go:661] temporary error: container missing-upgrade-770859 status is  but expect it to be exited
	I0811 23:40:19.888520  134361 oci.go:88] couldn't shut down missing-upgrade-770859 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "missing-upgrade-770859": docker container inspect missing-upgrade-770859 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-770859
	 
	I0811 23:40:19.888588  134361 cli_runner.go:164] Run: docker rm -f -v missing-upgrade-770859
	I0811 23:40:19.915584  134361 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-770859
	W0811 23:40:19.938973  134361 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-770859 returned with exit code 1
	I0811 23:40:19.939096  134361 cli_runner.go:164] Run: docker network inspect missing-upgrade-770859 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0811 23:40:19.966643  134361 cli_runner.go:164] Run: docker network rm missing-upgrade-770859
	I0811 23:40:20.080016  134361 fix.go:114] Sleeping 1 second for extra luck!
	I0811 23:40:21.080772  134361 start.go:125] createHost starting for "" (driver="docker")
	I0811 23:40:21.083360  134361 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0811 23:40:21.083514  134361 start.go:159] libmachine.API.Create for "missing-upgrade-770859" (driver="docker")
	I0811 23:40:21.083537  134361 client.go:168] LocalClient.Create starting
	I0811 23:40:21.083637  134361 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem
	I0811 23:40:21.083678  134361 main.go:141] libmachine: Decoding PEM data...
	I0811 23:40:21.083698  134361 main.go:141] libmachine: Parsing certificate...
	I0811 23:40:21.083763  134361 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem
	I0811 23:40:21.083807  134361 main.go:141] libmachine: Decoding PEM data...
	I0811 23:40:21.083823  134361 main.go:141] libmachine: Parsing certificate...
	I0811 23:40:21.084125  134361 cli_runner.go:164] Run: docker network inspect missing-upgrade-770859 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0811 23:40:21.102974  134361 cli_runner.go:211] docker network inspect missing-upgrade-770859 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0811 23:40:21.103112  134361 network_create.go:281] running [docker network inspect missing-upgrade-770859] to gather additional debugging logs...
	I0811 23:40:21.103139  134361 cli_runner.go:164] Run: docker network inspect missing-upgrade-770859
	W0811 23:40:21.124447  134361 cli_runner.go:211] docker network inspect missing-upgrade-770859 returned with exit code 1
	I0811 23:40:21.124486  134361 network_create.go:284] error running [docker network inspect missing-upgrade-770859]: docker network inspect missing-upgrade-770859: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network missing-upgrade-770859 not found
	I0811 23:40:21.124502  134361 network_create.go:286] output of [docker network inspect missing-upgrade-770859]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network missing-upgrade-770859 not found
	
	** /stderr **
	I0811 23:40:21.124575  134361 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0811 23:40:21.148451  134361 network.go:214] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-e309005ba41f IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:8b:47:f4:1f} reservation:<nil>}
	I0811 23:40:21.148810  134361 network.go:214] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-9cd863e7400d IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:46:81:84:05} reservation:<nil>}
	I0811 23:40:21.149151  134361 network.go:214] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-55f60164eb4c IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:fc:ac:6a:a5} reservation:<nil>}
	I0811 23:40:21.149767  134361 network.go:209] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40004135d0}
	I0811 23:40:21.149798  134361 network_create.go:123] attempt to create docker network missing-upgrade-770859 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
	I0811 23:40:21.149860  134361 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=missing-upgrade-770859 missing-upgrade-770859
	I0811 23:40:21.239988  134361 network_create.go:107] docker network missing-upgrade-770859 192.168.76.0/24 created
	I0811 23:40:21.240026  134361 kic.go:117] calculated static IP "192.168.76.2" for the "missing-upgrade-770859" container
	I0811 23:40:21.240107  134361 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0811 23:40:21.270060  134361 cli_runner.go:164] Run: docker volume create missing-upgrade-770859 --label name.minikube.sigs.k8s.io=missing-upgrade-770859 --label created_by.minikube.sigs.k8s.io=true
	I0811 23:40:21.290789  134361 oci.go:103] Successfully created a docker volume missing-upgrade-770859
	I0811 23:40:21.290877  134361 cli_runner.go:164] Run: docker run --rm --name missing-upgrade-770859-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-770859 --entrypoint /usr/bin/test -v missing-upgrade-770859:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib
	I0811 23:40:22.655517  134361 cli_runner.go:217] Completed: docker run --rm --name missing-upgrade-770859-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-770859 --entrypoint /usr/bin/test -v missing-upgrade-770859:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib: (1.364600915s)
	I0811 23:40:22.655542  134361 oci.go:107] Successfully prepared a docker volume missing-upgrade-770859
	I0811 23:40:22.655573  134361 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0811 23:40:22.655593  134361 kic.go:190] Starting extracting preloaded images to volume ...
	I0811 23:40:22.655667  134361 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-770859:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir
	I0811 23:40:28.179669  134361 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-770859:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir: (5.523965575s)
	I0811 23:40:28.179697  134361 kic.go:199] duration metric: took 5.524101 seconds to extract preloaded images to volume
	W0811 23:40:28.179835  134361 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0811 23:40:28.179939  134361 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0811 23:40:28.274305  134361 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-770859 --name missing-upgrade-770859 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-770859 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-770859 --network missing-upgrade-770859 --ip 192.168.76.2 --volume missing-upgrade-770859:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79
	I0811 23:40:28.785837  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Running}}
	I0811 23:40:28.818898  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	I0811 23:40:28.863832  134361 cli_runner.go:164] Run: docker exec missing-upgrade-770859 stat /var/lib/dpkg/alternatives/iptables
	I0811 23:40:28.969079  134361 oci.go:144] the created container "missing-upgrade-770859" has a running status.
	I0811 23:40:28.969111  134361 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa...
	I0811 23:40:30.009333  134361 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0811 23:40:30.065008  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	I0811 23:40:30.092855  134361 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0811 23:40:30.092938  134361 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-770859 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0811 23:40:30.190398  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	I0811 23:40:30.232350  134361 machine.go:88] provisioning docker machine ...
	I0811 23:40:30.232381  134361 ubuntu.go:169] provisioning hostname "missing-upgrade-770859"
	I0811 23:40:30.232495  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:30.254035  134361 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:30.254514  134361 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32956 <nil> <nil>}
	I0811 23:40:30.254535  134361 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-770859 && echo "missing-upgrade-770859" | sudo tee /etc/hostname
	I0811 23:40:30.440187  134361 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-770859
	
	I0811 23:40:30.440299  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:30.497914  134361 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:30.498349  134361 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32956 <nil> <nil>}
	I0811 23:40:30.498368  134361 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-770859' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-770859/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-770859' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0811 23:40:30.668446  134361 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0811 23:40:30.668512  134361 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0811 23:40:30.668550  134361 ubuntu.go:177] setting up certificates
	I0811 23:40:30.668584  134361 provision.go:83] configureAuth start
	I0811 23:40:30.668664  134361 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-770859
	I0811 23:40:30.706747  134361 provision.go:138] copyHostCerts
	I0811 23:40:30.706812  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0811 23:40:30.706829  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0811 23:40:30.706903  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0811 23:40:30.707000  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0811 23:40:30.707010  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0811 23:40:30.707088  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0811 23:40:30.707157  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0811 23:40:30.707168  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0811 23:40:30.707196  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0811 23:40:30.707261  134361 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-770859 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-770859]
	I0811 23:40:31.166864  134361 provision.go:172] copyRemoteCerts
	I0811 23:40:31.166956  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0811 23:40:31.167029  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.205543  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:31.302233  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0811 23:40:31.338670  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0811 23:40:31.377251  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0811 23:40:31.402937  134361 provision.go:86] duration metric: configureAuth took 734.325446ms
	I0811 23:40:31.402965  134361 ubuntu.go:193] setting minikube options for container-runtime
	I0811 23:40:31.403208  134361 config.go:182] Loaded profile config "missing-upgrade-770859": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0811 23:40:31.403221  134361 machine.go:91] provisioned docker machine in 1.17085364s
	I0811 23:40:31.403228  134361 client.go:171] LocalClient.Create took 10.319680668s
	I0811 23:40:31.403240  134361 start.go:167] duration metric: libmachine.API.Create for "missing-upgrade-770859" took 10.319726271s
	I0811 23:40:31.403251  134361 start.go:300] post-start starting for "missing-upgrade-770859" (driver="docker")
	I0811 23:40:31.403259  134361 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0811 23:40:31.403334  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0811 23:40:31.403394  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.430346  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:31.534265  134361 ssh_runner.go:195] Run: cat /etc/os-release
	I0811 23:40:31.539603  134361 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0811 23:40:31.539631  134361 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0811 23:40:31.539648  134361 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0811 23:40:31.539655  134361 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0811 23:40:31.539665  134361 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/addons for local assets ...
	I0811 23:40:31.539720  134361 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/files for local assets ...
	I0811 23:40:31.539804  134361 filesync.go:149] local asset: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem -> 76702.pem in /etc/ssl/certs
	I0811 23:40:31.539916  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0811 23:40:31.550676  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem --> /etc/ssl/certs/76702.pem (1708 bytes)
	I0811 23:40:31.577964  134361 start.go:303] post-start completed in 174.699371ms
	I0811 23:40:31.578396  134361 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-770859
	I0811 23:40:31.600075  134361 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/missing-upgrade-770859/config.json ...
	I0811 23:40:31.600352  134361 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:40:31.600404  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.632692  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:31.742519  134361 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0811 23:40:31.753523  134361 start.go:128] duration metric: createHost completed in 10.672702106s
	I0811 23:40:31.753619  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:31.785804  134361 fix.go:128] unexpected machine state, will restart: <nil>
	I0811 23:40:31.785833  134361 machine.go:88] provisioning docker machine ...
	I0811 23:40:31.785850  134361 ubuntu.go:169] provisioning hostname "missing-upgrade-770859"
	I0811 23:40:31.785908  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.816748  134361 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:31.817194  134361 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32956 <nil> <nil>}
	I0811 23:40:31.817213  134361 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-770859 && echo "missing-upgrade-770859" | sudo tee /etc/hostname
	I0811 23:40:31.965385  134361 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-770859
	
	I0811 23:40:31.965469  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.992577  134361 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:31.993015  134361 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32956 <nil> <nil>}
	I0811 23:40:31.993033  134361 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-770859' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-770859/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-770859' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0811 23:40:32.141935  134361 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0811 23:40:32.141980  134361 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0811 23:40:32.142012  134361 ubuntu.go:177] setting up certificates
	I0811 23:40:32.142031  134361 provision.go:83] configureAuth start
	I0811 23:40:32.142116  134361 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-770859
	I0811 23:40:32.173381  134361 provision.go:138] copyHostCerts
	I0811 23:40:32.173437  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0811 23:40:32.173446  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0811 23:40:32.173524  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0811 23:40:32.173615  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0811 23:40:32.173620  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0811 23:40:32.173646  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0811 23:40:32.173707  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0811 23:40:32.173711  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0811 23:40:32.173738  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0811 23:40:32.173791  134361 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-770859 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-770859]
	I0811 23:40:32.545647  134361 provision.go:172] copyRemoteCerts
	I0811 23:40:32.545755  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0811 23:40:32.545829  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:32.566870  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:32.667856  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0811 23:40:32.738836  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0811 23:40:32.794617  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0811 23:40:32.857872  134361 provision.go:86] duration metric: configureAuth took 715.804968ms
	I0811 23:40:32.857894  134361 ubuntu.go:193] setting minikube options for container-runtime
	I0811 23:40:32.858082  134361 config.go:182] Loaded profile config "missing-upgrade-770859": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0811 23:40:32.858106  134361 machine.go:91] provisioned docker machine in 1.072250262s
	I0811 23:40:32.858114  134361 start.go:300] post-start starting for "missing-upgrade-770859" (driver="docker")
	I0811 23:40:32.858124  134361 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0811 23:40:32.858172  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0811 23:40:32.858216  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:32.905771  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:33.019620  134361 ssh_runner.go:195] Run: cat /etc/os-release
	I0811 23:40:33.024807  134361 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0811 23:40:33.024832  134361 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0811 23:40:33.024844  134361 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0811 23:40:33.024851  134361 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0811 23:40:33.024861  134361 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/addons for local assets ...
	I0811 23:40:33.024926  134361 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/files for local assets ...
	I0811 23:40:33.025009  134361 filesync.go:149] local asset: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem -> 76702.pem in /etc/ssl/certs
	I0811 23:40:33.025120  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0811 23:40:33.041084  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem --> /etc/ssl/certs/76702.pem (1708 bytes)
	I0811 23:40:33.127699  134361 start.go:303] post-start completed in 269.568703ms
	I0811 23:40:33.127777  134361 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:40:33.127818  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:33.180987  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:33.315295  134361 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0811 23:40:33.326932  134361 fix.go:56] fixHost completed within 30.902438218s
	I0811 23:40:33.326955  134361 start.go:83] releasing machines lock for "missing-upgrade-770859", held for 30.90250431s
	I0811 23:40:33.327045  134361 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-770859
	I0811 23:40:33.379001  134361 ssh_runner.go:195] Run: cat /version.json
	I0811 23:40:33.379071  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:33.379293  134361 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0811 23:40:33.379348  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:33.436837  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:33.461090  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	W0811 23:40:33.572357  134361 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0811 23:40:33.572502  134361 ssh_runner.go:195] Run: systemctl --version
	I0811 23:40:33.768805  134361 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0811 23:40:33.776681  134361 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0811 23:40:33.871850  134361 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0811 23:40:33.871923  134361 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0811 23:40:33.933814  134361 cni.go:262] disabled [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0811 23:40:33.933837  134361 start.go:466] detecting cgroup driver to use...
	I0811 23:40:33.933866  134361 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0811 23:40:33.933916  134361 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0811 23:40:33.976726  134361 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0811 23:40:33.995313  134361 docker.go:196] disabling cri-docker service (if available) ...
	I0811 23:40:33.995400  134361 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0811 23:40:34.018240  134361 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0811 23:40:34.037594  134361 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	W0811 23:40:34.081146  134361 docker.go:206] Failed to disable socket "cri-docker.socket" (might be ok): sudo systemctl disable cri-docker.socket: Process exited with status 1
	stdout:
	
	stderr:
	Failed to disable unit: Unit file cri-docker.socket does not exist.
	I0811 23:40:34.081206  134361 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0811 23:40:34.668003  134361 docker.go:212] disabling docker service ...
	I0811 23:40:34.668072  134361 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0811 23:40:34.769616  134361 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0811 23:40:34.783838  134361 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0811 23:40:34.925673  134361 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0811 23:40:35.117181  134361 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0811 23:40:35.140868  134361 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0811 23:40:35.193274  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.4.1"|' /etc/containerd/config.toml"
	I0811 23:40:35.250322  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0811 23:40:35.274979  134361 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0811 23:40:35.275145  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0811 23:40:35.293123  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:40:35.319465  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0811 23:40:35.344757  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:40:35.367953  134361 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0811 23:40:35.393039  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0811 23:40:35.412415  134361 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0811 23:40:35.453737  134361 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0811 23:40:35.470162  134361 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0811 23:40:35.650647  134361 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0811 23:40:35.845726  134361 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0811 23:40:35.845790  134361 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0811 23:40:35.902201  134361 start.go:534] Will wait 60s for crictl version
	I0811 23:40:35.902273  134361 ssh_runner.go:195] Run: which crictl
	I0811 23:40:35.912246  134361 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:40:35.991581  134361 retry.go:31] will retry after 5.765131252s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:40:35Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0811 23:40:41.756935  134361 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:40:41.830527  134361 retry.go:31] will retry after 18.631378493s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:40:41Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0811 23:41:00.463047  134361 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:41:00.501198  134361 retry.go:31] will retry after 13.254687952s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:00Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0811 23:41:13.756122  134361 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:41:13.790030  134361 out.go:177] 
	W0811 23:41:13.791785  134361 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:13Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:13Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	W0811 23:41:13.791806  134361 out.go:239] * 
	* 
	W0811 23:41:13.792817  134361 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0811 23:41:13.794282  134361 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:343: failed missing container upgrade from v1.22.0. args: out/minikube-linux-arm64 start -p missing-upgrade-770859 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd : exit status 90
version_upgrade_test.go:345: *** TestMissingContainerUpgrade FAILED at 2023-08-11 23:41:13.864305823 +0000 UTC m=+2431.117060091
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestMissingContainerUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect missing-upgrade-770859
helpers_test.go:235: (dbg) docker inspect missing-upgrade-770859:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "ff0000810706eeadd605b88bacd2a106b7b9adf3e72df1c02e8bce2b8c3b6a72",
	        "Created": "2023-08-11T23:40:28.298937313Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 136319,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-08-11T23:40:28.767340567Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:ba5ae658d5b3f017bdb597cc46a1912d5eed54239e31b777788d204fdcbc4445",
	        "ResolvConfPath": "/var/lib/docker/containers/ff0000810706eeadd605b88bacd2a106b7b9adf3e72df1c02e8bce2b8c3b6a72/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/ff0000810706eeadd605b88bacd2a106b7b9adf3e72df1c02e8bce2b8c3b6a72/hostname",
	        "HostsPath": "/var/lib/docker/containers/ff0000810706eeadd605b88bacd2a106b7b9adf3e72df1c02e8bce2b8c3b6a72/hosts",
	        "LogPath": "/var/lib/docker/containers/ff0000810706eeadd605b88bacd2a106b7b9adf3e72df1c02e8bce2b8c3b6a72/ff0000810706eeadd605b88bacd2a106b7b9adf3e72df1c02e8bce2b8c3b6a72-json.log",
	        "Name": "/missing-upgrade-770859",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "missing-upgrade-770859:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "missing-upgrade-770859",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/23259d2ccc71ad84abc138bff883d0b8b92b0cd304409d9231ceac8850c9fca7-init/diff:/var/lib/docker/overlay2/0974092cc0cdb071ad14495c8cd220b0f16ef5c9096089a5f468db26666c413e/diff:/var/lib/docker/overlay2/1698a84b9e446e666b81e5ba15a772b69ac9e1ae3700f1171ff9c4796ced39da/diff:/var/lib/docker/overlay2/d1ec70be7f8e53ed1dbaf5100fb9d47dbdb2ca9eb27113cca1cd7c109a042d61/diff:/var/lib/docker/overlay2/eb50b3f8f337042431944235d0bda2511e9ec0fded11611a8651e540b5d933c9/diff:/var/lib/docker/overlay2/0f3ea0ed696389ebdf02e2098a59cb51b4b91983c4e4481d2a01767e7122fbb2/diff:/var/lib/docker/overlay2/9326a84ed41296bdcae602cf99b6983c30cef59ff047c2160b6872e1d98090d4/diff:/var/lib/docker/overlay2/71c29583b0f53df8c4b08d0bbc2e646051ba756babd35168dc0a13099835355a/diff:/var/lib/docker/overlay2/486d6d6a354b8569de383801a5b9533c78bc23571ed10422764797bfd2a5b033/diff:/var/lib/docker/overlay2/a87b485542a762da2421ce903c3aa2d70f535a089fbfb01129c3f2904f7d4328/diff:/var/lib/docker/overlay2/2cfc7a
cdcf15820e2790e8d27d8d771acbf02ca07b68d081d20bb868157c4ddd/diff:/var/lib/docker/overlay2/aad4d58edbb3a253f9aad64480474d2d72ab7c6eec3e0ce362bc4ff50e70e1db/diff:/var/lib/docker/overlay2/b6fa7989afd00b1126447fe9f92b960378c5216124429bccdf8ad102806db11c/diff:/var/lib/docker/overlay2/8fa92b48c7f0b6e86f72dd5adbe8b4bd38a6f34d54dca3c6103d1038fe9a940a/diff:/var/lib/docker/overlay2/21c47861787bbd212c69e6e2e1872277f7c812ecc63a2d9ad0aabdb0ff9b99a1/diff:/var/lib/docker/overlay2/814c8649e18c73bedcfbb567396f43e00ad7cc879699675289b0d5a1515cafde/diff:/var/lib/docker/overlay2/e8752f717c94f8acf091daffcf10f9526a842a731da0910b0baa6af1b0f4c109/diff:/var/lib/docker/overlay2/6f33f5c39c7eab3254f2e12a7fae78a9d3bc277826bd6de00187bf4f1f7c75b8/diff:/var/lib/docker/overlay2/75e489133cda675517d9ae3e558cb1d7fc81ba25a91a0c33979cc102321c6154/diff:/var/lib/docker/overlay2/f5153728da77a8437542a6e84d212da548ddc419560a90829b183edd5e703457/diff:/var/lib/docker/overlay2/7b46abab09c6022c4cfd6d9c0e06f984e5f3717832396e9a770770bbf964d2dc/diff:/var/lib/d
ocker/overlay2/b58d89edaaaf3dc31d38c5a57b3a171f35ba6b6a3096ebb8e0dc0d30d9dbadbb/diff:/var/lib/docker/overlay2/29641f16f94d118b031a2b4e886e4975f871982e945c0931adef7573458390a0/diff:/var/lib/docker/overlay2/f50ffa28faa6b7deb61b8e59488faf4c42133dab26e970ef047eb228088ddd8a/diff:/var/lib/docker/overlay2/71e65829e61da9f610255d112b152b60b68c856354a0932e154d4f2975409d7c/diff:/var/lib/docker/overlay2/48a697bc381a3206e0eaafa6ee96a9df2f17de73353a42931b314d256a34722c/diff:/var/lib/docker/overlay2/11c814db42fa668829ef8999c46b2ff12993199053547f66399f1f12ec72348c/diff:/var/lib/docker/overlay2/8f1e661f4ccc7dd47fd4ac4eabba00ee844b14d70de4a8c0bb2a8ab72d2a9c9c/diff:/var/lib/docker/overlay2/aa8a5dd7946e7f06748c963bd072c9c1156288c83940324acf84a5735b5b47bb/diff:/var/lib/docker/overlay2/8b387af1b63825a0b2481e19267f34e01a464f2d62d5b0162d2f6866579a6cc5/diff:/var/lib/docker/overlay2/de965530460c480d734181f3e55479b668ce816712bb9ae99ee72f76659653ea/diff:/var/lib/docker/overlay2/6ca0bb3123d8ec8dd53e79f0656f583971dc6c6e4ddbf75e9b3f7fa5f80
672fe/diff:/var/lib/docker/overlay2/3ac96a4719c03fea483eb96b2b3ebd92d2632180eca709344561cacbdadd8cac/diff:/var/lib/docker/overlay2/6079f990f15f5035bba73cd02b48483bbb0ab4f48db2b43c87173732fe754d55/diff:/var/lib/docker/overlay2/a128431492ca65feafd58776ed88596af528cd8c617d304c3d87393106498981/diff:/var/lib/docker/overlay2/a6e72513caa88b9207feea999e18ae6c4042e034c8833f6fd151fec604afd3d0/diff:/var/lib/docker/overlay2/31670483cf90b2c772fff21f8e910958032c2bda55808080147339b9ac2d3c55/diff",
	                "MergedDir": "/var/lib/docker/overlay2/23259d2ccc71ad84abc138bff883d0b8b92b0cd304409d9231ceac8850c9fca7/merged",
	                "UpperDir": "/var/lib/docker/overlay2/23259d2ccc71ad84abc138bff883d0b8b92b0cd304409d9231ceac8850c9fca7/diff",
	                "WorkDir": "/var/lib/docker/overlay2/23259d2ccc71ad84abc138bff883d0b8b92b0cd304409d9231ceac8850c9fca7/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "missing-upgrade-770859",
	                "Source": "/var/lib/docker/volumes/missing-upgrade-770859/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "missing-upgrade-770859",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "missing-upgrade-770859",
	                "name.minikube.sigs.k8s.io": "missing-upgrade-770859",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "7d6cc26f31f728762a0b83c6aead3314e18d92e610f03d3bf62c4408d05d280b",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32956"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32955"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32952"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32954"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32953"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/7d6cc26f31f7",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "missing-upgrade-770859": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "ff0000810706",
	                        "missing-upgrade-770859"
	                    ],
	                    "NetworkID": "257dcc1a9b18255d098ba34adf623dec4d49f34d866e02205882965fed1343b5",
	                    "EndpointID": "87ae80e6058711eecca6a7ffc8e6ea45b7d2a1a9aca5e78ac014ba337d84dfe8",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p missing-upgrade-770859 -n missing-upgrade-770859
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p missing-upgrade-770859 -n missing-upgrade-770859: exit status 2 (360.012014ms)

                                                
                                                
-- stdout --
	Running

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestMissingContainerUpgrade FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestMissingContainerUpgrade]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p missing-upgrade-770859 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p missing-upgrade-770859 logs -n 25: (1.427351425s)
helpers_test.go:252: TestMissingContainerUpgrade logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|-----------------------------------|-----------------------------|---------|---------|-------------------------------|-------------------------------|
	| Command |               Args                |           Profile           |  User   | Version |          Start Time           |           End Time            |
	|---------|-----------------------------------|-----------------------------|---------|---------|-------------------------------|-------------------------------|
	| stop    | -p scheduled-stop-611203          | scheduled-stop-611203       | jenkins | v1.31.1 | 11 Aug 23 23:36 UTC           |                               |
	|         | --schedule 15s                    |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-611203          | scheduled-stop-611203       | jenkins | v1.31.1 | 11 Aug 23 23:36 UTC           |                               |
	|         | --schedule 15s                    |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-611203          | scheduled-stop-611203       | jenkins | v1.31.1 | 11 Aug 23 23:36 UTC           |                               |
	|         | --schedule 15s                    |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-611203          | scheduled-stop-611203       | jenkins | v1.31.1 | 11 Aug 23 23:36 UTC           | 11 Aug 23 23:36 UTC           |
	|         | --cancel-scheduled                |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-611203          | scheduled-stop-611203       | jenkins | v1.31.1 | 11 Aug 23 23:36 UTC           |                               |
	|         | --schedule 15s                    |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-611203          | scheduled-stop-611203       | jenkins | v1.31.1 | 11 Aug 23 23:36 UTC           |                               |
	|         | --schedule 15s                    |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-611203          | scheduled-stop-611203       | jenkins | v1.31.1 | 11 Aug 23 23:36 UTC           | 11 Aug 23 23:37 UTC           |
	|         | --schedule 15s                    |                             |         |         |                               |                               |
	| delete  | -p scheduled-stop-611203          | scheduled-stop-611203       | jenkins | v1.31.1 | 11 Aug 23 23:37 UTC           | 11 Aug 23 23:37 UTC           |
	| start   | -p insufficient-storage-519017    | insufficient-storage-519017 | jenkins | v1.31.1 | 11 Aug 23 23:37 UTC           |                               |
	|         | --memory=2048 --output=json       |                             |         |         |                               |                               |
	|         | --wait=true --driver=docker       |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| delete  | -p insufficient-storage-519017    | insufficient-storage-519017 | jenkins | v1.31.1 | 11 Aug 23 23:37 UTC           | 11 Aug 23 23:37 UTC           |
	| start   | -p NoKubernetes-064892            | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:37 UTC           |                               |
	|         | --no-kubernetes                   |                             |         |         |                               |                               |
	|         | --kubernetes-version=1.20         |                             |         |         |                               |                               |
	|         | --driver=docker                   |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| start   | -p NoKubernetes-064892            | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:37 UTC           | 11 Aug 23 23:38 UTC           |
	|         | --driver=docker                   |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| start   | -p NoKubernetes-064892            | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:38 UTC           | 11 Aug 23 23:38 UTC           |
	|         | --no-kubernetes                   |                             |         |         |                               |                               |
	|         | --driver=docker                   |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| delete  | -p NoKubernetes-064892            | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:38 UTC           | 11 Aug 23 23:38 UTC           |
	| start   | -p NoKubernetes-064892            | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:38 UTC           | 11 Aug 23 23:39 UTC           |
	|         | --no-kubernetes                   |                             |         |         |                               |                               |
	|         | --driver=docker                   |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| ssh     | -p NoKubernetes-064892 sudo       | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:39 UTC           |                               |
	|         | systemctl is-active --quiet       |                             |         |         |                               |                               |
	|         | service kubelet                   |                             |         |         |                               |                               |
	| stop    | -p NoKubernetes-064892            | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:39 UTC           | 11 Aug 23 23:39 UTC           |
	| start   | -p NoKubernetes-064892            | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:39 UTC           | 11 Aug 23 23:39 UTC           |
	|         | --driver=docker                   |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| ssh     | -p NoKubernetes-064892 sudo       | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:39 UTC           |                               |
	|         | systemctl is-active --quiet       |                             |         |         |                               |                               |
	|         | service kubelet                   |                             |         |         |                               |                               |
	| delete  | -p NoKubernetes-064892            | NoKubernetes-064892         | jenkins | v1.31.1 | 11 Aug 23 23:39 UTC           | 11 Aug 23 23:39 UTC           |
	| start   | -p kubernetes-upgrade-851802      | kubernetes-upgrade-851802   | jenkins | v1.31.1 | 11 Aug 23 23:39 UTC           | 11 Aug 23 23:40 UTC           |
	|         | --memory=2200                     |                             |         |         |                               |                               |
	|         | --kubernetes-version=v1.16.0      |                             |         |         |                               |                               |
	|         | --alsologtostderr                 |                             |         |         |                               |                               |
	|         | -v=1 --driver=docker              |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| start   | -p missing-upgrade-770859         | missing-upgrade-770859      | jenkins | v1.22.0 | Fri, 11 Aug 2023 23:37:42 UTC | Fri, 11 Aug 2023 23:39:34 UTC |
	|         | --memory=2200 --driver=docker     |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| start   | -p missing-upgrade-770859         | missing-upgrade-770859      | jenkins | v1.31.1 | 11 Aug 23 23:39 UTC           |                               |
	|         | --memory=2200                     |                             |         |         |                               |                               |
	|         | --alsologtostderr                 |                             |         |         |                               |                               |
	|         | -v=1 --driver=docker              |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	| stop    | -p kubernetes-upgrade-851802      | kubernetes-upgrade-851802   | jenkins | v1.31.1 | 11 Aug 23 23:40 UTC           | 11 Aug 23 23:40 UTC           |
	| start   | -p kubernetes-upgrade-851802      | kubernetes-upgrade-851802   | jenkins | v1.31.1 | 11 Aug 23 23:40 UTC           |                               |
	|         | --memory=2200                     |                             |         |         |                               |                               |
	|         | --kubernetes-version=v1.28.0-rc.0 |                             |         |         |                               |                               |
	|         | --alsologtostderr                 |                             |         |         |                               |                               |
	|         | -v=1 --driver=docker              |                             |         |         |                               |                               |
	|         | --container-runtime=containerd    |                             |         |         |                               |                               |
	|---------|-----------------------------------|-----------------------------|---------|---------|-------------------------------|-------------------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/08/11 23:40:24
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0811 23:40:24.434594  135622 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:40:24.434821  135622 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:40:24.434844  135622 out.go:309] Setting ErrFile to fd 2...
	I0811 23:40:24.434863  135622 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:40:24.435208  135622 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:40:24.435630  135622 out.go:303] Setting JSON to false
	I0811 23:40:24.436663  135622 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":4971,"bootTime":1691792254,"procs":258,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:40:24.436776  135622 start.go:138] virtualization:  
	I0811 23:40:24.439743  135622 out.go:177] * [kubernetes-upgrade-851802] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:40:24.442620  135622 out.go:177]   - MINIKUBE_LOCATION=17044
	I0811 23:40:24.444969  135622 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:40:24.442790  135622 notify.go:220] Checking for updates...
	I0811 23:40:24.447283  135622 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:40:24.449758  135622 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:40:24.455150  135622 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0811 23:40:24.457077  135622 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0811 23:40:24.460491  135622 config.go:182] Loaded profile config "kubernetes-upgrade-851802": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0811 23:40:24.461344  135622 driver.go:373] Setting default libvirt URI to qemu:///system
	I0811 23:40:24.516915  135622 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:40:24.517045  135622 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:40:24.645490  135622 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:48 SystemTime:2023-08-11 23:40:24.633032425 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:40:24.645595  135622 docker.go:294] overlay module found
	I0811 23:40:24.648046  135622 out.go:177] * Using the docker driver based on existing profile
	I0811 23:40:24.650188  135622 start.go:298] selected driver: docker
	I0811 23:40:24.650206  135622 start.go:901] validating driver "docker" against &{Name:kubernetes-upgrade-851802 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-851802 Namespace:default APIS
erverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpti
mizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:40:24.650325  135622 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0811 23:40:24.650943  135622 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:40:24.763803  135622 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:48 SystemTime:2023-08-11 23:40:24.750583084 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:40:24.764137  135622 cni.go:84] Creating CNI manager for ""
	I0811 23:40:24.764155  135622 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:40:24.764166  135622 start_flags.go:319] config:
	{Name:kubernetes-upgrade-851802 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0-rc.0 ClusterName:kubernetes-upgrade-851802 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.lo
cal ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetCli
entPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:40:24.766361  135622 out.go:177] * Starting control plane node kubernetes-upgrade-851802 in cluster kubernetes-upgrade-851802
	I0811 23:40:24.768432  135622 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0811 23:40:24.770267  135622 out.go:177] * Pulling base image ...
	I0811 23:40:24.772039  135622 preload.go:132] Checking if preload exists for k8s version v1.28.0-rc.0 and runtime containerd
	I0811 23:40:24.772093  135622 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4
	I0811 23:40:24.772106  135622 cache.go:57] Caching tarball of preloaded images
	I0811 23:40:24.772108  135622 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon
	I0811 23:40:24.772210  135622 preload.go:174] Found /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0811 23:40:24.772221  135622 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.0-rc.0 on containerd
	I0811 23:40:24.772340  135622 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/config.json ...
	I0811 23:40:24.801856  135622 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon, skipping pull
	I0811 23:40:24.805159  135622 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 exists in daemon, skipping load
	I0811 23:40:24.805211  135622 cache.go:195] Successfully downloaded all kic artifacts
	I0811 23:40:24.805268  135622 start.go:365] acquiring machines lock for kubernetes-upgrade-851802: {Name:mkac1a4b941e248270f5a227629fdda048edbd05 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0811 23:40:24.805340  135622 start.go:369] acquired machines lock for "kubernetes-upgrade-851802" in 46.218µs
	I0811 23:40:24.805361  135622 start.go:96] Skipping create...Using existing machine configuration
	I0811 23:40:24.805367  135622 fix.go:54] fixHost starting: 
	I0811 23:40:24.805647  135622 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-851802 --format={{.State.Status}}
	I0811 23:40:24.836559  135622 fix.go:102] recreateIfNeeded on kubernetes-upgrade-851802: state=Stopped err=<nil>
	W0811 23:40:24.836595  135622 fix.go:128] unexpected machine state, will restart: <nil>
	I0811 23:40:24.838694  135622 out.go:177] * Restarting existing docker container for "kubernetes-upgrade-851802" ...
	I0811 23:40:21.270060  134361 cli_runner.go:164] Run: docker volume create missing-upgrade-770859 --label name.minikube.sigs.k8s.io=missing-upgrade-770859 --label created_by.minikube.sigs.k8s.io=true
	I0811 23:40:21.290789  134361 oci.go:103] Successfully created a docker volume missing-upgrade-770859
	I0811 23:40:21.290877  134361 cli_runner.go:164] Run: docker run --rm --name missing-upgrade-770859-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-770859 --entrypoint /usr/bin/test -v missing-upgrade-770859:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib
	I0811 23:40:22.655517  134361 cli_runner.go:217] Completed: docker run --rm --name missing-upgrade-770859-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-770859 --entrypoint /usr/bin/test -v missing-upgrade-770859:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib: (1.364600915s)
	I0811 23:40:22.655542  134361 oci.go:107] Successfully prepared a docker volume missing-upgrade-770859
	I0811 23:40:22.655573  134361 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0811 23:40:22.655593  134361 kic.go:190] Starting extracting preloaded images to volume ...
	I0811 23:40:22.655667  134361 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-770859:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir
	I0811 23:40:24.841117  135622 cli_runner.go:164] Run: docker start kubernetes-upgrade-851802
	I0811 23:40:25.244985  135622 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-851802 --format={{.State.Status}}
	I0811 23:40:25.277817  135622 kic.go:426] container "kubernetes-upgrade-851802" state is running.
	I0811 23:40:25.278214  135622 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-851802
	I0811 23:40:25.310787  135622 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/config.json ...
	I0811 23:40:25.311006  135622 machine.go:88] provisioning docker machine ...
	I0811 23:40:25.311101  135622 ubuntu.go:169] provisioning hostname "kubernetes-upgrade-851802"
	I0811 23:40:25.311150  135622 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-851802
	I0811 23:40:25.342684  135622 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:25.343206  135622 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32951 <nil> <nil>}
	I0811 23:40:25.343220  135622 main.go:141] libmachine: About to run SSH command:
	sudo hostname kubernetes-upgrade-851802 && echo "kubernetes-upgrade-851802" | sudo tee /etc/hostname
	I0811 23:40:25.345703  135622 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52060->127.0.0.1:32951: read: connection reset by peer
	I0811 23:40:28.545055  135622 main.go:141] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-851802
	
	I0811 23:40:28.545146  135622 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-851802
	I0811 23:40:28.573676  135622 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:28.574191  135622 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32951 <nil> <nil>}
	I0811 23:40:28.574237  135622 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\skubernetes-upgrade-851802' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-851802/g' /etc/hosts;
				else 
					echo '127.0.1.1 kubernetes-upgrade-851802' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0811 23:40:28.736281  135622 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0811 23:40:28.736332  135622 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0811 23:40:28.736352  135622 ubuntu.go:177] setting up certificates
	I0811 23:40:28.736361  135622 provision.go:83] configureAuth start
	I0811 23:40:28.736425  135622 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-851802
	I0811 23:40:28.771859  135622 provision.go:138] copyHostCerts
	I0811 23:40:28.771919  135622 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0811 23:40:28.771951  135622 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0811 23:40:28.772039  135622 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0811 23:40:28.772133  135622 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0811 23:40:28.772138  135622 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0811 23:40:28.772165  135622 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0811 23:40:28.772215  135622 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0811 23:40:28.772219  135622 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0811 23:40:28.772244  135622 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0811 23:40:28.772285  135622 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-851802 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube kubernetes-upgrade-851802]
	I0811 23:40:28.179669  134361 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-770859:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir: (5.523965575s)
	I0811 23:40:28.179697  134361 kic.go:199] duration metric: took 5.524101 seconds to extract preloaded images to volume
	W0811 23:40:28.179835  134361 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0811 23:40:28.179939  134361 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0811 23:40:28.274305  134361 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-770859 --name missing-upgrade-770859 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-770859 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-770859 --network missing-upgrade-770859 --ip 192.168.76.2 --volume missing-upgrade-770859:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79
	I0811 23:40:28.785837  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Running}}
	I0811 23:40:28.818898  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	I0811 23:40:28.863832  134361 cli_runner.go:164] Run: docker exec missing-upgrade-770859 stat /var/lib/dpkg/alternatives/iptables
	I0811 23:40:28.969079  134361 oci.go:144] the created container "missing-upgrade-770859" has a running status.
	I0811 23:40:28.969111  134361 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa...
	I0811 23:40:30.009333  134361 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0811 23:40:30.065008  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	I0811 23:40:30.092855  134361 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0811 23:40:30.092938  134361 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-770859 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0811 23:40:30.190398  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	I0811 23:40:30.232350  134361 machine.go:88] provisioning docker machine ...
	I0811 23:40:30.232381  134361 ubuntu.go:169] provisioning hostname "missing-upgrade-770859"
	I0811 23:40:30.232495  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:30.254035  134361 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:30.254514  134361 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32956 <nil> <nil>}
	I0811 23:40:30.254535  134361 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-770859 && echo "missing-upgrade-770859" | sudo tee /etc/hostname
	I0811 23:40:30.440187  134361 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-770859
	
	I0811 23:40:30.440299  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:30.497914  134361 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:30.498349  134361 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32956 <nil> <nil>}
	I0811 23:40:30.498368  134361 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-770859' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-770859/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-770859' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0811 23:40:30.668446  134361 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0811 23:40:30.668512  134361 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0811 23:40:30.668550  134361 ubuntu.go:177] setting up certificates
	I0811 23:40:30.668584  134361 provision.go:83] configureAuth start
	I0811 23:40:30.668664  134361 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-770859
	I0811 23:40:30.706747  134361 provision.go:138] copyHostCerts
	I0811 23:40:30.706812  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0811 23:40:30.706829  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0811 23:40:30.706903  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0811 23:40:30.707000  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0811 23:40:30.707010  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0811 23:40:30.707088  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0811 23:40:30.707157  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0811 23:40:30.707168  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0811 23:40:30.707196  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0811 23:40:30.707261  134361 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-770859 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-770859]
	I0811 23:40:31.166864  134361 provision.go:172] copyRemoteCerts
	I0811 23:40:31.166956  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0811 23:40:31.167029  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.205543  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:29.688190  135622 provision.go:172] copyRemoteCerts
	I0811 23:40:29.688305  135622 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0811 23:40:29.688385  135622 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-851802
	I0811 23:40:29.707769  135622 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32951 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/kubernetes-upgrade-851802/id_rsa Username:docker}
	I0811 23:40:29.850622  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0811 23:40:29.896238  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
	I0811 23:40:29.950334  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0811 23:40:29.998118  135622 provision.go:86] duration metric: configureAuth took 1.261740655s
	I0811 23:40:29.998146  135622 ubuntu.go:193] setting minikube options for container-runtime
	I0811 23:40:29.998324  135622 config.go:182] Loaded profile config "kubernetes-upgrade-851802": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.0-rc.0
	I0811 23:40:29.998337  135622 machine.go:91] provisioned docker machine in 4.687322756s
	I0811 23:40:29.998344  135622 start.go:300] post-start starting for "kubernetes-upgrade-851802" (driver="docker")
	I0811 23:40:29.998358  135622 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0811 23:40:29.998412  135622 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0811 23:40:29.998454  135622 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-851802
	I0811 23:40:30.029678  135622 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32951 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/kubernetes-upgrade-851802/id_rsa Username:docker}
	I0811 23:40:30.178698  135622 ssh_runner.go:195] Run: cat /etc/os-release
	I0811 23:40:30.188734  135622 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0811 23:40:30.188789  135622 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0811 23:40:30.188803  135622 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0811 23:40:30.188811  135622 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0811 23:40:30.188833  135622 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/addons for local assets ...
	I0811 23:40:30.188910  135622 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/files for local assets ...
	I0811 23:40:30.189005  135622 filesync.go:149] local asset: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem -> 76702.pem in /etc/ssl/certs
	I0811 23:40:30.189119  135622 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0811 23:40:30.205448  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem --> /etc/ssl/certs/76702.pem (1708 bytes)
	I0811 23:40:30.283401  135622 start.go:303] post-start completed in 285.038488ms
	I0811 23:40:30.283481  135622 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:40:30.283527  135622 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-851802
	I0811 23:40:30.318078  135622 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32951 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/kubernetes-upgrade-851802/id_rsa Username:docker}
	I0811 23:40:30.429543  135622 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0811 23:40:30.437707  135622 fix.go:56] fixHost completed within 5.632331581s
	I0811 23:40:30.437736  135622 start.go:83] releasing machines lock for "kubernetes-upgrade-851802", held for 5.632387153s
	I0811 23:40:30.437810  135622 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-851802
	I0811 23:40:30.466774  135622 ssh_runner.go:195] Run: cat /version.json
	I0811 23:40:30.466830  135622 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-851802
	I0811 23:40:30.467096  135622 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0811 23:40:30.467129  135622 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-851802
	I0811 23:40:30.515597  135622 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32951 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/kubernetes-upgrade-851802/id_rsa Username:docker}
	I0811 23:40:30.526865  135622 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32951 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/kubernetes-upgrade-851802/id_rsa Username:docker}
	I0811 23:40:30.812707  135622 ssh_runner.go:195] Run: systemctl --version
	I0811 23:40:30.821923  135622 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0811 23:40:30.832857  135622 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0811 23:40:30.868481  135622 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0811 23:40:30.868560  135622 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0811 23:40:30.892837  135622 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0811 23:40:30.892860  135622 start.go:466] detecting cgroup driver to use...
	I0811 23:40:30.892890  135622 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0811 23:40:30.892940  135622 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0811 23:40:30.929641  135622 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0811 23:40:30.946605  135622 docker.go:196] disabling cri-docker service (if available) ...
	I0811 23:40:30.946690  135622 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0811 23:40:30.962443  135622 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0811 23:40:30.976925  135622 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0811 23:40:31.131582  135622 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0811 23:40:31.261204  135622 docker.go:212] disabling docker service ...
	I0811 23:40:31.261271  135622 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0811 23:40:31.276368  135622 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0811 23:40:31.289982  135622 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0811 23:40:31.416564  135622 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0811 23:40:31.537657  135622 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0811 23:40:31.556566  135622 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0811 23:40:31.581017  135622 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0811 23:40:31.594863  135622 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0811 23:40:31.609032  135622 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0811 23:40:31.609098  135622 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0811 23:40:31.622869  135622 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:40:31.635477  135622 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0811 23:40:31.648753  135622 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:40:31.661705  135622 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0811 23:40:31.673838  135622 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0811 23:40:31.686701  135622 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0811 23:40:31.698577  135622 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0811 23:40:31.709084  135622 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0811 23:40:31.832060  135622 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0811 23:40:31.933646  135622 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0811 23:40:31.933730  135622 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0811 23:40:31.939183  135622 start.go:534] Will wait 60s for crictl version
	I0811 23:40:31.939254  135622 ssh_runner.go:195] Run: which crictl
	I0811 23:40:31.944244  135622 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:40:32.065140  135622 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.21
	RuntimeApiVersion:  v1
	I0811 23:40:32.065220  135622 ssh_runner.go:195] Run: containerd --version
	I0811 23:40:32.104742  135622 ssh_runner.go:195] Run: containerd --version
	I0811 23:40:32.138476  135622 out.go:177] * Preparing Kubernetes v1.28.0-rc.0 on containerd 1.6.21 ...
	I0811 23:40:32.141620  135622 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-851802 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0811 23:40:32.170571  135622 ssh_runner.go:195] Run: grep 192.168.67.1	host.minikube.internal$ /etc/hosts
	I0811 23:40:32.176692  135622 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0811 23:40:32.195608  135622 preload.go:132] Checking if preload exists for k8s version v1.28.0-rc.0 and runtime containerd
	I0811 23:40:32.195692  135622 ssh_runner.go:195] Run: sudo crictl images --output json
	I0811 23:40:32.262799  135622 containerd.go:600] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.0-rc.0". assuming images are not preloaded.
	I0811 23:40:32.262871  135622 ssh_runner.go:195] Run: which lz4
	I0811 23:40:32.268488  135622 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0811 23:40:32.274116  135622 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0811 23:40:32.274152  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (388397642 bytes)
	I0811 23:40:31.302233  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0811 23:40:31.338670  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0811 23:40:31.377251  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0811 23:40:31.402937  134361 provision.go:86] duration metric: configureAuth took 734.325446ms
	I0811 23:40:31.402965  134361 ubuntu.go:193] setting minikube options for container-runtime
	I0811 23:40:31.403208  134361 config.go:182] Loaded profile config "missing-upgrade-770859": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0811 23:40:31.403221  134361 machine.go:91] provisioned docker machine in 1.17085364s
	I0811 23:40:31.403228  134361 client.go:171] LocalClient.Create took 10.319680668s
	I0811 23:40:31.403240  134361 start.go:167] duration metric: libmachine.API.Create for "missing-upgrade-770859" took 10.319726271s
	I0811 23:40:31.403251  134361 start.go:300] post-start starting for "missing-upgrade-770859" (driver="docker")
	I0811 23:40:31.403259  134361 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0811 23:40:31.403334  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0811 23:40:31.403394  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.430346  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:31.534265  134361 ssh_runner.go:195] Run: cat /etc/os-release
	I0811 23:40:31.539603  134361 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0811 23:40:31.539631  134361 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0811 23:40:31.539648  134361 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0811 23:40:31.539655  134361 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0811 23:40:31.539665  134361 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/addons for local assets ...
	I0811 23:40:31.539720  134361 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/files for local assets ...
	I0811 23:40:31.539804  134361 filesync.go:149] local asset: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem -> 76702.pem in /etc/ssl/certs
	I0811 23:40:31.539916  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0811 23:40:31.550676  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem --> /etc/ssl/certs/76702.pem (1708 bytes)
	I0811 23:40:31.577964  134361 start.go:303] post-start completed in 174.699371ms
	I0811 23:40:31.578396  134361 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-770859
	I0811 23:40:31.600075  134361 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/missing-upgrade-770859/config.json ...
	I0811 23:40:31.600352  134361 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:40:31.600404  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.632692  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:31.742519  134361 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0811 23:40:31.753523  134361 start.go:128] duration metric: createHost completed in 10.672702106s
	I0811 23:40:31.753619  134361 cli_runner.go:164] Run: docker container inspect missing-upgrade-770859 --format={{.State.Status}}
	W0811 23:40:31.785804  134361 fix.go:128] unexpected machine state, will restart: <nil>
	I0811 23:40:31.785833  134361 machine.go:88] provisioning docker machine ...
	I0811 23:40:31.785850  134361 ubuntu.go:169] provisioning hostname "missing-upgrade-770859"
	I0811 23:40:31.785908  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.816748  134361 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:31.817194  134361 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32956 <nil> <nil>}
	I0811 23:40:31.817213  134361 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-770859 && echo "missing-upgrade-770859" | sudo tee /etc/hostname
	I0811 23:40:31.965385  134361 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-770859
	
	I0811 23:40:31.965469  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:31.992577  134361 main.go:141] libmachine: Using SSH client type: native
	I0811 23:40:31.993015  134361 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 32956 <nil> <nil>}
	I0811 23:40:31.993033  134361 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-770859' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-770859/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-770859' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0811 23:40:32.141935  134361 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0811 23:40:32.141980  134361 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0811 23:40:32.142012  134361 ubuntu.go:177] setting up certificates
	I0811 23:40:32.142031  134361 provision.go:83] configureAuth start
	I0811 23:40:32.142116  134361 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-770859
	I0811 23:40:32.173381  134361 provision.go:138] copyHostCerts
	I0811 23:40:32.173437  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0811 23:40:32.173446  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0811 23:40:32.173524  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0811 23:40:32.173615  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0811 23:40:32.173620  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0811 23:40:32.173646  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0811 23:40:32.173707  134361 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0811 23:40:32.173711  134361 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0811 23:40:32.173738  134361 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0811 23:40:32.173791  134361 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-770859 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-770859]
	I0811 23:40:32.545647  134361 provision.go:172] copyRemoteCerts
	I0811 23:40:32.545755  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0811 23:40:32.545829  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:32.566870  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:32.667856  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0811 23:40:32.738836  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0811 23:40:32.794617  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0811 23:40:32.857872  134361 provision.go:86] duration metric: configureAuth took 715.804968ms
	I0811 23:40:32.857894  134361 ubuntu.go:193] setting minikube options for container-runtime
	I0811 23:40:32.858082  134361 config.go:182] Loaded profile config "missing-upgrade-770859": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0811 23:40:32.858106  134361 machine.go:91] provisioned docker machine in 1.072250262s
	I0811 23:40:32.858114  134361 start.go:300] post-start starting for "missing-upgrade-770859" (driver="docker")
	I0811 23:40:32.858124  134361 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0811 23:40:32.858172  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0811 23:40:32.858216  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:32.905771  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:33.019620  134361 ssh_runner.go:195] Run: cat /etc/os-release
	I0811 23:40:33.024807  134361 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0811 23:40:33.024832  134361 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0811 23:40:33.024844  134361 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0811 23:40:33.024851  134361 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0811 23:40:33.024861  134361 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/addons for local assets ...
	I0811 23:40:33.024926  134361 filesync.go:126] Scanning /home/jenkins/minikube-integration/17044-2342/.minikube/files for local assets ...
	I0811 23:40:33.025009  134361 filesync.go:149] local asset: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem -> 76702.pem in /etc/ssl/certs
	I0811 23:40:33.025120  134361 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0811 23:40:33.041084  134361 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem --> /etc/ssl/certs/76702.pem (1708 bytes)
	I0811 23:40:33.127699  134361 start.go:303] post-start completed in 269.568703ms
	I0811 23:40:33.127777  134361 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:40:33.127818  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:33.180987  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:33.315295  134361 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0811 23:40:33.326932  134361 fix.go:56] fixHost completed within 30.902438218s
	I0811 23:40:33.326955  134361 start.go:83] releasing machines lock for "missing-upgrade-770859", held for 30.90250431s
	I0811 23:40:33.327045  134361 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-770859
	I0811 23:40:33.379001  134361 ssh_runner.go:195] Run: cat /version.json
	I0811 23:40:33.379071  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:33.379293  134361 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0811 23:40:33.379348  134361 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-770859
	I0811 23:40:33.436837  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	I0811 23:40:33.461090  134361 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32956 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/missing-upgrade-770859/id_rsa Username:docker}
	W0811 23:40:33.572357  134361 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0811 23:40:33.572502  134361 ssh_runner.go:195] Run: systemctl --version
	I0811 23:40:33.768805  134361 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0811 23:40:33.776681  134361 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0811 23:40:33.871850  134361 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0811 23:40:33.871923  134361 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0811 23:40:33.933814  134361 cni.go:262] disabled [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0811 23:40:33.933837  134361 start.go:466] detecting cgroup driver to use...
	I0811 23:40:33.933866  134361 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0811 23:40:33.933916  134361 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0811 23:40:33.976726  134361 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0811 23:40:33.995313  134361 docker.go:196] disabling cri-docker service (if available) ...
	I0811 23:40:33.995400  134361 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0811 23:40:34.018240  134361 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0811 23:40:34.037594  134361 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	W0811 23:40:34.081146  134361 docker.go:206] Failed to disable socket "cri-docker.socket" (might be ok): sudo systemctl disable cri-docker.socket: Process exited with status 1
	stdout:
	
	stderr:
	Failed to disable unit: Unit file cri-docker.socket does not exist.
	I0811 23:40:34.081206  134361 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0811 23:40:34.668003  134361 docker.go:212] disabling docker service ...
	I0811 23:40:34.668072  134361 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0811 23:40:34.769616  134361 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0811 23:40:34.783838  134361 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0811 23:40:34.925673  134361 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0811 23:40:35.117181  134361 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0811 23:40:35.140868  134361 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0811 23:40:35.193274  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.4.1"|' /etc/containerd/config.toml"
	I0811 23:40:35.250322  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0811 23:40:35.274979  134361 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0811 23:40:35.275145  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0811 23:40:35.293123  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:40:35.319465  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0811 23:40:35.344757  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0811 23:40:35.367953  134361 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0811 23:40:35.393039  134361 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0811 23:40:35.412415  134361 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0811 23:40:35.453737  134361 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0811 23:40:35.470162  134361 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0811 23:40:35.650647  134361 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0811 23:40:35.845726  134361 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0811 23:40:35.845790  134361 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0811 23:40:35.902201  134361 start.go:534] Will wait 60s for crictl version
	I0811 23:40:35.902273  134361 ssh_runner.go:195] Run: which crictl
	I0811 23:40:35.912246  134361 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:40:35.991581  134361 retry.go:31] will retry after 5.765131252s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:40:35Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0811 23:40:35.964200  135622 containerd.go:547] Took 3.695759 seconds to copy over tarball
	I0811 23:40:35.964266  135622 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0811 23:40:38.345617  135622 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.381325397s)
	I0811 23:40:38.345643  135622 containerd.go:554] Took 2.381421 seconds to extract the tarball
	I0811 23:40:38.345652  135622 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0811 23:40:38.405683  135622 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0811 23:40:38.510133  135622 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0811 23:40:38.629796  135622 ssh_runner.go:195] Run: sudo crictl images --output json
	I0811 23:40:38.817402  135622 containerd.go:604] all images are preloaded for containerd runtime.
	I0811 23:40:38.817423  135622 cache_images.go:84] Images are preloaded, skipping loading
	I0811 23:40:38.817494  135622 ssh_runner.go:195] Run: sudo crictl info
	I0811 23:40:38.859924  135622 cni.go:84] Creating CNI manager for ""
	I0811 23:40:38.859949  135622 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:40:38.859967  135622 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0811 23:40:38.859986  135622 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.28.0-rc.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-851802 NodeName:kubernetes-upgrade-851802 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.67.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/ce
rts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0811 23:40:38.860112  135622 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.67.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "kubernetes-upgrade-851802"
	  kubeletExtraArgs:
	    node-ip: 192.168.67.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.0-rc.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0811 23:40:38.860185  135622 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.0-rc.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=kubernetes-upgrade-851802 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.0-rc.0 ClusterName:kubernetes-upgrade-851802 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0811 23:40:38.860251  135622 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.0-rc.0
	I0811 23:40:38.871069  135622 binaries.go:44] Found k8s binaries, skipping transfer
	I0811 23:40:38.871191  135622 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0811 23:40:38.882760  135622 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (402 bytes)
	I0811 23:40:38.906086  135622 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
	I0811 23:40:38.927433  135622 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2119 bytes)
	I0811 23:40:38.948795  135622 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts
	I0811 23:40:38.955550  135622 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0811 23:40:38.970096  135622 certs.go:56] Setting up /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802 for IP: 192.168.67.2
	I0811 23:40:38.970168  135622 certs.go:190] acquiring lock for shared ca certs: {Name:mkb015b1abfb46823ddc64ddbe4b33bd353eab35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:40:38.970343  135622 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key
	I0811 23:40:38.970394  135622 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key
	I0811 23:40:38.970469  135622 certs.go:315] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/client.key
	I0811 23:40:38.970538  135622 certs.go:315] skipping minikube signed cert generation: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/apiserver.key.c7fa3a9e
	I0811 23:40:38.970587  135622 certs.go:315] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/proxy-client.key
	I0811 23:40:38.970702  135622 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/7670.pem (1338 bytes)
	W0811 23:40:38.970734  135622 certs.go:433] ignoring /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/7670_empty.pem, impossibly tiny 0 bytes
	I0811 23:40:38.970746  135622 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem (1675 bytes)
	I0811 23:40:38.970771  135622 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem (1078 bytes)
	I0811 23:40:38.970799  135622 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem (1123 bytes)
	I0811 23:40:38.970828  135622 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem (1675 bytes)
	I0811 23:40:38.970880  135622 certs.go:437] found cert: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem (1708 bytes)
	I0811 23:40:38.971523  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0811 23:40:38.999910  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0811 23:40:39.030716  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0811 23:40:39.060909  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0811 23:40:39.090809  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0811 23:40:39.121222  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0811 23:40:39.151897  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0811 23:40:39.182076  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0811 23:40:39.213531  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0811 23:40:39.242544  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/certs/7670.pem --> /usr/share/ca-certificates/7670.pem (1338 bytes)
	I0811 23:40:39.271967  135622 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/ssl/certs/76702.pem --> /usr/share/ca-certificates/76702.pem (1708 bytes)
	I0811 23:40:39.301355  135622 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0811 23:40:39.323669  135622 ssh_runner.go:195] Run: openssl version
	I0811 23:40:39.332943  135622 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0811 23:40:39.345196  135622 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:40:39.350153  135622 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Aug 11 23:02 /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:40:39.350221  135622 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0811 23:40:39.358964  135622 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0811 23:40:39.369833  135622 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7670.pem && ln -fs /usr/share/ca-certificates/7670.pem /etc/ssl/certs/7670.pem"
	I0811 23:40:39.381606  135622 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7670.pem
	I0811 23:40:39.386253  135622 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Aug 11 23:07 /usr/share/ca-certificates/7670.pem
	I0811 23:40:39.386315  135622 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7670.pem
	I0811 23:40:39.394773  135622 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7670.pem /etc/ssl/certs/51391683.0"
	I0811 23:40:39.405650  135622 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/76702.pem && ln -fs /usr/share/ca-certificates/76702.pem /etc/ssl/certs/76702.pem"
	I0811 23:40:39.417741  135622 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/76702.pem
	I0811 23:40:39.422440  135622 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Aug 11 23:07 /usr/share/ca-certificates/76702.pem
	I0811 23:40:39.422505  135622 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/76702.pem
	I0811 23:40:39.431188  135622 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/76702.pem /etc/ssl/certs/3ec20f2e.0"
	I0811 23:40:39.442958  135622 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0811 23:40:39.447739  135622 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0811 23:40:39.456711  135622 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0811 23:40:39.465934  135622 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0811 23:40:39.474656  135622 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0811 23:40:39.483470  135622 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0811 23:40:39.492029  135622 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0811 23:40:39.500555  135622 kubeadm.go:404] StartCluster: {Name:kubernetes-upgrade-851802 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0-rc.0 ClusterName:kubernetes-upgrade-851802 Namespace:default APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.28.0-rc.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:
false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:40:39.500678  135622 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0811 23:40:39.500760  135622 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0811 23:40:39.545311  135622 cri.go:89] found id: ""
	I0811 23:40:39.545377  135622 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0811 23:40:39.556545  135622 kubeadm.go:419] found existing configuration files, will attempt cluster restart
	I0811 23:40:39.556563  135622 kubeadm.go:636] restartCluster start
	I0811 23:40:39.556620  135622 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0811 23:40:39.568381  135622 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0811 23:40:39.569084  135622 kubeconfig.go:135] verify returned: extract IP: "kubernetes-upgrade-851802" does not appear in /home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:40:39.569395  135622 kubeconfig.go:146] "kubernetes-upgrade-851802" context is missing from /home/jenkins/minikube-integration/17044-2342/kubeconfig - will repair!
	I0811 23:40:39.569930  135622 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/kubeconfig: {Name:mka6624c250fdc5498ab30cb4943888e3cdba6af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:40:39.570789  135622 kapi.go:59] client config for kubernetes-upgrade-851802: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/client.crt", KeyFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kubernetes-upgrade-851802/client.key", CAFile:"/home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CA
Data:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16eb290), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0811 23:40:39.571894  135622 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0811 23:40:39.583863  135622 kubeadm.go:602] needs reconfigure: configs differ:
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml	2023-08-11 23:39:46.103350874 +0000
	+++ /var/tmp/minikube/kubeadm.yaml.new	2023-08-11 23:40:38.942263355 +0000
	@@ -1,4 +1,4 @@
	-apiVersion: kubeadm.k8s.io/v1beta1
	+apiVersion: kubeadm.k8s.io/v1beta3
	 kind: InitConfiguration
	 localAPIEndpoint:
	   advertiseAddress: 192.168.67.2
	@@ -11,13 +11,13 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /run/containerd/containerd.sock
	+  criSocket: unix:///run/containerd/containerd.sock
	   name: "kubernetes-upgrade-851802"
	   kubeletExtraArgs:
	     node-ip: 192.168.67.2
	   taints: []
	 ---
	-apiVersion: kubeadm.k8s.io/v1beta1
	+apiVersion: kubeadm.k8s.io/v1beta3
	 kind: ClusterConfiguration
	 apiServer:
	   certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	@@ -31,16 +31,14 @@
	   extraArgs:
	     leader-elect: "false"
	 certificatesDir: /var/lib/minikube/certs
	-clusterName: kubernetes-upgrade-851802
	+clusterName: mk
	 controlPlaneEndpoint: control-plane.minikube.internal:8443
	-dns:
	-  type: CoreDNS
	 etcd:
	   local:
	     dataDir: /var/lib/minikube/etcd
	     extraArgs:
	-      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
	-kubernetesVersion: v1.16.0
	+      proxy-refresh-interval: "70000"
	+kubernetesVersion: v1.28.0-rc.0
	 networking:
	   dnsDomain: cluster.local
	   podSubnet: "10.244.0.0/16"
	
	-- /stdout --
	I0811 23:40:39.583885  135622 kubeadm.go:1128] stopping kube-system containers ...
	I0811 23:40:39.583897  135622 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0811 23:40:39.583954  135622 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0811 23:40:39.627095  135622 cri.go:89] found id: ""
	I0811 23:40:39.627216  135622 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0811 23:40:39.642844  135622 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0811 23:40:39.654421  135622 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5707 Aug 11 23:39 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5743 Aug 11 23:39 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 5823 Aug 11 23:39 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5687 Aug 11 23:39 /etc/kubernetes/scheduler.conf
	
	I0811 23:40:39.654555  135622 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0811 23:40:39.665771  135622 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0811 23:40:39.677183  135622 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0811 23:40:39.689959  135622 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0811 23:40:39.703116  135622 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0811 23:40:39.714806  135622 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0811 23:40:39.714834  135622 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.0-rc.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0811 23:40:39.782293  135622 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.0-rc.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0811 23:40:42.076022  135622 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.0-rc.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (2.293687218s)
	I0811 23:40:42.076050  135622 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.0-rc.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0811 23:40:42.276474  135622 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.0-rc.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0811 23:40:42.360363  135622 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.0-rc.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0811 23:40:42.436515  135622 api_server.go:52] waiting for apiserver process to appear ...
	I0811 23:40:42.436609  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:42.457557  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:42.980871  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:43.480979  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:43.981123  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:41.756935  134361 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:40:41.830527  134361 retry.go:31] will retry after 18.631378493s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:40:41Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0811 23:40:44.481074  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:44.980345  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:45.481275  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:45.981132  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:46.481002  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:46.980944  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:47.480687  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:47.981137  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:48.480305  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:48.980357  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:49.480256  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:49.981109  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:50.480668  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:50.980357  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:51.481213  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:51.981162  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:52.480483  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:52.980950  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:53.480219  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:53.980365  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:54.480303  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:54.981258  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:55.480267  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:55.981053  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:56.480287  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:56.980972  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:57.480265  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:57.980753  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:58.480311  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:58.981140  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:00.463047  134361 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:41:00.501198  134361 retry.go:31] will retry after 13.254687952s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:00Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0811 23:40:59.481090  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:40:59.981267  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:00.480304  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:00.981252  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:01.480373  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:01.980852  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:02.481038  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:02.981245  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:03.481158  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:03.980315  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:04.481064  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:04.980286  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:05.480573  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:05.980537  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:06.480263  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:06.980675  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:07.480784  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:07.980232  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:08.480365  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:08.980291  135622 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:41:08.999517  135622 api_server.go:72] duration metric: took 26.563013133s to wait for apiserver process to appear ...
	I0811 23:41:08.999540  135622 api_server.go:88] waiting for apiserver healthz status ...
	I0811 23:41:08.999557  135622 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0811 23:41:13.756122  134361 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0811 23:41:13.790030  134361 out.go:177] 
	W0811 23:41:13.791785  134361 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:13Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	W0811 23:41:13.791806  134361 out.go:239] * 
	W0811 23:41:13.792817  134361 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0811 23:41:13.794282  134361 out.go:177] 
	
	* 
	* ==> container status <==
	* 
	* ==> containerd <==
	* -- Logs begin at Fri 2023-08-11 23:40:29 UTC, end at Fri 2023-08-11 23:41:15 UTC. --
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.828258372Z" level=info msg="loading plugin \"io.containerd.service.v1.leases-service\"..." type=io.containerd.service.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.828277432Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.828295015Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.828311836Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.828379633Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.828448957Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.829213799Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.829386915Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.833491586Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.833574169Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.837866199Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.837917965Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.837936368Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.837953098Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.837971042Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.837993992Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.838008999Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.838072718Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.838092279Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.838107598Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.838121013Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.838404346Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.838456120Z" level=info msg=serving... address=/run/containerd/containerd.sock
	Aug 11 23:40:35 missing-upgrade-770859 systemd[1]: Started containerd container runtime.
	Aug 11 23:40:35 missing-upgrade-770859 containerd[629]: time="2023-08-11T23:40:35.847486868Z" level=info msg="containerd successfully booted in 0.101889s"
	
	* 
	* ==> describe nodes <==
	* 
	* ==> dmesg <==
	* [  +0.000715] FS-Cache: N-cookie c=0000000c [p=00000003 fl=2 nc=0 na=1]
	[  +0.000949] FS-Cache: N-cookie d=000000002fd8c7ff{9p.inode} n=00000000699cacf4
	[  +0.001047] FS-Cache: N-key=[8] '9e385c0100000000'
	[  +0.003043] FS-Cache: Duplicate cookie detected
	[  +0.000729] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000978] FS-Cache: O-cookie d=000000002fd8c7ff{9p.inode} n=00000000db345718
	[  +0.001134] FS-Cache: O-key=[8] '9e385c0100000000'
	[  +0.000715] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
	[  +0.000972] FS-Cache: N-cookie d=000000002fd8c7ff{9p.inode} n=0000000043789e40
	[  +0.001075] FS-Cache: N-key=[8] '9e385c0100000000'
	[  +2.726009] FS-Cache: Duplicate cookie detected
	[  +0.000765] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000977] FS-Cache: O-cookie d=000000002fd8c7ff{9p.inode} n=000000005421d4ac
	[  +0.001109] FS-Cache: O-key=[8] '9d385c0100000000'
	[  +0.000721] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
	[  +0.000978] FS-Cache: N-cookie d=000000002fd8c7ff{9p.inode} n=0000000016d32580
	[  +0.001105] FS-Cache: N-key=[8] '9d385c0100000000'
	[  +0.435245] FS-Cache: Duplicate cookie detected
	[  +0.000737] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000949] FS-Cache: O-cookie d=000000002fd8c7ff{9p.inode} n=00000000eb575120
	[  +0.001036] FS-Cache: O-key=[8] 'a5385c0100000000'
	[  +0.000739] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
	[  +0.000924] FS-Cache: N-cookie d=000000002fd8c7ff{9p.inode} n=00000000f0e81b88
	[  +0.001050] FS-Cache: N-key=[8] 'a5385c0100000000'
	[Aug11 23:16] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
	
	* 
	* ==> kernel <==
	*  23:41:15 up  1:23,  0 users,  load average: 2.43, 2.27, 1.66
	Linux missing-upgrade-770859 5.15.0-1040-aws #45~20.04.1-Ubuntu SMP Tue Jul 11 19:11:12 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.2 LTS"
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Fri 2023-08-11 23:40:29 UTC, end at Fri 2023-08-11 23:41:15 UTC. --
	-- No entries --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	E0811 23:41:14.573552  138262 logs.go:281] Failed to list containers for "kube-apiserver": crictl list: sudo crictl ps -a --quiet --name=kube-apiserver: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0811 23:41:14.601964  138262 logs.go:281] Failed to list containers for "etcd": crictl list: sudo crictl ps -a --quiet --name=etcd: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0811 23:41:14.630833  138262 logs.go:281] Failed to list containers for "coredns": crictl list: sudo crictl ps -a --quiet --name=coredns: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0811 23:41:14.664690  138262 logs.go:281] Failed to list containers for "kube-scheduler": crictl list: sudo crictl ps -a --quiet --name=kube-scheduler: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0811 23:41:14.694665  138262 logs.go:281] Failed to list containers for "kube-proxy": crictl list: sudo crictl ps -a --quiet --name=kube-proxy: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0811 23:41:14.726357  138262 logs.go:281] Failed to list containers for "kube-controller-manager": crictl list: sudo crictl ps -a --quiet --name=kube-controller-manager: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0811 23:41:14.760088  138262 logs.go:281] Failed to list containers for "kindnet": crictl list: sudo crictl ps -a --quiet --name=kindnet: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0811 23:41:14.789450  138262 logs.go:281] Failed to list containers for "storage-provisioner": crictl list: sudo crictl ps -a --quiet --name=storage-provisioner: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0811 23:41:15.195003  138262 logs.go:195] command /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" failed with error: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": Process exited with status 1
	stdout:
	
	stderr:
	time="2023-08-11T23:41:14Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	 output: "\n** stderr ** \ntime=\"2023-08-11T23:41:14Z\" level=fatal msg=\"listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService\"\nCannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?\n\n** /stderr **"
	E0811 23:41:15.595578  138262 logs.go:195] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: "\n** stderr ** \nThe connection to the server localhost:8443 was refused - did you specify the right host or port?\n\n** /stderr **"
	! unable to fetch logs for: container status, describe nodes

                                                
                                                
** /stderr **
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p missing-upgrade-770859 -n missing-upgrade-770859
helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p missing-upgrade-770859 -n missing-upgrade-770859: exit status 2 (344.548355ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "missing-upgrade-770859" apiserver is not running, skipping kubectl commands (state="Stopped")
helpers_test.go:175: Cleaning up "missing-upgrade-770859" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-770859
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-770859: (2.329454516s)
--- FAIL: TestMissingContainerUpgrade (217.41s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (139.89s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-001161 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Non-zero exit: out/minikube-linux-arm64 stop -p embed-certs-001161 --alsologtostderr -v=3: exit status 82 (2m17.120508094s)

                                                
                                                
-- stdout --
	* Stopping node "embed-certs-001161"  ...
	* Powering off "embed-certs-001161" via SSH ...
	* Stopping node "embed-certs-001161"  ...
	* Powering off "embed-certs-001161" via SSH ...
	* Stopping node "embed-certs-001161"  ...
	* Powering off "embed-certs-001161" via SSH ...
	* Stopping node "embed-certs-001161"  ...
	* Powering off "embed-certs-001161" via SSH ...
	* Stopping node "embed-certs-001161"  ...
	* Powering off "embed-certs-001161" via SSH ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 00:00:10.202294  194417 out.go:296] Setting OutFile to fd 1 ...
	I0812 00:00:10.202551  194417 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0812 00:00:10.202580  194417 out.go:309] Setting ErrFile to fd 2...
	I0812 00:00:10.202601  194417 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0812 00:00:10.202878  194417 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0812 00:00:10.203344  194417 out.go:303] Setting JSON to false
	I0812 00:00:10.203531  194417 mustload.go:65] Loading cluster: embed-certs-001161
	I0812 00:00:10.203932  194417 config.go:182] Loaded profile config "embed-certs-001161": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0812 00:00:10.204049  194417 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/embed-certs-001161/config.json ...
	I0812 00:00:10.204261  194417 mustload.go:65] Loading cluster: embed-certs-001161
	I0812 00:00:10.204446  194417 config.go:182] Loaded profile config "embed-certs-001161": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0812 00:00:10.204525  194417 stop.go:39] StopHost: embed-certs-001161
	I0812 00:00:10.208961  194417 out.go:177] * Stopping node "embed-certs-001161"  ...
	I0812 00:00:10.211200  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:00:10.243850  194417 out.go:177] * Powering off "embed-certs-001161" via SSH ...
	I0812 00:00:10.245841  194417 cli_runner.go:164] Run: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0"
	I0812 00:00:11.390613  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:00:11.409254  194417 oci.go:661] temporary error: container embed-certs-001161 status is Running but expect it to be exited
	I0812 00:00:11.409305  194417 oci.go:667] Successfully shutdown container embed-certs-001161
	I0812 00:00:11.409326  194417 stop.go:88] shutdown container: err=<nil>
	I0812 00:00:11.409347  194417 main.go:141] libmachine: Stopping "embed-certs-001161"...
	I0812 00:00:11.409437  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:00:11.428711  194417 kic_runner.go:93] Run: systemctl --version
	I0812 00:00:11.428735  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 systemctl --version]
	I0812 00:00:11.507785  194417 kic_runner.go:93] Run: sudo systemctl stop kubelet
	I0812 00:00:11.508083  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop kubelet]
	W0812 00:00:11.635721  194417 kic.go:449] couldn't stop kubelet. will continue with stop anyways: sudo systemctl stop kubelet: exit status 1
	stdout:
	
	stderr:
	sudo: unable to resolve host embed-certs-001161: Temporary failure in name resolution
	Failed to connect to bus: No such file or directory
	I0812 00:00:11.635807  194417 kic_runner.go:93] Run: sudo systemctl stop -f kubelet
	I0812 00:00:11.635821  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop -f kubelet]
	W0812 00:00:11.725865  194417 kic.go:451] couldn't force stop kubelet. will continue with stop anyways: sudo systemctl stop -f kubelet: exit status 1
	stdout:
	
	stderr:
	sudo: unable to resolve host embed-certs-001161: Temporary failure in name resolution
	Failed to connect to bus: No such file or directory
	I0812 00:00:11.725901  194417 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}
	I0812 00:00:11.726000  194417 kic_runner.go:93] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
	I0812 00:00:11.726015  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo -s eval crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator]
	I0812 00:00:11.912706  194417 kic.go:462] unable list containers : crictl list: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator": exit status 1
	stdout:
	
	stderr:
	sudo: unable to resolve host embed-certs-001161: Temporary failure in name resolution
	time="2023-08-12T00:00:11Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	time="2023-08-12T00:00:11Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	time="2023-08-12T00:00:11Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	time="2023-08-12T00:00:11Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
	I0812 00:00:11.912736  194417 kic.go:472] successfully stopped kubernetes!
	I0812 00:00:11.912814  194417 kic_runner.go:93] Run: pgrep kube-apiserver
	I0812 00:00:11.912822  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 pgrep kube-apiserver]
	I0812 00:00:36.026294  194417 stop.go:59] stop err: stopping embed-certs-001161: exit status 1
	W0812 00:00:36.026330  194417 stop.go:163] stop host returned error: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:00:36.026353  194417 retry.go:31] will retry after 1.445814309s: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:00:37.472309  194417 stop.go:39] StopHost: embed-certs-001161
	I0812 00:00:37.474915  194417 out.go:177] * Stopping node "embed-certs-001161"  ...
	I0812 00:00:37.477030  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:00:37.497261  194417 out.go:177] * Powering off "embed-certs-001161" via SSH ...
	I0812 00:00:37.499081  194417 cli_runner.go:164] Run: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0"
	W0812 00:00:37.555795  194417 cli_runner.go:211] docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0" returned with exit code 126
	I0812 00:00:37.555841  194417 oci.go:647] error shutdown embed-certs-001161: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0": exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:00:38.556008  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:00:38.577163  194417 oci.go:661] temporary error: container embed-certs-001161 status is Running but expect it to be exited
	I0812 00:00:38.577187  194417 oci.go:667] Successfully shutdown container embed-certs-001161
	I0812 00:00:38.577193  194417 stop.go:88] shutdown container: err=<nil>
	I0812 00:00:38.577211  194417 main.go:141] libmachine: Stopping "embed-certs-001161"...
	I0812 00:00:38.577297  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:00:38.598227  194417 kic_runner.go:93] Run: sudo systemctl stop kubelet
	I0812 00:00:38.598246  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop kubelet]
	W0812 00:00:38.664075  194417 kic.go:449] couldn't stop kubelet. will continue with stop anyways: sudo systemctl stop kubelet: exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:00:38.664171  194417 kic_runner.go:93] Run: sudo systemctl stop -f kubelet
	I0812 00:00:38.664185  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop -f kubelet]
	W0812 00:00:38.728557  194417 kic.go:451] couldn't force stop kubelet. will continue with stop anyways: sudo systemctl stop -f kubelet: exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:00:38.728589  194417 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}
	I0812 00:00:38.728694  194417 kic_runner.go:93] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
	I0812 00:00:38.728710  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo -s eval crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator]
	I0812 00:00:38.785731  194417 kic.go:462] unable list containers : crictl list: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator": exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:00:38.785764  194417 kic.go:472] successfully stopped kubernetes!
	I0812 00:00:38.785850  194417 kic_runner.go:93] Run: pgrep kube-apiserver
	I0812 00:00:38.785863  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 pgrep kube-apiserver]
	I0812 00:01:02.885674  194417 stop.go:59] stop err: stopping embed-certs-001161: exit status 1
	W0812 00:01:02.885706  194417 stop.go:163] stop host returned error: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:01:02.885734  194417 retry.go:31] will retry after 1.264871453s: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:01:04.150899  194417 stop.go:39] StopHost: embed-certs-001161
	I0812 00:01:04.155516  194417 out.go:177] * Stopping node "embed-certs-001161"  ...
	I0812 00:01:04.158096  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:01:04.178898  194417 out.go:177] * Powering off "embed-certs-001161" via SSH ...
	I0812 00:01:04.180938  194417 cli_runner.go:164] Run: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0"
	W0812 00:01:04.225693  194417 cli_runner.go:211] docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0" returned with exit code 126
	I0812 00:01:04.225730  194417 oci.go:647] error shutdown embed-certs-001161: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0": exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:01:05.226915  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:01:05.249158  194417 oci.go:661] temporary error: container embed-certs-001161 status is Running but expect it to be exited
	I0812 00:01:05.249189  194417 oci.go:667] Successfully shutdown container embed-certs-001161
	I0812 00:01:05.249196  194417 stop.go:88] shutdown container: err=<nil>
	I0812 00:01:05.249239  194417 main.go:141] libmachine: Stopping "embed-certs-001161"...
	I0812 00:01:05.249398  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:01:05.272836  194417 kic_runner.go:93] Run: sudo systemctl stop kubelet
	I0812 00:01:05.272855  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop kubelet]
	W0812 00:01:05.323573  194417 kic.go:449] couldn't stop kubelet. will continue with stop anyways: sudo systemctl stop kubelet: exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:01:05.323671  194417 kic_runner.go:93] Run: sudo systemctl stop -f kubelet
	I0812 00:01:05.323684  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop -f kubelet]
	W0812 00:01:05.378103  194417 kic.go:451] couldn't force stop kubelet. will continue with stop anyways: sudo systemctl stop -f kubelet: exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:01:05.378134  194417 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}
	I0812 00:01:05.378216  194417 kic_runner.go:93] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
	I0812 00:01:05.378233  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo -s eval crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator]
	I0812 00:01:05.434109  194417 kic.go:462] unable list containers : crictl list: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator": exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:01:05.434132  194417 kic.go:472] successfully stopped kubernetes!
	I0812 00:01:05.434208  194417 kic_runner.go:93] Run: pgrep kube-apiserver
	I0812 00:01:05.434221  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 pgrep kube-apiserver]
	I0812 00:01:29.549670  194417 stop.go:59] stop err: stopping embed-certs-001161: exit status 1
	W0812 00:01:29.549719  194417 stop.go:163] stop host returned error: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:01:29.549736  194417 retry.go:31] will retry after 2.399472061s: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:01:31.950127  194417 stop.go:39] StopHost: embed-certs-001161
	I0812 00:01:31.952605  194417 out.go:177] * Stopping node "embed-certs-001161"  ...
	I0812 00:01:31.954948  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:01:31.981216  194417 out.go:177] * Powering off "embed-certs-001161" via SSH ...
	I0812 00:01:31.984194  194417 cli_runner.go:164] Run: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0"
	W0812 00:01:32.054184  194417 cli_runner.go:211] docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0" returned with exit code 126
	I0812 00:01:32.054223  194417 oci.go:647] error shutdown embed-certs-001161: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0": exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:01:33.054415  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:01:33.077588  194417 oci.go:661] temporary error: container embed-certs-001161 status is Running but expect it to be exited
	I0812 00:01:33.077631  194417 oci.go:667] Successfully shutdown container embed-certs-001161
	I0812 00:01:33.077638  194417 stop.go:88] shutdown container: err=<nil>
	I0812 00:01:33.077683  194417 main.go:141] libmachine: Stopping "embed-certs-001161"...
	I0812 00:01:33.077781  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:01:33.097672  194417 kic_runner.go:93] Run: sudo systemctl stop kubelet
	I0812 00:01:33.097694  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop kubelet]
	W0812 00:01:33.158461  194417 kic.go:449] couldn't stop kubelet. will continue with stop anyways: sudo systemctl stop kubelet: exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:01:33.158553  194417 kic_runner.go:93] Run: sudo systemctl stop -f kubelet
	I0812 00:01:33.158563  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop -f kubelet]
	W0812 00:01:33.225333  194417 kic.go:451] couldn't force stop kubelet. will continue with stop anyways: sudo systemctl stop -f kubelet: exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:01:33.225372  194417 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}
	I0812 00:01:33.225459  194417 kic_runner.go:93] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
	I0812 00:01:33.225468  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo -s eval crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator]
	I0812 00:01:33.285844  194417 kic.go:462] unable list containers : crictl list: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator": exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:01:33.285870  194417 kic.go:472] successfully stopped kubernetes!
	I0812 00:01:33.285939  194417 kic_runner.go:93] Run: pgrep kube-apiserver
	I0812 00:01:33.285946  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 pgrep kube-apiserver]
	I0812 00:01:57.403095  194417 stop.go:59] stop err: stopping embed-certs-001161: exit status 1
	W0812 00:01:57.403137  194417 stop.go:163] stop host returned error: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:01:57.403153  194417 retry.go:31] will retry after 3.964279106s: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:02:01.367964  194417 stop.go:39] StopHost: embed-certs-001161
	I0812 00:02:01.371057  194417 out.go:177] * Stopping node "embed-certs-001161"  ...
	I0812 00:02:01.373482  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:02:01.393553  194417 out.go:177] * Powering off "embed-certs-001161" via SSH ...
	I0812 00:02:01.395692  194417 cli_runner.go:164] Run: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0"
	W0812 00:02:01.456347  194417 cli_runner.go:211] docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0" returned with exit code 126
	I0812 00:02:01.456377  194417 oci.go:647] error shutdown embed-certs-001161: docker exec --privileged -t embed-certs-001161 /bin/bash -c "sudo init 0": exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:02:02.457024  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:02:02.487373  194417 oci.go:661] temporary error: container embed-certs-001161 status is Running but expect it to be exited
	I0812 00:02:02.487430  194417 oci.go:667] Successfully shutdown container embed-certs-001161
	I0812 00:02:02.487436  194417 stop.go:88] shutdown container: err=<nil>
	I0812 00:02:02.487456  194417 main.go:141] libmachine: Stopping "embed-certs-001161"...
	I0812 00:02:02.487530  194417 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:02:02.507725  194417 kic_runner.go:93] Run: sudo systemctl stop kubelet
	I0812 00:02:02.507755  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop kubelet]
	W0812 00:02:02.606247  194417 kic.go:449] couldn't stop kubelet. will continue with stop anyways: sudo systemctl stop kubelet: exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:02:02.606340  194417 kic_runner.go:93] Run: sudo systemctl stop -f kubelet
	I0812 00:02:02.606350  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo systemctl stop -f kubelet]
	W0812 00:02:02.683277  194417 kic.go:451] couldn't force stop kubelet. will continue with stop anyways: sudo systemctl stop -f kubelet: exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:02:02.683349  194417 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}
	I0812 00:02:02.683485  194417 kic_runner.go:93] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"
	I0812 00:02:02.683504  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 sudo -s eval crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator]
	I0812 00:02:02.753589  194417 kic.go:462] unable list containers : crictl list: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator": exit status 126
	stdout:
	OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown
	
	stderr:
	I0812 00:02:02.753619  194417 kic.go:472] successfully stopped kubernetes!
	I0812 00:02:02.753696  194417 kic_runner.go:93] Run: pgrep kube-apiserver
	I0812 00:02:02.753710  194417 kic_runner.go:114] Args: [docker exec --privileged embed-certs-001161 pgrep kube-apiserver]
	I0812 00:02:26.870541  194417 stop.go:59] stop err: stopping embed-certs-001161: exit status 1
	W0812 00:02:26.870575  194417 stop.go:163] stop host returned error: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	I0812 00:02:26.873415  194417 out.go:177] 
	W0812 00:02:26.875508  194417 out.go:239] X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: stopping embed-certs-001161: exit status 1
	W0812 00:02:26.875527  194417 out.go:239] * 
	* 
	W0812 00:02:27.256023  194417 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0812 00:02:27.258103  194417 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:230: failed stopping minikube - first stop-. args "out/minikube-linux-arm64 stop -p embed-certs-001161 --alsologtostderr -v=3" : exit status 82
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/Stop]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-001161
helpers_test.go:235: (dbg) docker inspect embed-certs-001161:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217",
	        "Created": "2023-08-11T23:59:05.272559204Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 191614,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-08-11T23:59:05.608172408Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:abe4482d178dd08cce0cdcb8e444349673c3edfa8e7d6462144a8d9173479eb6",
	        "ResolvConfPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hostname",
	        "HostsPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hosts",
	        "LogPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217-json.log",
	        "Name": "/embed-certs-001161",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "embed-certs-001161:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-001161",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a-init/diff:/var/lib/docker/overlay2/d97b84d3132f258dcb9c2a1a6f715ba5f60dbe710f2671cc920145c44f465eef/diff",
	                "MergedDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/merged",
	                "UpperDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/diff",
	                "WorkDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "embed-certs-001161",
	                "Source": "/var/lib/docker/volumes/embed-certs-001161/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-001161",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-001161",
	                "name.minikube.sigs.k8s.io": "embed-certs-001161",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "4b938b1f54c578ff1bc13abe4f7ea0d83ed2c71397ab6b54925a8a5f25d207c9",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33021"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33020"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33017"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33019"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33018"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/4b938b1f54c5",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-001161": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "b742c3a7ea28",
	                        "embed-certs-001161"
	                    ],
	                    "NetworkID": "1e9e37def88d7ba246e9a20625327417fbb737f8f4521ce6ea560e7e47592ac3",
	                    "EndpointID": "07b44759e9dc648ea620292d9b0532f931873a50ca8ef672ae8a4b46b3a7c349",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161
E0812 00:02:27.983134    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:02:27.988439    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:02:27.998712    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:02:28.018984    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:02:28.059348    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:02:28.139655    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:02:28.299979    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:02:28.620547    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:02:29.261554    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161: exit status 3 (2.7481434s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 00:02:30.027655  196245 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: ssh: handshake failed: EOF
	E0812 00:02:30.027674  196245 status.go:249] status error: NewSession: new client: new client: ssh: handshake failed: EOF

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "embed-certs-001161" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/embed-certs/serial/Stop (139.89s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (10.77s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161: exit status 3 (1.993952475s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 00:02:32.025265  196273 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: ssh: handshake failed: EOF
	E0812 00:02:32.025285  196273 status.go:249] status error: NewSession: new client: new client: ssh: handshake failed: EOF

                                                
                                                
** /stderr **
start_stop_delete_test.go:239: status error: exit status 3 (may be ok)
start_stop_delete_test.go:241: expected post-stop host status to be -"Stopped"- but got *"Error"*
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-001161 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
E0812 00:02:33.102733    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
start_stop_delete_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p embed-certs-001161 --images=MetricsScraper=registry.k8s.io/echoserver:1.4: exit status 11 (5.41122668s)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: crictl list: NewSession: new client: new client: ssh: handshake failed: EOF
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_addons_a2d68fa011bbbda55500e636dff79fec124b29e3_0.log                  │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
start_stop_delete_test.go:248: failed to enable an addon post-stop. args "out/minikube-linux-arm64 addons enable dashboard -p embed-certs-001161 --images=MetricsScraper=registry.k8s.io/echoserver:1.4": exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/EnableAddonAfterStop]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-001161
helpers_test.go:235: (dbg) docker inspect embed-certs-001161:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217",
	        "Created": "2023-08-11T23:59:05.272559204Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 191614,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-08-11T23:59:05.608172408Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:abe4482d178dd08cce0cdcb8e444349673c3edfa8e7d6462144a8d9173479eb6",
	        "ResolvConfPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hostname",
	        "HostsPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hosts",
	        "LogPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217-json.log",
	        "Name": "/embed-certs-001161",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "embed-certs-001161:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-001161",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a-init/diff:/var/lib/docker/overlay2/d97b84d3132f258dcb9c2a1a6f715ba5f60dbe710f2671cc920145c44f465eef/diff",
	                "MergedDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/merged",
	                "UpperDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/diff",
	                "WorkDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "embed-certs-001161",
	                "Source": "/var/lib/docker/volumes/embed-certs-001161/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-001161",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-001161",
	                "name.minikube.sigs.k8s.io": "embed-certs-001161",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "4b938b1f54c578ff1bc13abe4f7ea0d83ed2c71397ab6b54925a8a5f25d207c9",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33021"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33020"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33017"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33019"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33018"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/4b938b1f54c5",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-001161": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "b742c3a7ea28",
	                        "embed-certs-001161"
	                    ],
	                    "NetworkID": "1e9e37def88d7ba246e9a20625327417fbb737f8f4521ce6ea560e7e47592ac3",
	                    "EndpointID": "07b44759e9dc648ea620292d9b0532f931873a50ca8ef672ae8a4b46b3a7c349",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161: exit status 3 (3.341905582s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 00:02:40.798583  196733 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:58178->127.0.0.1:33021: read: connection reset by peer
	E0812 00:02:40.798603  196733 status.go:249] status error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:58178->127.0.0.1:33021: read: connection reset by peer

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "embed-certs-001161" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (10.77s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (977.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-001161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p embed-certs-001161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4: exit status 80 (16m13.84603961s)

                                                
                                                
-- stdout --
	* [embed-certs-001161] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17044
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	* Starting control plane node embed-certs-001161 in cluster embed-certs-001161
	* Pulling base image ...
	* Updating the running docker "embed-certs-001161" container ...
	* Updating the running docker "embed-certs-001161" container ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0812 00:02:40.879807  197285 out.go:296] Setting OutFile to fd 1 ...
	I0812 00:02:40.880009  197285 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0812 00:02:40.880015  197285 out.go:309] Setting ErrFile to fd 2...
	I0812 00:02:40.880021  197285 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0812 00:02:40.880272  197285 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0812 00:02:40.880661  197285 out.go:303] Setting JSON to false
	I0812 00:02:40.881698  197285 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":6307,"bootTime":1691792254,"procs":266,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0812 00:02:40.881776  197285 start.go:138] virtualization:  
	I0812 00:02:40.894880  197285 out.go:177] * [embed-certs-001161] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0812 00:02:40.897388  197285 out.go:177]   - MINIKUBE_LOCATION=17044
	I0812 00:02:40.897488  197285 notify.go:220] Checking for updates...
	I0812 00:02:40.900154  197285 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0812 00:02:40.902682  197285 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0812 00:02:40.905041  197285 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0812 00:02:40.907336  197285 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0812 00:02:40.909506  197285 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0812 00:02:40.912150  197285 config.go:182] Loaded profile config "embed-certs-001161": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0812 00:02:40.912669  197285 driver.go:373] Setting default libvirt URI to qemu:///system
	I0812 00:02:40.941596  197285 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0812 00:02:40.941694  197285 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 00:02:41.065030  197285 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:47 SystemTime:2023-08-12 00:02:41.04476428 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0812 00:02:41.065271  197285 docker.go:294] overlay module found
	I0812 00:02:41.073888  197285 out.go:177] * Using the docker driver based on existing profile
	I0812 00:02:41.077920  197285 start.go:298] selected driver: docker
	I0812 00:02:41.077944  197285 start.go:901] validating driver "docker" against &{Name:embed-certs-001161 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:embed-certs-001161 Namespace:default APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host M
ount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0812 00:02:41.078064  197285 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0812 00:02:41.078711  197285 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0812 00:02:41.189871  197285 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:true NGoroutines:47 SystemTime:2023-08-12 00:02:41.176838179 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0812 00:02:41.190204  197285 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0812 00:02:41.190228  197285 cni.go:84] Creating CNI manager for ""
	I0812 00:02:41.190236  197285 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0812 00:02:41.190244  197285 start_flags.go:319] config:
	{Name:embed-certs-001161 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:embed-certs-001161 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0812 00:02:41.202015  197285 out.go:177] * Starting control plane node embed-certs-001161 in cluster embed-certs-001161
	I0812 00:02:41.205589  197285 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0812 00:02:41.208751  197285 out.go:177] * Pulling base image ...
	I0812 00:02:41.212727  197285 preload.go:132] Checking if preload exists for k8s version v1.27.4 and runtime containerd
	I0812 00:02:41.212788  197285 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4
	I0812 00:02:41.212806  197285 cache.go:57] Caching tarball of preloaded images
	I0812 00:02:41.212880  197285 preload.go:174] Found /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0812 00:02:41.212895  197285 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.4 on containerd
	I0812 00:02:41.213020  197285 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/embed-certs-001161/config.json ...
	I0812 00:02:41.213226  197285 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon
	I0812 00:02:41.239933  197285 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon, skipping pull
	I0812 00:02:41.239954  197285 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 exists in daemon, skipping load
	I0812 00:02:41.239972  197285 cache.go:195] Successfully downloaded all kic artifacts
	I0812 00:02:41.240041  197285 start.go:365] acquiring machines lock for embed-certs-001161: {Name:mkd3777b7cae5c83c1c549ae87c5fba7cbe17621 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0812 00:02:41.240104  197285 start.go:369] acquired machines lock for "embed-certs-001161" in 41µs
	I0812 00:02:41.240140  197285 start.go:96] Skipping create...Using existing machine configuration
	I0812 00:02:41.240151  197285 fix.go:54] fixHost starting: 
	I0812 00:02:41.240411  197285 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:02:41.265483  197285 fix.go:102] recreateIfNeeded on embed-certs-001161: state=Running err=<nil>
	W0812 00:02:41.265510  197285 fix.go:128] unexpected machine state, will restart: <nil>
	I0812 00:02:41.271045  197285 out.go:177] * Updating the running docker "embed-certs-001161" container ...
	I0812 00:02:41.273858  197285 machine.go:88] provisioning docker machine ...
	I0812 00:02:41.273890  197285 ubuntu.go:169] provisioning hostname "embed-certs-001161"
	I0812 00:02:41.273967  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:02:41.294669  197285 main.go:141] libmachine: Using SSH client type: native
	I0812 00:02:41.295204  197285 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 33021 <nil> <nil>}
	I0812 00:02:41.295223  197285 main.go:141] libmachine: About to run SSH command:
	sudo hostname embed-certs-001161 && echo "embed-certs-001161" | sudo tee /etc/hostname
	I0812 00:02:41.297693  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:02:44.299570  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58208->127.0.0.1:33021: read: connection reset by peer
	I0812 00:02:47.301014  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:34036->127.0.0.1:33021: read: connection reset by peer
	I0812 00:02:50.303585  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:02:53.304231  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:02:56.304998  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35086->127.0.0.1:33021: read: connection reset by peer
	I0812 00:02:59.307556  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35102->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:02.308232  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:03:05.309666  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60400->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:08.311604  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60416->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:11.312854  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60430->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:14.313608  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60438->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:17.315322  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:42864->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:20.315949  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:42876->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:23.318102  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:03:26.319061  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:03:29.321692  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:03:32.322488  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44044->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:35.323112  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:03:38.323797  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60124->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:41.325012  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60140->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:44.327601  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60154->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:47.328260  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59704->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:50.330044  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:03:53.332194  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:03:56.332831  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55348->127.0.0.1:33021: read: connection reset by peer
	I0812 00:03:59.333464  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55364->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:02.334226  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55366->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:05.335624  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44988->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:08.338135  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:11.339207  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:14.341744  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45008->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:17.342659  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45570->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:20.343338  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:23.345465  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45590->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:26.346107  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45142->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:29.346800  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45148->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:32.347559  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:35.348276  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:48972->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:38.349008  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:41.349811  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:44.350971  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:47.352822  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:50.355421  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:04:53.358375  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53226->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:56.359496  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50712->127.0.0.1:33021: read: connection reset by peer
	I0812 00:04:59.361582  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50716->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:02.362234  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50724->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:05.363589  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:05:08.364445  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:05:11.366065  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:57814->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:14.367653  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:57820->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:17.368306  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51430->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:20.369082  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51436->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:23.371391  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51442->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:26.371995  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43074->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:29.374538  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43090->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:32.375201  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43104->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:35.375858  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:40666->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:38.378580  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:40668->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:41.378749  197285 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0812 00:05:41.378844  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:05:41.396509  197285 main.go:141] libmachine: Using SSH client type: native
	I0812 00:05:41.396953  197285 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 33021 <nil> <nil>}
	I0812 00:05:41.396976  197285 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-001161' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-001161/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-001161' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0812 00:05:41.397438  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:40674->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:44.399561  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:05:47.401167  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:05:50.401963  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60504->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:53.402699  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60516->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:56.403464  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46470->127.0.0.1:33021: read: connection reset by peer
	I0812 00:05:59.404120  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46474->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:02.404732  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46486->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:05.407466  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59632->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:08.409562  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59638->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:11.411085  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59640->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:14.412553  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59642->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:17.413172  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41750->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:20.415401  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41764->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:23.417668  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41780->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:26.418362  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59926->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:29.420988  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59928->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:32.421598  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59930->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:35.422255  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60942->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:38.422896  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60958->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:41.423844  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:06:44.424486  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60986->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:47.425472  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54898->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:50.427550  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:06:53.430261  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54910->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:56.431762  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:48156->127.0.0.1:33021: read: connection reset by peer
	I0812 00:06:59.432925  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:48166->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:02.434628  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:48182->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:05.435319  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46928->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:08.435919  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46942->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:11.436518  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46952->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:14.437147  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:07:17.437785  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35164->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:20.440058  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35172->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:23.440908  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35176->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:26.442213  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44434->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:29.443133  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:07:32.444937  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44444->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:35.447528  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:40754->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:38.448186  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:40764->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:41.449128  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:40776->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:44.450402  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:40786->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:47.451238  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:07:50.451852  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:57122->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:53.454535  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:57128->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:56.455967  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49946->127.0.0.1:33021: read: connection reset by peer
	I0812 00:07:59.458548  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49960->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:02.459207  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:08:05.461583  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46988->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:08.462731  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46996->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:11.464264  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:08:14.466809  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:47010->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:17.467552  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:08:20.469612  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:08:23.471613  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:34154->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:26.472301  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49802->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:29.474942  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49806->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:32.475739  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49818->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:35.476312  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41102->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:38.479058  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:41112->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:41.479514  197285 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0812 00:08:41.479544  197285 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0812 00:08:41.479578  197285 ubuntu.go:177] setting up certificates
	I0812 00:08:41.479598  197285 provision.go:83] configureAuth start
	I0812 00:08:41.479741  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:08:41.497329  197285 provision.go:138] copyHostCerts
	I0812 00:08:41.497399  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:08:41.497433  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:08:41.497514  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:08:41.497616  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:08:41.497624  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:08:41.497652  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:08:41.497709  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:08:41.497716  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:08:41.497744  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:08:41.497793  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:08:42.212081  197285 provision.go:172] copyRemoteCerts
	I0812 00:08:42.212156  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:08:42.212203  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:42.232343  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:42.233391  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:41122->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:42.233416  197285 retry.go:31] will retry after 252.191011ms: ssh: handshake failed: read tcp 127.0.0.1:41122->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:42.486261  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:42.486287  197285 retry.go:31] will retry after 445.91013ms: ssh: handshake failed: EOF
	W0812 00:08:42.933420  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:41132->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:42.933448  197285 retry.go:31] will retry after 769.756021ms: ssh: handshake failed: read tcp 127.0.0.1:41132->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:43.704668  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:43.704734  197285 retry.go:31] will retry after 128.199991ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:08:43.833078  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:43.850573  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:43.851458  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:43.851482  197285 retry.go:31] will retry after 305.264539ms: ssh: handshake failed: EOF
	W0812 00:08:44.158236  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:41176->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:44.158270  197285 retry.go:31] will retry after 412.473105ms: ssh: handshake failed: read tcp 127.0.0.1:41176->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:44.572063  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:44.572084  197285 retry.go:31] will retry after 749.297478ms: ssh: handshake failed: EOF
	W0812 00:08:45.322407  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48130->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:45.322487  197285 provision.go:86] duration metric: configureAuth took 3.842815734s
	W0812 00:08:45.322498  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:48130->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:45.322511  197285 retry.go:31] will retry after 98.341µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:48130->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:45.323608  197285 provision.go:83] configureAuth start
	I0812 00:08:45.323703  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:08:45.343581  197285 provision.go:138] copyHostCerts
	I0812 00:08:45.343649  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:08:45.343664  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:08:45.343771  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:08:45.343878  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:08:45.343890  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:08:45.343916  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:08:45.343981  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:08:45.343991  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:08:45.344016  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:08:45.344073  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:08:46.006762  197285 provision.go:172] copyRemoteCerts
	I0812 00:08:46.006836  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:08:46.006890  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:46.035310  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:46.036140  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48144->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:46.036162  197285 retry.go:31] will retry after 236.673369ms: ssh: handshake failed: read tcp 127.0.0.1:48144->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:46.274048  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:46.274076  197285 retry.go:31] will retry after 540.196053ms: ssh: handshake failed: EOF
	W0812 00:08:46.815721  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:46.815749  197285 retry.go:31] will retry after 696.369606ms: ssh: handshake failed: EOF
	W0812 00:08:47.512717  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:47.512788  197285 retry.go:31] will retry after 330.099654ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:08:47.843132  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:47.862637  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:47.863708  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48164->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:47.863731  197285 retry.go:31] will retry after 234.948675ms: ssh: handshake failed: read tcp 127.0.0.1:48164->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:48.099558  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48168->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:48.099593  197285 retry.go:31] will retry after 475.253129ms: ssh: handshake failed: read tcp 127.0.0.1:48168->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:48.575624  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48178->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:48.575651  197285 retry.go:31] will retry after 684.057613ms: ssh: handshake failed: read tcp 127.0.0.1:48178->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:49.260427  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:49.260503  197285 provision.go:86] duration metric: configureAuth took 3.936882598s
	W0812 00:08:49.260513  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:08:49.260523  197285 retry.go:31] will retry after 173.467µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:08:49.261625  197285 provision.go:83] configureAuth start
	I0812 00:08:49.261698  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:08:49.279202  197285 provision.go:138] copyHostCerts
	I0812 00:08:49.279269  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:08:49.279282  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:08:49.279346  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:08:49.279452  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:08:49.279461  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:08:49.279486  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:08:49.279544  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:08:49.279554  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:08:49.279579  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:08:49.279624  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:08:49.621536  197285 provision.go:172] copyRemoteCerts
	I0812 00:08:49.621604  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:08:49.621676  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:49.643271  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:49.644212  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:49.644233  197285 retry.go:31] will retry after 226.339266ms: ssh: handshake failed: EOF
	W0812 00:08:49.872077  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48222->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:49.872106  197285 retry.go:31] will retry after 387.749976ms: ssh: handshake failed: read tcp 127.0.0.1:48222->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:50.260923  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48228->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:50.260949  197285 retry.go:31] will retry after 283.333158ms: ssh: handshake failed: read tcp 127.0.0.1:48228->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:50.545641  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48242->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:50.545712  197285 retry.go:31] will retry after 306.67007ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:48242->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:50.853466  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:50.873959  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:50.874897  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:50.874917  197285 retry.go:31] will retry after 130.14484ms: ssh: handshake failed: EOF
	W0812 00:08:51.005970  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48274->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:51.005999  197285 retry.go:31] will retry after 437.705913ms: ssh: handshake failed: read tcp 127.0.0.1:48274->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:51.444679  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:51.444706  197285 retry.go:31] will retry after 576.381008ms: ssh: handshake failed: EOF
	W0812 00:08:52.021688  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:52.021780  197285 provision.go:86] duration metric: configureAuth took 2.760142453s
	W0812 00:08:52.021792  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:08:52.021802  197285 retry.go:31] will retry after 319.28µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:08:52.022866  197285 provision.go:83] configureAuth start
	I0812 00:08:52.022949  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:08:52.042194  197285 provision.go:138] copyHostCerts
	I0812 00:08:52.042261  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:08:52.042273  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:08:52.042335  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:08:52.042438  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:08:52.042447  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:08:52.042479  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:08:52.042543  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:08:52.042552  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:08:52.042576  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:08:52.042668  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:08:52.362133  197285 provision.go:172] copyRemoteCerts
	I0812 00:08:52.362207  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:08:52.362253  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:52.381856  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:52.382714  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48294->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:52.382731  197285 retry.go:31] will retry after 193.22287ms: ssh: handshake failed: read tcp 127.0.0.1:48294->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:52.576520  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:52.576555  197285 retry.go:31] will retry after 457.230346ms: ssh: handshake failed: EOF
	W0812 00:08:53.034597  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:53.034630  197285 retry.go:31] will retry after 568.409493ms: ssh: handshake failed: EOF
	W0812 00:08:53.603623  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48330->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:53.603649  197285 retry.go:31] will retry after 749.639828ms: ssh: handshake failed: read tcp 127.0.0.1:48330->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:54.353856  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:48334->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:54.353945  197285 provision.go:86] duration metric: configureAuth took 2.331048091s
	W0812 00:08:54.353958  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:48334->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:54.353969  197285 retry.go:31] will retry after 232.11µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:48334->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:54.355085  197285 provision.go:83] configureAuth start
	I0812 00:08:54.355176  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:08:54.373051  197285 provision.go:138] copyHostCerts
	I0812 00:08:54.373114  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:08:54.373127  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:08:54.373189  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:08:54.373288  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:08:54.373297  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:08:54.373322  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:08:54.373379  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:08:54.373389  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:08:54.373409  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:08:54.373456  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:08:54.940467  197285 provision.go:172] copyRemoteCerts
	I0812 00:08:54.940537  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:08:54.940598  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:54.958840  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:54.959764  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:54.959790  197285 retry.go:31] will retry after 207.75975ms: ssh: handshake failed: EOF
	W0812 00:08:55.168674  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46256->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:55.168703  197285 retry.go:31] will retry after 496.523027ms: ssh: handshake failed: read tcp 127.0.0.1:46256->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:55.665776  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46258->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:55.665802  197285 retry.go:31] will retry after 366.475652ms: ssh: handshake failed: read tcp 127.0.0.1:46258->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:56.033063  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46264->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:56.033093  197285 retry.go:31] will retry after 428.048875ms: ssh: handshake failed: read tcp 127.0.0.1:46264->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:56.461706  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46274->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:56.461777  197285 retry.go:31] will retry after 323.313513ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:46274->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:56.785266  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:56.806410  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:56.807441  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:08:56.807513  197285 retry.go:31] will retry after 132.147428ms: ssh: handshake failed: EOF
	W0812 00:08:56.940265  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46290->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:56.940294  197285 retry.go:31] will retry after 398.852604ms: ssh: handshake failed: read tcp 127.0.0.1:46290->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:57.340363  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46302->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:57.340390  197285 retry.go:31] will retry after 332.201228ms: ssh: handshake failed: read tcp 127.0.0.1:46302->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:57.673180  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46312->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:57.673209  197285 retry.go:31] will retry after 538.777326ms: ssh: handshake failed: read tcp 127.0.0.1:46312->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:58.213521  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46316->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:58.213604  197285 provision.go:86] duration metric: configureAuth took 3.858506429s
	W0812 00:08:58.213617  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:46316->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:58.213627  197285 retry.go:31] will retry after 497.52µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:46316->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:58.214728  197285 provision.go:83] configureAuth start
	I0812 00:08:58.214805  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:08:58.237331  197285 provision.go:138] copyHostCerts
	I0812 00:08:58.237399  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:08:58.237411  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:08:58.237474  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:08:58.237580  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:08:58.237590  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:08:58.237614  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:08:58.237676  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:08:58.237685  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:08:58.237710  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:08:58.237759  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:08:58.941369  197285 provision.go:172] copyRemoteCerts
	I0812 00:08:58.941443  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:08:58.941508  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:08:58.962571  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:08:58.963489  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46318->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:58.963517  197285 retry.go:31] will retry after 269.296174ms: ssh: handshake failed: read tcp 127.0.0.1:46318->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:59.233504  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46332->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:59.233529  197285 retry.go:31] will retry after 387.309789ms: ssh: handshake failed: read tcp 127.0.0.1:46332->127.0.0.1:33021: read: connection reset by peer
	W0812 00:08:59.621512  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46342->127.0.0.1:33021: read: connection reset by peer
	I0812 00:08:59.621539  197285 retry.go:31] will retry after 699.691465ms: ssh: handshake failed: read tcp 127.0.0.1:46342->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:00.321934  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46356->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:00.321961  197285 retry.go:31] will retry after 500.896377ms: ssh: handshake failed: read tcp 127.0.0.1:46356->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:00.824186  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46358->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:00.824262  197285 provision.go:86] duration metric: configureAuth took 2.609523721s
	W0812 00:09:00.824274  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:46358->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:00.824285  197285 retry.go:31] will retry after 637.627µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:46358->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:00.825356  197285 provision.go:83] configureAuth start
	I0812 00:09:00.825436  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:00.846343  197285 provision.go:138] copyHostCerts
	I0812 00:09:00.846413  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:00.846425  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:00.846490  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:00.846583  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:00.846593  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:00.846616  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:00.846671  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:00.846679  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:00.846702  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:00.846749  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:01.771767  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:01.771838  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:01.771880  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:01.795234  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:01.796110  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46362->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:01.796133  197285 retry.go:31] will retry after 327.554829ms: ssh: handshake failed: read tcp 127.0.0.1:46362->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:02.125166  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46370->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:02.125196  197285 retry.go:31] will retry after 492.703746ms: ssh: handshake failed: read tcp 127.0.0.1:46370->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:02.618921  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46378->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:02.618950  197285 retry.go:31] will retry after 671.081373ms: ssh: handshake failed: read tcp 127.0.0.1:46378->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:03.290702  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:03.290770  197285 retry.go:31] will retry after 366.607521ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:09:03.658366  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:03.681096  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:03.681988  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46402->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:03.682009  197285 retry.go:31] will retry after 190.556052ms: ssh: handshake failed: read tcp 127.0.0.1:46402->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:03.873692  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46408->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:03.873717  197285 retry.go:31] will retry after 325.66547ms: ssh: handshake failed: read tcp 127.0.0.1:46408->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:04.200466  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46416->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:04.200494  197285 retry.go:31] will retry after 439.530028ms: ssh: handshake failed: read tcp 127.0.0.1:46416->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:04.641568  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:46428->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:04.641593  197285 retry.go:31] will retry after 665.71128ms: ssh: handshake failed: read tcp 127.0.0.1:46428->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:05.308657  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36386->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:05.308734  197285 provision.go:86] duration metric: configureAuth took 4.483361272s
	W0812 00:09:05.308747  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36386->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:05.308758  197285 retry.go:31] will retry after 1.643766ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36386->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:05.310948  197285 provision.go:83] configureAuth start
	I0812 00:09:05.311084  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:05.329201  197285 provision.go:138] copyHostCerts
	I0812 00:09:05.329268  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:05.329280  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:05.329342  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:05.329437  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:05.329445  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:05.329520  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:05.329600  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:05.329612  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:05.329650  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:05.329702  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:05.696158  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:05.696258  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:05.696305  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:05.715703  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:05.716605  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36392->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:05.716629  197285 retry.go:31] will retry after 311.797362ms: ssh: handshake failed: read tcp 127.0.0.1:36392->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:06.029788  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36408->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:06.029814  197285 retry.go:31] will retry after 362.337081ms: ssh: handshake failed: read tcp 127.0.0.1:36408->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:06.392767  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36420->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:06.392795  197285 retry.go:31] will retry after 701.863638ms: ssh: handshake failed: read tcp 127.0.0.1:36420->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:07.095922  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36424->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:07.095988  197285 retry.go:31] will retry after 331.661421ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36424->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:07.428559  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:07.453414  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:07.454313  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36440->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:07.454332  197285 retry.go:31] will retry after 224.4128ms: ssh: handshake failed: read tcp 127.0.0.1:36440->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:07.680182  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:07.680209  197285 retry.go:31] will retry after 234.689602ms: ssh: handshake failed: EOF
	W0812 00:09:07.916021  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36456->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:07.916052  197285 retry.go:31] will retry after 489.865394ms: ssh: handshake failed: read tcp 127.0.0.1:36456->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:08.407428  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36460->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:08.407511  197285 provision.go:86] duration metric: configureAuth took 3.09654381s
	W0812 00:09:08.407518  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36460->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:08.407527  197285 retry.go:31] will retry after 1.930599ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36460->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:08.409708  197285 provision.go:83] configureAuth start
	I0812 00:09:08.409807  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:08.434873  197285 provision.go:138] copyHostCerts
	I0812 00:09:08.434943  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:08.434951  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:08.435046  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:08.435141  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:08.435154  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:08.435185  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:08.435271  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:08.435279  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:08.435302  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:08.435356  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:09.145014  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:09.145098  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:09.145146  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:09.164877  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:09.165768  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:09.165792  197285 retry.go:31] will retry after 266.666464ms: ssh: handshake failed: EOF
	W0812 00:09:09.433735  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:09.433774  197285 retry.go:31] will retry after 223.783994ms: ssh: handshake failed: EOF
	W0812 00:09:09.658612  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36500->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:09.658643  197285 retry.go:31] will retry after 521.87973ms: ssh: handshake failed: read tcp 127.0.0.1:36500->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:10.181920  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36514->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:10.181992  197285 retry.go:31] will retry after 165.45398ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36514->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:10.348413  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:10.369013  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:10.369880  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36518->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:10.369905  197285 retry.go:31] will retry after 182.313721ms: ssh: handshake failed: read tcp 127.0.0.1:36518->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:10.553680  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36526->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:10.553705  197285 retry.go:31] will retry after 327.885953ms: ssh: handshake failed: read tcp 127.0.0.1:36526->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:10.883068  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36534->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:10.883112  197285 retry.go:31] will retry after 338.995149ms: ssh: handshake failed: read tcp 127.0.0.1:36534->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:11.223222  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:11.223245  197285 retry.go:31] will retry after 1.016962894s: ssh: handshake failed: EOF
	W0812 00:09:12.241341  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36552->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:12.241421  197285 provision.go:86] duration metric: configureAuth took 3.831679071s
	W0812 00:09:12.241430  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36552->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:12.241440  197285 retry.go:31] will retry after 2.682908ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36552->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:12.244670  197285 provision.go:83] configureAuth start
	I0812 00:09:12.244765  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:12.263638  197285 provision.go:138] copyHostCerts
	I0812 00:09:12.263703  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:12.263714  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:12.263777  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:12.263868  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:12.263875  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:12.263897  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:12.263953  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:12.263964  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:12.263987  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:12.264033  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:12.823996  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:12.824063  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:12.824106  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:12.845088  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:12.845948  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:12.845986  197285 retry.go:31] will retry after 228.180167ms: ssh: handshake failed: EOF
	W0812 00:09:13.074823  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36574->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:13.074852  197285 retry.go:31] will retry after 385.767877ms: ssh: handshake failed: read tcp 127.0.0.1:36574->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:13.461890  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36578->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:13.461918  197285 retry.go:31] will retry after 780.771314ms: ssh: handshake failed: read tcp 127.0.0.1:36578->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:14.243360  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:14.243436  197285 retry.go:31] will retry after 365.99714ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:09:14.610031  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:14.628028  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:14.628983  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:14.629001  197285 retry.go:31] will retry after 291.232868ms: ssh: handshake failed: EOF
	W0812 00:09:14.920948  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36598->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:14.920973  197285 retry.go:31] will retry after 432.793012ms: ssh: handshake failed: read tcp 127.0.0.1:36598->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:15.355082  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54190->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:15.355108  197285 retry.go:31] will retry after 498.943452ms: ssh: handshake failed: read tcp 127.0.0.1:54190->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:15.855098  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54198->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:15.855174  197285 provision.go:86] duration metric: configureAuth took 3.610484538s
	W0812 00:09:15.855185  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54198->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:15.855195  197285 retry.go:31] will retry after 4.019503ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54198->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:15.859300  197285 provision.go:83] configureAuth start
	I0812 00:09:15.859385  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:15.877575  197285 provision.go:138] copyHostCerts
	I0812 00:09:15.877648  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:15.877657  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:15.877722  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:15.877817  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:15.877826  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:15.877850  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:15.877902  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:15.877912  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:15.877934  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:15.877977  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:16.219242  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:16.219308  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:16.219353  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:16.237729  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:16.238549  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54206->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:16.238588  197285 retry.go:31] will retry after 184.613881ms: ssh: handshake failed: read tcp 127.0.0.1:54206->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:16.424439  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:16.424467  197285 retry.go:31] will retry after 520.142362ms: ssh: handshake failed: EOF
	W0812 00:09:16.945218  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54220->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:16.945246  197285 retry.go:31] will retry after 574.548052ms: ssh: handshake failed: read tcp 127.0.0.1:54220->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:17.520372  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54236->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:17.520445  197285 retry.go:31] will retry after 297.913616ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54236->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:17.818934  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:17.836850  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:17.837718  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:17.837740  197285 retry.go:31] will retry after 161.858064ms: ssh: handshake failed: EOF
	W0812 00:09:18.009371  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54252->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:18.009413  197285 retry.go:31] will retry after 351.6038ms: ssh: handshake failed: read tcp 127.0.0.1:54252->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:18.362539  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54254->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:18.362566  197285 retry.go:31] will retry after 348.969825ms: ssh: handshake failed: read tcp 127.0.0.1:54254->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:18.712363  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54264->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:18.712390  197285 retry.go:31] will retry after 1.074546832s: ssh: handshake failed: read tcp 127.0.0.1:54264->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:19.787718  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54280->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:19.787794  197285 provision.go:86] duration metric: configureAuth took 3.928479209s
	W0812 00:09:19.787803  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54280->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:19.787813  197285 retry.go:31] will retry after 5.16785ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54280->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:19.794007  197285 provision.go:83] configureAuth start
	I0812 00:09:19.794105  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:19.811517  197285 provision.go:138] copyHostCerts
	I0812 00:09:19.811593  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:19.811605  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:19.811670  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:19.811765  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:19.811775  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:19.811800  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:19.811857  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:19.811866  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:19.811889  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:19.811936  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:20.453653  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:20.453722  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:20.453763  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:20.475208  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:20.476165  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54296->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:20.476190  197285 retry.go:31] will retry after 364.586261ms: ssh: handshake failed: read tcp 127.0.0.1:54296->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:20.841523  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54310->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:20.841559  197285 retry.go:31] will retry after 266.913244ms: ssh: handshake failed: read tcp 127.0.0.1:54310->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:21.109662  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54324->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:21.109687  197285 retry.go:31] will retry after 407.816541ms: ssh: handshake failed: read tcp 127.0.0.1:54324->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:21.518680  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54332->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:21.518708  197285 retry.go:31] will retry after 921.141741ms: ssh: handshake failed: read tcp 127.0.0.1:54332->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:22.440485  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54344->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:22.440563  197285 provision.go:86] duration metric: configureAuth took 2.646540372s
	W0812 00:09:22.440575  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54344->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:22.440591  197285 retry.go:31] will retry after 11.907141ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54344->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:22.452809  197285 provision.go:83] configureAuth start
	I0812 00:09:22.452899  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:22.471119  197285 provision.go:138] copyHostCerts
	I0812 00:09:22.471188  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:22.471200  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:22.471264  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:22.471354  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:22.471362  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:22.471383  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:22.471435  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:22.471445  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:22.471467  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:22.471510  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:22.816393  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:22.816461  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:22.816504  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:22.842011  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:22.842907  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54356->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:22.842931  197285 retry.go:31] will retry after 257.142479ms: ssh: handshake failed: read tcp 127.0.0.1:54356->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:23.101580  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54368->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:23.101606  197285 retry.go:31] will retry after 459.703722ms: ssh: handshake failed: read tcp 127.0.0.1:54368->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:23.562697  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54374->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:23.562725  197285 retry.go:31] will retry after 483.081149ms: ssh: handshake failed: read tcp 127.0.0.1:54374->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:24.046795  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:24.046823  197285 retry.go:31] will retry after 662.688699ms: ssh: handshake failed: EOF
	W0812 00:09:24.711051  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54396->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:24.711125  197285 provision.go:86] duration metric: configureAuth took 2.25829377s
	W0812 00:09:24.711132  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54396->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:24.711141  197285 retry.go:31] will retry after 18.067527ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54396->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:24.729279  197285 provision.go:83] configureAuth start
	I0812 00:09:24.729372  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:24.749079  197285 provision.go:138] copyHostCerts
	I0812 00:09:24.749150  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:24.749162  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:24.749225  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:24.749322  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:24.749332  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:24.749355  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:24.749409  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:24.749417  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:24.749440  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:24.749487  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:25.261057  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:25.261123  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:25.261162  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:25.283918  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:25.284826  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50204->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:25.284861  197285 retry.go:31] will retry after 285.506407ms: ssh: handshake failed: read tcp 127.0.0.1:50204->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:25.571733  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50206->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:25.571762  197285 retry.go:31] will retry after 512.905623ms: ssh: handshake failed: read tcp 127.0.0.1:50206->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:26.085967  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50216->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:26.085996  197285 retry.go:31] will retry after 592.078898ms: ssh: handshake failed: read tcp 127.0.0.1:50216->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:26.678721  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:26.678811  197285 retry.go:31] will retry after 366.923287ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:09:27.046466  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:27.066924  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:27.067871  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50246->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:27.067898  197285 retry.go:31] will retry after 314.209371ms: ssh: handshake failed: read tcp 127.0.0.1:50246->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:27.382661  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50254->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:27.382691  197285 retry.go:31] will retry after 426.320726ms: ssh: handshake failed: read tcp 127.0.0.1:50254->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:27.810369  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50258->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:27.810398  197285 retry.go:31] will retry after 570.488215ms: ssh: handshake failed: read tcp 127.0.0.1:50258->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:28.381619  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50274->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:28.381648  197285 retry.go:31] will retry after 486.650978ms: ssh: handshake failed: read tcp 127.0.0.1:50274->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:28.869804  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50288->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:28.869890  197285 provision.go:86] duration metric: configureAuth took 4.140585312s
	W0812 00:09:28.869900  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50288->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:28.869911  197285 retry.go:31] will retry after 17.462576ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50288->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:28.888138  197285 provision.go:83] configureAuth start
	I0812 00:09:28.888279  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:28.911307  197285 provision.go:138] copyHostCerts
	I0812 00:09:28.911376  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:28.911404  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:28.911465  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:28.911556  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:28.911561  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:28.911584  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:28.911635  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:28.911639  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:28.911665  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:28.911706  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:30.450815  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:30.450879  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:30.450920  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:30.469742  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:30.470618  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:30.470638  197285 retry.go:31] will retry after 257.277289ms: ssh: handshake failed: EOF
	W0812 00:09:30.728483  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:30.728517  197285 retry.go:31] will retry after 192.223582ms: ssh: handshake failed: EOF
	W0812 00:09:30.921834  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50312->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:30.921863  197285 retry.go:31] will retry after 560.230441ms: ssh: handshake failed: read tcp 127.0.0.1:50312->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:31.483076  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50316->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:31.483106  197285 retry.go:31] will retry after 758.937015ms: ssh: handshake failed: read tcp 127.0.0.1:50316->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:32.242754  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50318->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:32.242823  197285 retry.go:31] will retry after 188.16283ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50318->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:32.431157  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:32.449712  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:32.450618  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50320->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:32.450658  197285 retry.go:31] will retry after 335.541493ms: ssh: handshake failed: read tcp 127.0.0.1:50320->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:32.787463  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50332->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:32.787489  197285 retry.go:31] will retry after 465.435824ms: ssh: handshake failed: read tcp 127.0.0.1:50332->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:33.253549  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50348->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:33.253576  197285 retry.go:31] will retry after 456.175831ms: ssh: handshake failed: read tcp 127.0.0.1:50348->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:33.710273  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50364->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:33.710358  197285 provision.go:86] duration metric: configureAuth took 4.822193876s
	W0812 00:09:33.710365  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50364->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:33.710375  197285 retry.go:31] will retry after 14.818003ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50364->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:33.725562  197285 provision.go:83] configureAuth start
	I0812 00:09:33.725658  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:33.743896  197285 provision.go:138] copyHostCerts
	I0812 00:09:33.743963  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:33.743978  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:33.744044  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:33.744142  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:33.744150  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:33.744171  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:33.744258  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:33.744267  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:33.744293  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:33.744338  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:34.745178  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:34.745274  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:34.745330  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:34.763689  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:34.764634  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50370->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:34.764655  197285 retry.go:31] will retry after 173.479863ms: ssh: handshake failed: read tcp 127.0.0.1:50370->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:34.939534  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50380->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:34.939558  197285 retry.go:31] will retry after 373.340799ms: ssh: handshake failed: read tcp 127.0.0.1:50380->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:35.314215  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54046->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:35.314251  197285 retry.go:31] will retry after 740.611853ms: ssh: handshake failed: read tcp 127.0.0.1:54046->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:36.055764  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54054->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:36.055801  197285 retry.go:31] will retry after 584.041017ms: ssh: handshake failed: read tcp 127.0.0.1:54054->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:36.640492  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54070->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:36.640576  197285 provision.go:86] duration metric: configureAuth took 2.914989734s
	W0812 00:09:36.640589  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54070->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:36.640600  197285 retry.go:31] will retry after 44.036853ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54070->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:36.684754  197285 provision.go:83] configureAuth start
	I0812 00:09:36.684857  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:36.707329  197285 provision.go:138] copyHostCerts
	I0812 00:09:36.707396  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:36.707409  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:36.707473  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:36.707567  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:36.707578  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:36.707606  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:36.707663  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:36.707672  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:36.707693  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:36.707740  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:37.140965  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:37.141033  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:37.141082  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:37.160878  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:37.161808  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:37.161831  197285 retry.go:31] will retry after 246.784674ms: ssh: handshake failed: EOF
	W0812 00:09:37.409584  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54084->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:37.409614  197285 retry.go:31] will retry after 330.028906ms: ssh: handshake failed: read tcp 127.0.0.1:54084->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:37.740284  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54096->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:37.740312  197285 retry.go:31] will retry after 350.981718ms: ssh: handshake failed: read tcp 127.0.0.1:54096->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:38.092259  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54102->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:38.092288  197285 retry.go:31] will retry after 534.746999ms: ssh: handshake failed: read tcp 127.0.0.1:54102->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:38.628152  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54108->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:38.628226  197285 retry.go:31] will retry after 237.097891ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54108->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:38.865560  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:38.898584  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:38.899634  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:38.899654  197285 retry.go:31] will retry after 178.802834ms: ssh: handshake failed: EOF
	W0812 00:09:39.079465  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54124->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:39.079497  197285 retry.go:31] will retry after 187.604161ms: ssh: handshake failed: read tcp 127.0.0.1:54124->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:39.268377  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54130->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:39.268403  197285 retry.go:31] will retry after 715.719256ms: ssh: handshake failed: read tcp 127.0.0.1:54130->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:39.985690  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54138->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:39.985713  197285 retry.go:31] will retry after 835.568175ms: ssh: handshake failed: read tcp 127.0.0.1:54138->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:40.821864  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54150->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:40.821940  197285 provision.go:86] duration metric: configureAuth took 4.137152518s
	W0812 00:09:40.821946  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54150->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:40.821955  197285 retry.go:31] will retry after 65.046988ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54150->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:40.887426  197285 provision.go:83] configureAuth start
	I0812 00:09:40.887514  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:40.912095  197285 provision.go:138] copyHostCerts
	I0812 00:09:40.912155  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:40.912162  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:40.912236  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:40.912321  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:40.912327  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:40.912354  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:40.912402  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:40.912406  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:40.912431  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:40.912473  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:41.228044  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:41.228156  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:41.228213  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:41.247854  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:41.248783  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54166->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:41.248799  197285 retry.go:31] will retry after 301.305233ms: ssh: handshake failed: read tcp 127.0.0.1:54166->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:41.550790  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54182->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:41.550821  197285 retry.go:31] will retry after 299.986174ms: ssh: handshake failed: read tcp 127.0.0.1:54182->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:41.851918  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54194->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:41.851948  197285 retry.go:31] will retry after 725.210151ms: ssh: handshake failed: read tcp 127.0.0.1:54194->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:42.577921  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54200->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:42.577949  197285 retry.go:31] will retry after 516.747078ms: ssh: handshake failed: read tcp 127.0.0.1:54200->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:43.096118  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54208->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:43.096200  197285 provision.go:86] duration metric: configureAuth took 2.208752667s
	W0812 00:09:43.096211  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54208->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:43.096222  197285 retry.go:31] will retry after 127.817676ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54208->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:43.224493  197285 provision.go:83] configureAuth start
	I0812 00:09:43.224593  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:43.244741  197285 provision.go:138] copyHostCerts
	I0812 00:09:43.244813  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:43.244826  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:43.244886  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:43.244978  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:43.244988  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:43.245014  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:43.245098  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:43.245107  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:43.245141  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:43.245191  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:43.483489  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:43.483587  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:43.483648  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:43.503402  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:43.504314  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:43.504334  197285 retry.go:31] will retry after 317.191653ms: ssh: handshake failed: EOF
	W0812 00:09:43.822237  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54238->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:43.822267  197285 retry.go:31] will retry after 341.72169ms: ssh: handshake failed: read tcp 127.0.0.1:54238->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:44.165394  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54240->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:44.165417  197285 retry.go:31] will retry after 769.851029ms: ssh: handshake failed: read tcp 127.0.0.1:54240->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:44.936590  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:54254->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:44.936662  197285 retry.go:31] will retry after 194.742421ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54254->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:45.132121  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:45.157589  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:45.158694  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55396->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:45.158725  197285 retry.go:31] will retry after 298.275016ms: ssh: handshake failed: read tcp 127.0.0.1:55396->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:45.457567  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:45.457590  197285 retry.go:31] will retry after 505.203894ms: ssh: handshake failed: EOF
	W0812 00:09:45.963755  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55410->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:45.963779  197285 retry.go:31] will retry after 828.909657ms: ssh: handshake failed: read tcp 127.0.0.1:55410->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:46.794332  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55416->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:46.794415  197285 provision.go:86] duration metric: configureAuth took 3.56989328s
	W0812 00:09:46.794427  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55416->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:46.794439  197285 retry.go:31] will retry after 75.301246ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55416->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:46.870612  197285 provision.go:83] configureAuth start
	I0812 00:09:46.870716  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:46.896761  197285 provision.go:138] copyHostCerts
	I0812 00:09:46.896831  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:46.896844  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:46.896906  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:46.897007  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:46.897018  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:46.897044  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:46.897100  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:46.897109  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:46.897134  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:46.897213  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:48.070174  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:48.070288  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:48.070363  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:48.106492  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:48.107382  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:48.107398  197285 retry.go:31] will retry after 147.413305ms: ssh: handshake failed: EOF
	W0812 00:09:48.256108  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55442->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:48.256130  197285 retry.go:31] will retry after 377.77018ms: ssh: handshake failed: read tcp 127.0.0.1:55442->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:48.635199  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55454->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:48.635231  197285 retry.go:31] will retry after 674.110207ms: ssh: handshake failed: read tcp 127.0.0.1:55454->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:49.309882  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55470->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:49.309943  197285 retry.go:31] will retry after 135.937582ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55470->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:49.446287  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:49.478673  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:49.481809  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:49.481828  197285 retry.go:31] will retry after 288.121945ms: ssh: handshake failed: EOF
	W0812 00:09:49.770528  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55476->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:49.770550  197285 retry.go:31] will retry after 334.429839ms: ssh: handshake failed: read tcp 127.0.0.1:55476->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:50.106562  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55484->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:50.106592  197285 retry.go:31] will retry after 490.914583ms: ssh: handshake failed: read tcp 127.0.0.1:55484->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:50.598719  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55498->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:50.598793  197285 provision.go:86] duration metric: configureAuth took 3.728155317s
	W0812 00:09:50.598799  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55498->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:50.598809  197285 retry.go:31] will retry after 121.578379ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55498->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:50.721057  197285 provision.go:83] configureAuth start
	I0812 00:09:50.721154  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:50.749485  197285 provision.go:138] copyHostCerts
	I0812 00:09:50.749557  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:50.749565  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:50.749629  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:50.749724  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:50.749729  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:50.749753  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:50.749802  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:50.749806  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:50.749825  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:50.749866  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:51.593903  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:51.594009  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:51.594087  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:51.623178  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:51.624054  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55510->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:51.624078  197285 retry.go:31] will retry after 144.940987ms: ssh: handshake failed: read tcp 127.0.0.1:55510->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:51.769937  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55526->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:51.769965  197285 retry.go:31] will retry after 254.528032ms: ssh: handshake failed: read tcp 127.0.0.1:55526->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:52.025863  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55538->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:52.025892  197285 retry.go:31] will retry after 381.051199ms: ssh: handshake failed: read tcp 127.0.0.1:55538->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:52.408384  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55548->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:52.408412  197285 retry.go:31] will retry after 763.94977ms: ssh: handshake failed: read tcp 127.0.0.1:55548->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:53.173440  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55564->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:53.173511  197285 retry.go:31] will retry after 292.367583ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55564->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:53.467052  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:53.484943  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:53.485832  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55574->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:53.485856  197285 retry.go:31] will retry after 325.828323ms: ssh: handshake failed: read tcp 127.0.0.1:55574->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:53.812702  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55590->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:53.812729  197285 retry.go:31] will retry after 383.859202ms: ssh: handshake failed: read tcp 127.0.0.1:55590->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:54.197752  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55606->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:54.197783  197285 retry.go:31] will retry after 309.237439ms: ssh: handshake failed: read tcp 127.0.0.1:55606->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:54.507646  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55616->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:54.507716  197285 provision.go:86] duration metric: configureAuth took 3.786637131s
	W0812 00:09:54.507723  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55616->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:54.507733  197285 retry.go:31] will retry after 316.453801ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55616->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:54.825187  197285 provision.go:83] configureAuth start
	I0812 00:09:54.825297  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:54.852273  197285 provision.go:138] copyHostCerts
	I0812 00:09:54.852337  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:54.852345  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:54.852410  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:54.852503  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:54.852507  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:54.852530  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:54.852578  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:54.852582  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:54.852607  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:54.852649  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:55.620471  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:55.620561  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:55.620624  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:55.648736  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:55.649603  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:55.649621  197285 retry.go:31] will retry after 252.120627ms: ssh: handshake failed: EOF
	W0812 00:09:55.902393  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:55.902443  197285 retry.go:31] will retry after 353.255725ms: ssh: handshake failed: EOF
	W0812 00:09:56.256331  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:56.256357  197285 retry.go:31] will retry after 535.193318ms: ssh: handshake failed: EOF
	W0812 00:09:56.792125  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43204->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:56.792197  197285 retry.go:31] will retry after 305.372299ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:43204->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:57.098724  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:57.117648  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:57.118612  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:57.118649  197285 retry.go:31] will retry after 153.423148ms: ssh: handshake failed: EOF
	W0812 00:09:57.273451  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43212->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:57.273479  197285 retry.go:31] will retry after 456.762261ms: ssh: handshake failed: read tcp 127.0.0.1:43212->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:57.731792  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43220->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:57.731821  197285 retry.go:31] will retry after 379.236681ms: ssh: handshake failed: read tcp 127.0.0.1:43220->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:58.111704  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43228->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:58.111729  197285 retry.go:31] will retry after 931.598363ms: ssh: handshake failed: read tcp 127.0.0.1:43228->127.0.0.1:33021: read: connection reset by peer
	W0812 00:09:59.044616  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43242->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:59.044695  197285 provision.go:86] duration metric: configureAuth took 4.21948306s
	W0812 00:09:59.044702  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:43242->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:59.044711  197285 retry.go:31] will retry after 466.409633ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:43242->127.0.0.1:33021: read: connection reset by peer
	I0812 00:09:59.512180  197285 provision.go:83] configureAuth start
	I0812 00:09:59.512295  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:09:59.531290  197285 provision.go:138] copyHostCerts
	I0812 00:09:59.531355  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:09:59.531367  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:09:59.531438  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:09:59.531536  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:09:59.531547  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:09:59.531572  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:09:59.531628  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:09:59.531637  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:09:59.531658  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:09:59.531704  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:09:59.821562  197285 provision.go:172] copyRemoteCerts
	I0812 00:09:59.821631  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:09:59.821670  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:09:59.841616  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:09:59.842535  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:09:59.842559  197285 retry.go:31] will retry after 157.83575ms: ssh: handshake failed: EOF
	W0812 00:10:00.008360  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:00.008444  197285 retry.go:31] will retry after 440.408026ms: ssh: handshake failed: EOF
	W0812 00:10:00.449515  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43262->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:00.449539  197285 retry.go:31] will retry after 614.679088ms: ssh: handshake failed: read tcp 127.0.0.1:43262->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:01.065221  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:01.065323  197285 retry.go:31] will retry after 136.036433ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:01.201599  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:01.220761  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:01.221780  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:01.221802  197285 retry.go:31] will retry after 325.065169ms: ssh: handshake failed: EOF
	W0812 00:10:01.547712  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:01.547740  197285 retry.go:31] will retry after 477.684086ms: ssh: handshake failed: EOF
	W0812 00:10:02.026666  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43302->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:02.026702  197285 retry.go:31] will retry after 501.82456ms: ssh: handshake failed: read tcp 127.0.0.1:43302->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:02.529856  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:02.529883  197285 retry.go:31] will retry after 645.721067ms: ssh: handshake failed: EOF
	W0812 00:10:03.176744  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43320->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:03.176823  197285 provision.go:86] duration metric: configureAuth took 3.664616949s
	W0812 00:10:03.176834  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:43320->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:03.176844  197285 retry.go:31] will retry after 854.165715ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:43320->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:04.031167  197285 provision.go:83] configureAuth start
	I0812 00:10:04.031280  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:10:04.050507  197285 provision.go:138] copyHostCerts
	I0812 00:10:04.050576  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:10:04.050589  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:10:04.050652  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:10:04.050742  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:10:04.050752  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:10:04.050777  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:10:04.050861  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:10:04.050870  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:10:04.050891  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:10:04.050936  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:10:04.368366  197285 provision.go:172] copyRemoteCerts
	I0812 00:10:04.368430  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:10:04.368479  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:04.395113  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:04.395950  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:04.395973  197285 retry.go:31] will retry after 315.622775ms: ssh: handshake failed: EOF
	W0812 00:10:04.712915  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:43346->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:04.712943  197285 retry.go:31] will retry after 436.438878ms: ssh: handshake failed: read tcp 127.0.0.1:43346->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:05.150009  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33096->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:05.150036  197285 retry.go:31] will retry after 502.751062ms: ssh: handshake failed: read tcp 127.0.0.1:33096->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:05.654208  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33110->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:05.654273  197285 retry.go:31] will retry after 238.08054ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:33110->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:05.892725  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:05.912403  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:05.913302  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33124->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:05.913321  197285 retry.go:31] will retry after 309.129764ms: ssh: handshake failed: read tcp 127.0.0.1:33124->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:06.223213  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33140->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:06.223251  197285 retry.go:31] will retry after 532.681588ms: ssh: handshake failed: read tcp 127.0.0.1:33140->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:06.757449  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33144->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:06.757477  197285 retry.go:31] will retry after 834.456614ms: ssh: handshake failed: read tcp 127.0.0.1:33144->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:07.592524  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33146->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:07.592596  197285 provision.go:86] duration metric: configureAuth took 3.561404353s
	W0812 00:10:07.592603  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:33146->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:07.592613  197285 retry.go:31] will retry after 912.900734ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:33146->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:08.505797  197285 provision.go:83] configureAuth start
	I0812 00:10:08.505880  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:10:08.530862  197285 provision.go:138] copyHostCerts
	I0812 00:10:08.530932  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:10:08.530945  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:10:08.531007  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:10:08.531115  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:10:08.531126  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:10:08.531150  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:10:08.531211  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:10:08.531221  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:10:08.531251  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:10:08.531317  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:10:08.838795  197285 provision.go:172] copyRemoteCerts
	I0812 00:10:08.838864  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:10:08.838915  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:08.870571  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:08.871493  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:08.871525  197285 retry.go:31] will retry after 343.515016ms: ssh: handshake failed: EOF
	W0812 00:10:09.216444  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33172->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:09.216479  197285 retry.go:31] will retry after 357.703409ms: ssh: handshake failed: read tcp 127.0.0.1:33172->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:09.575312  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33184->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:09.575344  197285 retry.go:31] will retry after 739.48097ms: ssh: handshake failed: read tcp 127.0.0.1:33184->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:10.315565  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33198->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:10.315635  197285 retry.go:31] will retry after 364.147473ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:33198->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:10.679992  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:10.723716  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:10.724621  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33208->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:10.724646  197285 retry.go:31] will retry after 149.239046ms: ssh: handshake failed: read tcp 127.0.0.1:33208->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:10.874647  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:10.874670  197285 retry.go:31] will retry after 225.661655ms: ssh: handshake failed: EOF
	W0812 00:10:11.101463  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33226->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:11.101495  197285 retry.go:31] will retry after 455.68023ms: ssh: handshake failed: read tcp 127.0.0.1:33226->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:11.558085  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33242->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:11.558112  197285 retry.go:31] will retry after 677.45404ms: ssh: handshake failed: read tcp 127.0.0.1:33242->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:12.237034  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33246->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:12.237106  197285 provision.go:86] duration metric: configureAuth took 3.731284435s
	W0812 00:10:12.237113  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:33246->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:12.237122  197285 retry.go:31] will retry after 1.174059092s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:33246->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:13.411303  197285 provision.go:83] configureAuth start
	I0812 00:10:13.411418  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:10:13.434690  197285 provision.go:138] copyHostCerts
	I0812 00:10:13.434765  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:10:13.434777  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:10:13.434837  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:10:13.435058  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:10:13.435077  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:10:13.435109  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:10:13.435169  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:10:13.435177  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:10:13.435201  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:10:13.435275  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:10:13.791200  197285 provision.go:172] copyRemoteCerts
	I0812 00:10:13.791264  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:10:13.791307  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:13.819188  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:13.820046  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33248->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:13.820065  197285 retry.go:31] will retry after 163.652554ms: ssh: handshake failed: read tcp 127.0.0.1:33248->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:13.984712  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33262->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:13.984742  197285 retry.go:31] will retry after 303.78195ms: ssh: handshake failed: read tcp 127.0.0.1:33262->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:14.289584  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:33264->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:14.289613  197285 retry.go:31] will retry after 769.08263ms: ssh: handshake failed: read tcp 127.0.0.1:33264->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:15.059912  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:15.059989  197285 retry.go:31] will retry after 302.898189ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:15.363224  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:15.384594  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:15.385588  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:15.385607  197285 retry.go:31] will retry after 219.701336ms: ssh: handshake failed: EOF
	W0812 00:10:15.606370  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39110->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:15.606407  197285 retry.go:31] will retry after 473.205439ms: ssh: handshake failed: read tcp 127.0.0.1:39110->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:16.080326  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39124->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:16.080697  197285 retry.go:31] will retry after 795.363012ms: ssh: handshake failed: read tcp 127.0.0.1:39124->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:16.877296  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39140->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:16.877381  197285 provision.go:86] duration metric: configureAuth took 3.466055104s
	W0812 00:10:16.877389  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:39140->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:16.877399  197285 retry.go:31] will retry after 2.43851704s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:39140->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:19.317462  197285 provision.go:83] configureAuth start
	I0812 00:10:19.317564  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:10:19.341124  197285 provision.go:138] copyHostCerts
	I0812 00:10:19.341204  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:10:19.341216  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:10:19.341290  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:10:19.341392  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:10:19.341402  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:10:19.341431  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:10:19.341493  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:10:19.341503  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:10:19.341532  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:10:19.341822  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:10:19.994498  197285 provision.go:172] copyRemoteCerts
	I0812 00:10:19.994598  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:10:19.994651  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:20.019157  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:20.020061  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:20.020088  197285 retry.go:31] will retry after 249.770364ms: ssh: handshake failed: EOF
	W0812 00:10:20.270882  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:20.270908  197285 retry.go:31] will retry after 528.214419ms: ssh: handshake failed: EOF
	W0812 00:10:20.799863  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39160->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:20.799893  197285 retry.go:31] will retry after 398.187772ms: ssh: handshake failed: read tcp 127.0.0.1:39160->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:21.199331  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39168->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:21.199396  197285 retry.go:31] will retry after 371.192393ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:39168->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:21.570921  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:21.590073  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:21.591070  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:21.591092  197285 retry.go:31] will retry after 178.678132ms: ssh: handshake failed: EOF
	W0812 00:10:21.770966  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:21.770991  197285 retry.go:31] will retry after 529.842286ms: ssh: handshake failed: EOF
	W0812 00:10:22.302176  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39206->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:22.302204  197285 retry.go:31] will retry after 577.338497ms: ssh: handshake failed: read tcp 127.0.0.1:39206->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:22.880037  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39214->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:22.880064  197285 retry.go:31] will retry after 617.321955ms: ssh: handshake failed: read tcp 127.0.0.1:39214->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:23.498271  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:23.498349  197285 provision.go:86] duration metric: configureAuth took 4.180863031s
	W0812 00:10:23.498360  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:23.498369  197285 retry.go:31] will retry after 4.838861086s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:28.339090  197285 provision.go:83] configureAuth start
	I0812 00:10:28.339179  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:10:28.360500  197285 provision.go:138] copyHostCerts
	I0812 00:10:28.360563  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:10:28.360577  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:10:28.360664  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:10:28.360752  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:10:28.360762  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:10:28.360790  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:10:28.360875  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:10:28.360883  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:10:28.360912  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:10:28.360958  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:10:28.970978  197285 provision.go:172] copyRemoteCerts
	I0812 00:10:28.971131  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:10:28.971213  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:28.998666  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:28.999695  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:28.999724  197285 retry.go:31] will retry after 366.364184ms: ssh: handshake failed: EOF
	W0812 00:10:29.366648  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:29.366678  197285 retry.go:31] will retry after 337.55508ms: ssh: handshake failed: EOF
	W0812 00:10:29.705488  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36990->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:29.705509  197285 retry.go:31] will retry after 792.732095ms: ssh: handshake failed: read tcp 127.0.0.1:36990->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:30.498775  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:36998->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:30.498837  197285 retry.go:31] will retry after 149.451205ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:36998->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:30.649661  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:30.698217  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:30.703214  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:30.703244  197285 retry.go:31] will retry after 325.0897ms: ssh: handshake failed: EOF
	W0812 00:10:31.029848  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:37010->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:31.029878  197285 retry.go:31] will retry after 328.39741ms: ssh: handshake failed: read tcp 127.0.0.1:37010->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:31.359870  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:31.359897  197285 retry.go:31] will retry after 653.867306ms: ssh: handshake failed: EOF
	W0812 00:10:32.014561  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:32.014634  197285 provision.go:86] duration metric: configureAuth took 3.675521228s
	W0812 00:10:32.014640  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:32.014650  197285 retry.go:31] will retry after 7.328838207s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:39.343624  197285 provision.go:83] configureAuth start
	I0812 00:10:39.343718  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:10:39.363211  197285 provision.go:138] copyHostCerts
	I0812 00:10:39.363281  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:10:39.363295  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:10:39.363369  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:10:39.363498  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:10:39.363510  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:10:39.363553  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:10:39.363614  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:10:39.363619  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:10:39.363647  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:10:39.363692  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:10:39.814109  197285 provision.go:172] copyRemoteCerts
	I0812 00:10:39.814201  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:10:39.814260  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:39.834188  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:39.835152  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:39.835173  197285 retry.go:31] will retry after 225.810854ms: ssh: handshake failed: EOF
	W0812 00:10:40.062047  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:40.062078  197285 retry.go:31] will retry after 217.056165ms: ssh: handshake failed: EOF
	W0812 00:10:40.279757  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:40.279787  197285 retry.go:31] will retry after 658.481385ms: ssh: handshake failed: EOF
	W0812 00:10:40.939100  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39474->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:40.939128  197285 retry.go:31] will retry after 506.069705ms: ssh: handshake failed: read tcp 127.0.0.1:39474->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:41.446228  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39476->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:41.446296  197285 retry.go:31] will retry after 225.080729ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:39476->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:41.671530  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:41.702844  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:41.703798  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:41.703818  197285 retry.go:31] will retry after 199.786716ms: ssh: handshake failed: EOF
	W0812 00:10:41.904579  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39498->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:41.904603  197285 retry.go:31] will retry after 474.412994ms: ssh: handshake failed: read tcp 127.0.0.1:39498->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:42.379631  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:42.379655  197285 retry.go:31] will retry after 635.862521ms: ssh: handshake failed: EOF
	W0812 00:10:43.016979  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:43.017059  197285 provision.go:86] duration metric: configureAuth took 3.673409201s
	W0812 00:10:43.017070  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:43.017081  197285 ubuntu.go:189] Error configuring auth during provisioning Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:43.017089  197285 machine.go:91] provisioned docker machine in 8m1.743214019s
	I0812 00:10:43.017159  197285 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 00:10:43.017211  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:43.035742  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:43.036632  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:43.036654  197285 retry.go:31] will retry after 167.961647ms: ssh: handshake failed: EOF
	W0812 00:10:43.205523  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39548->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:43.205567  197285 retry.go:31] will retry after 306.425998ms: ssh: handshake failed: read tcp 127.0.0.1:39548->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:43.513589  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39562->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:43.513615  197285 retry.go:31] will retry after 591.551036ms: ssh: handshake failed: read tcp 127.0.0.1:39562->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:44.105792  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39572->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:44.105818  197285 retry.go:31] will retry after 725.929787ms: ssh: handshake failed: read tcp 127.0.0.1:39572->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:44.833382  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:39580->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:44.833453  197285 retry.go:31] will retry after 146.577355ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:39580->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:44.980899  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:45.017641  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:45.024017  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:38338->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:45.024044  197285 retry.go:31] will retry after 331.11583ms: ssh: handshake failed: read tcp 127.0.0.1:38338->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:45.355729  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:38354->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:45.355757  197285 retry.go:31] will retry after 232.344333ms: ssh: handshake failed: read tcp 127.0.0.1:38354->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:45.589701  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:45.589725  197285 retry.go:31] will retry after 354.082747ms: ssh: handshake failed: EOF
	W0812 00:10:45.944920  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:45.944943  197285 retry.go:31] will retry after 874.952559ms: ssh: handshake failed: EOF
	W0812 00:10:46.820723  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	W0812 00:10:46.820801  197285 start.go:275] error running df -h /var: NewSession: new client: new client: ssh: handshake failed: EOF
	W0812 00:10:46.820814  197285 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:46.820875  197285 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0812 00:10:46.820937  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:46.846892  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:46.847831  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:46.847851  197285 retry.go:31] will retry after 320.768818ms: ssh: handshake failed: EOF
	W0812 00:10:47.170080  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:38406->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:47.170110  197285 retry.go:31] will retry after 554.937931ms: ssh: handshake failed: read tcp 127.0.0.1:38406->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:47.725961  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:47.725988  197285 retry.go:31] will retry after 614.7277ms: ssh: handshake failed: EOF
	W0812 00:10:48.342256  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:48.342322  197285 retry.go:31] will retry after 163.396339ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:48.506752  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:48.529203  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:10:48.530138  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:48.530153  197285 retry.go:31] will retry after 285.864519ms: ssh: handshake failed: EOF
	W0812 00:10:48.817115  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:48.817141  197285 retry.go:31] will retry after 466.851405ms: ssh: handshake failed: EOF
	W0812 00:10:49.285496  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:10:49.285519  197285 retry.go:31] will retry after 422.951368ms: ssh: handshake failed: EOF
	W0812 00:10:49.709535  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:38466->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:49.709574  197285 retry.go:31] will retry after 427.990472ms: ssh: handshake failed: read tcp 127.0.0.1:38466->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:50.138775  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:38468->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:50.138889  197285 start.go:290] error running df -BG /var: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:38468->127.0.0.1:33021: read: connection reset by peer
	W0812 00:10:50.138900  197285 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:38468->127.0.0.1:33021: read: connection reset by peer
	I0812 00:10:50.138914  197285 fix.go:56] fixHost completed within 8m8.898766079s
	I0812 00:10:50.138924  197285 start.go:83] releasing machines lock for "embed-certs-001161", held for 8m8.898796979s
	W0812 00:10:50.138937  197285 start.go:672] error starting host: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	W0812 00:10:50.139038  197285 out.go:239] ! StartHost failed, but will try again: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	! StartHost failed, but will try again: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:10:50.139047  197285 start.go:687] Will try again in 5 seconds ...
	I0812 00:10:55.139216  197285 start.go:365] acquiring machines lock for embed-certs-001161: {Name:mkd3777b7cae5c83c1c549ae87c5fba7cbe17621 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0812 00:10:55.139315  197285 start.go:369] acquired machines lock for "embed-certs-001161" in 63.088µs
	I0812 00:10:55.139339  197285 start.go:96] Skipping create...Using existing machine configuration
	I0812 00:10:55.139345  197285 fix.go:54] fixHost starting: 
	I0812 00:10:55.139650  197285 cli_runner.go:164] Run: docker container inspect embed-certs-001161 --format={{.State.Status}}
	I0812 00:10:55.166460  197285 fix.go:102] recreateIfNeeded on embed-certs-001161: state=Running err=<nil>
	W0812 00:10:55.166485  197285 fix.go:128] unexpected machine state, will restart: <nil>
	I0812 00:10:55.168752  197285 out.go:177] * Updating the running docker "embed-certs-001161" container ...
	I0812 00:10:55.170798  197285 machine.go:88] provisioning docker machine ...
	I0812 00:10:55.170829  197285 ubuntu.go:169] provisioning hostname "embed-certs-001161"
	I0812 00:10:55.170910  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:10:55.195212  197285 main.go:141] libmachine: Using SSH client type: native
	I0812 00:10:55.195643  197285 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 33021 <nil> <nil>}
	I0812 00:10:55.195656  197285 main.go:141] libmachine: About to run SSH command:
	sudo hostname embed-certs-001161 && echo "embed-certs-001161" | sudo tee /etc/hostname
	I0812 00:10:55.196260  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:10:58.196915  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38222->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:01.198361  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38238->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:04.200910  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38250->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:07.201600  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53062->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:10.204163  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53074->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:13.205410  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53080->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:16.206769  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44026->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:19.207548  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44036->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:22.208614  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44044->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:25.210026  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:11:28.212757  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38508->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:31.213369  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38518->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:34.214142  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38522->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:37.214811  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:11:40.215539  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54302->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:43.218321  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54310->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:46.218905  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46030->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:49.221530  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46032->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:52.223105  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:46042->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:55.223728  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50604->127.0.0.1:33021: read: connection reset by peer
	I0812 00:11:58.225604  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50614->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:01.226657  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50620->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:04.227846  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:12:07.228672  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:32922->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:10.230700  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:32924->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:13.231604  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:12:16.232739  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:37640->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:19.233349  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:12:22.233985  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:12:25.235559  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:39894->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:28.236836  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:39900->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:31.238358  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:39910->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:34.240519  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:39922->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:37.241119  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:36086->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:40.242015  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:12:43.243007  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:12:46.243772  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:57930->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:49.244432  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:12:52.245112  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:57944->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:55.247598  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54758->127.0.0.1:33021: read: connection reset by peer
	I0812 00:12:58.248239  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54768->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:01.249388  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54770->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:04.250065  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:13:07.251548  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44506->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:10.253866  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44512->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:13.256597  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44522->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:16.257796  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55710->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:19.259743  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55714->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:22.261717  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:55730->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:25.262440  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50670->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:28.264003  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:13:31.264639  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50694->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:34.265349  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50704->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:37.265963  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43860->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:40.267119  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43864->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:43.268155  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43878->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:46.268820  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58572->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:49.270724  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58578->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:52.271738  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:13:55.273546  197285 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0812 00:13:55.273669  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:13:55.296612  197285 main.go:141] libmachine: Using SSH client type: native
	I0812 00:13:55.297154  197285 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f940] 0x3a22d0 <nil>  [] 0s} 127.0.0.1 33021 <nil> <nil>}
	I0812 00:13:55.297177  197285 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-001161' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-001161/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-001161' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0812 00:13:55.297606  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:56006->127.0.0.1:33021: read: connection reset by peer
	I0812 00:13:58.299554  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:56020->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:01.300497  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:56022->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:04.302627  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:56038->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:07.303548  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:14:10.304205  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:42674->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:13.305601  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:42678->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:16.306970  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52414->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:19.307595  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52422->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:22.308275  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:14:25.308899  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49540->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:28.311000  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49550->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:31.311640  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49558->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:34.312352  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:49570->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:37.313860  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58734->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:40.315394  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58738->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:43.316051  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58748->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:46.316667  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35008->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:49.317397  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:14:52.318582  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35022->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:55.319280  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52344->127.0.0.1:33021: read: connection reset by peer
	I0812 00:14:58.319980  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:15:01.321497  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52360->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:04.323426  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52364->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:07.324067  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:15:10.324689  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59564->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:13.326203  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:59570->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:16.327770  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51554->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:19.328687  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51568->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:22.329297  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51570->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:25.331521  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:48324->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:28.334131  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:15:31.335277  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:48342->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:34.335907  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:15:37.337350  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33524->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:40.338122  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:33526->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:43.340936  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:15:46.342197  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51270->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:49.344770  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:15:52.345419  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51278->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:55.348019  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:36432->127.0.0.1:33021: read: connection reset by peer
	I0812 00:15:58.348749  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:36438->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:01.349410  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0812 00:16:04.351426  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:36458->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:07.352090  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58964->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:10.354132  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58974->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:13.356026  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58984->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:16.356659  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53342->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:19.357270  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53356->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:22.357851  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53368->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:25.359570  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50114->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:28.360221  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50118->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:31.361055  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50122->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:34.363513  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50136->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:37.364158  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38836->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:40.368766  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38840->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:43.371519  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38846->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:46.372761  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:37424->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:49.374390  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:37428->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:52.375601  197285 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:37440->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:55.375779  197285 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0812 00:16:55.375808  197285 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17044-2342/.minikube CaCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17044-2342/.minikube}
	I0812 00:16:55.375831  197285 ubuntu.go:177] setting up certificates
	I0812 00:16:55.375849  197285 provision.go:83] configureAuth start
	I0812 00:16:55.376012  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:16:55.394578  197285 provision.go:138] copyHostCerts
	I0812 00:16:55.394646  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:16:55.394659  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:16:55.394740  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:16:55.394847  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:16:55.394857  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:16:55.394886  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:16:55.394982  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:16:55.394992  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:16:55.395057  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:16:55.395113  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:16:56.374352  197285 provision.go:172] copyRemoteCerts
	I0812 00:16:56.374417  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:16:56.374461  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:16:56.398657  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:16:56.399571  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:16:56.399597  197285 retry.go:31] will retry after 253.413333ms: ssh: handshake failed: EOF
	W0812 00:16:56.654413  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:16:56.654443  197285 retry.go:31] will retry after 241.464226ms: ssh: handshake failed: EOF
	W0812 00:16:56.897294  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:52988->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:56.897322  197285 retry.go:31] will retry after 454.475667ms: ssh: handshake failed: read tcp 127.0.0.1:52988->127.0.0.1:33021: read: connection reset by peer
	W0812 00:16:57.352316  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:16:57.352343  197285 retry.go:31] will retry after 789.619101ms: ssh: handshake failed: EOF
	W0812 00:16:58.142618  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:53002->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:58.142695  197285 provision.go:86] duration metric: configureAuth took 2.766838992s
	W0812 00:16:58.142709  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:53002->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:58.142720  197285 retry.go:31] will retry after 82.603µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:53002->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:58.143806  197285 provision.go:83] configureAuth start
	I0812 00:16:58.143894  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:16:58.162389  197285 provision.go:138] copyHostCerts
	I0812 00:16:58.162452  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:16:58.162461  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:16:58.162522  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:16:58.162631  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:16:58.162636  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:16:58.162659  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:16:58.162718  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:16:58.162723  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:16:58.162744  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:16:58.162795  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:16:58.566709  197285 provision.go:172] copyRemoteCerts
	I0812 00:16:58.566778  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:16:58.566820  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:16:58.592555  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:16:58.593557  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:53008->127.0.0.1:33021: read: connection reset by peer
	I0812 00:16:58.593583  197285 retry.go:31] will retry after 335.755731ms: ssh: handshake failed: read tcp 127.0.0.1:53008->127.0.0.1:33021: read: connection reset by peer
	W0812 00:16:58.930638  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:16:58.930676  197285 retry.go:31] will retry after 470.595295ms: ssh: handshake failed: EOF
	W0812 00:16:59.402725  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:16:59.402752  197285 retry.go:31] will retry after 622.749408ms: ssh: handshake failed: EOF
	W0812 00:17:00.027295  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:00.027368  197285 retry.go:31] will retry after 228.184737ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:00.268218  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:00.314295  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:00.315625  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:00.315690  197285 retry.go:31] will retry after 237.055641ms: ssh: handshake failed: EOF
	W0812 00:17:00.553442  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:53058->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:00.553476  197285 retry.go:31] will retry after 299.487562ms: ssh: handshake failed: read tcp 127.0.0.1:53058->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:00.854605  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:53074->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:00.854638  197285 retry.go:31] will retry after 651.565559ms: ssh: handshake failed: read tcp 127.0.0.1:53074->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:01.506832  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:01.506864  197285 retry.go:31] will retry after 651.334454ms: ssh: handshake failed: EOF
	W0812 00:17:02.158983  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:53080->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:02.159102  197285 provision.go:86] duration metric: configureAuth took 4.015280916s
	W0812 00:17:02.159116  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:53080->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:02.159127  197285 retry.go:31] will retry after 172.156µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:53080->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:02.160220  197285 provision.go:83] configureAuth start
	I0812 00:17:02.160322  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:02.192653  197285 provision.go:138] copyHostCerts
	I0812 00:17:02.192732  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:02.192744  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:02.192814  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:02.192940  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:02.192952  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:02.192986  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:02.193066  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:02.193076  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:02.193103  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:02.193166  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:02.890498  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:02.890594  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:02.890661  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:02.912548  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:02.913496  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:02.913523  197285 retry.go:31] will retry after 217.193857ms: ssh: handshake failed: EOF
	W0812 00:17:03.132448  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:53090->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:03.132485  197285 retry.go:31] will retry after 462.3646ms: ssh: handshake failed: read tcp 127.0.0.1:53090->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:03.595513  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:03.595542  197285 retry.go:31] will retry after 843.025674ms: ssh: handshake failed: EOF
	W0812 00:17:04.439905  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:53114->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:04.440006  197285 retry.go:31] will retry after 258.400836ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:53114->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:04.699441  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:04.720098  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:04.720972  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:53130->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:04.720994  197285 retry.go:31] will retry after 157.996067ms: ssh: handshake failed: read tcp 127.0.0.1:53130->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:04.879777  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:04.879808  197285 retry.go:31] will retry after 202.475586ms: ssh: handshake failed: EOF
	W0812 00:17:05.083738  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:05.083767  197285 retry.go:31] will retry after 627.604786ms: ssh: handshake failed: EOF
	W0812 00:17:05.712077  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:05.712105  197285 retry.go:31] will retry after 505.058739ms: ssh: handshake failed: EOF
	W0812 00:17:06.218394  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59672->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:06.218480  197285 provision.go:86] duration metric: configureAuth took 4.058243328s
	W0812 00:17:06.218491  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:59672->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:06.218502  197285 retry.go:31] will retry after 142.726µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:59672->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:06.219618  197285 provision.go:83] configureAuth start
	I0812 00:17:06.219694  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:06.239525  197285 provision.go:138] copyHostCerts
	I0812 00:17:06.239595  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:06.239613  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:06.239686  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:06.239784  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:06.239795  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:06.239822  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:06.239880  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:06.239889  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:06.239912  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:06.239973  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:06.680803  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:06.680901  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:06.680957  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:06.701684  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:06.702561  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:06.702579  197285 retry.go:31] will retry after 252.348191ms: ssh: handshake failed: EOF
	W0812 00:17:06.956353  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:06.956381  197285 retry.go:31] will retry after 284.263652ms: ssh: handshake failed: EOF
	W0812 00:17:07.241341  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:07.241369  197285 retry.go:31] will retry after 319.077889ms: ssh: handshake failed: EOF
	W0812 00:17:07.561147  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59710->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:07.561177  197285 retry.go:31] will retry after 1.064228331s: ssh: handshake failed: read tcp 127.0.0.1:59710->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:08.626347  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59716->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:08.626436  197285 provision.go:86] duration metric: configureAuth took 2.406803766s
	W0812 00:17:08.626449  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:59716->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:08.626458  197285 retry.go:31] will retry after 474.708µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:59716->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:08.627616  197285 provision.go:83] configureAuth start
	I0812 00:17:08.627703  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:08.645888  197285 provision.go:138] copyHostCerts
	I0812 00:17:08.645956  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:08.645969  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:08.646030  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:08.646130  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:08.646139  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:08.646166  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:08.646224  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:08.646232  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:08.646256  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:08.646299  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:08.965857  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:08.965928  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:08.965969  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:08.990227  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:08.991084  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:08.991108  197285 retry.go:31] will retry after 268.429993ms: ssh: handshake failed: EOF
	W0812 00:17:09.260664  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59724->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:09.260700  197285 retry.go:31] will retry after 187.783258ms: ssh: handshake failed: read tcp 127.0.0.1:59724->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:09.449604  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59728->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:09.449644  197285 retry.go:31] will retry after 331.737444ms: ssh: handshake failed: read tcp 127.0.0.1:59728->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:09.782548  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:09.782574  197285 retry.go:31] will retry after 680.492243ms: ssh: handshake failed: EOF
	W0812 00:17:10.463834  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59740->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:10.463906  197285 retry.go:31] will retry after 187.897326ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:59740->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:10.652340  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:10.675201  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:10.676179  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59746->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:10.676204  197285 retry.go:31] will retry after 229.686388ms: ssh: handshake failed: read tcp 127.0.0.1:59746->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:10.907267  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59762->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:10.907291  197285 retry.go:31] will retry after 241.836097ms: ssh: handshake failed: read tcp 127.0.0.1:59762->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:11.150366  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59764->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:11.150406  197285 retry.go:31] will retry after 452.455186ms: ssh: handshake failed: read tcp 127.0.0.1:59764->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:11.604018  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59772->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:11.604051  197285 retry.go:31] will retry after 909.499139ms: ssh: handshake failed: read tcp 127.0.0.1:59772->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:12.514502  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:12.514595  197285 provision.go:86] duration metric: configureAuth took 3.886956641s
	W0812 00:17:12.514606  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:12.514616  197285 retry.go:31] will retry after 399.978µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:12.515716  197285 provision.go:83] configureAuth start
	I0812 00:17:12.515798  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:12.534215  197285 provision.go:138] copyHostCerts
	I0812 00:17:12.534279  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:12.534287  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:12.534349  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:12.534441  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:12.534446  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:12.534468  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:12.534516  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:12.534521  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:12.534543  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:12.534585  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:12.917038  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:12.917104  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:12.917152  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:12.937161  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:12.938014  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:59788->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:12.938038  197285 retry.go:31] will retry after 328.409716ms: ssh: handshake failed: read tcp 127.0.0.1:59788->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:13.267947  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:13.267977  197285 retry.go:31] will retry after 479.235471ms: ssh: handshake failed: EOF
	W0812 00:17:13.747885  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:13.747920  197285 retry.go:31] will retry after 559.667027ms: ssh: handshake failed: EOF
	W0812 00:17:14.309057  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:14.309123  197285 retry.go:31] will retry after 258.801215ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:14.568564  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:14.591264  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:14.592108  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:14.592131  197285 retry.go:31] will retry after 164.491412ms: ssh: handshake failed: EOF
	W0812 00:17:14.757890  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:14.757917  197285 retry.go:31] will retry after 542.225961ms: ssh: handshake failed: EOF
	W0812 00:17:15.300907  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:15.300933  197285 retry.go:31] will retry after 664.591758ms: ssh: handshake failed: EOF
	W0812 00:17:15.966346  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50522->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:15.966422  197285 provision.go:86] duration metric: configureAuth took 3.450686408s
	W0812 00:17:15.966435  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50522->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:15.966445  197285 retry.go:31] will retry after 446.647µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50522->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:15.967543  197285 provision.go:83] configureAuth start
	I0812 00:17:15.967619  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:15.985592  197285 provision.go:138] copyHostCerts
	I0812 00:17:15.985668  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:15.985684  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:15.985748  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:15.985841  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:15.985849  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:15.985871  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:15.985929  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:15.985937  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:15.985961  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:15.986007  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:16.142533  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:16.142629  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:16.142691  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:16.165092  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:16.165967  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50534->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:16.165992  197285 retry.go:31] will retry after 359.515379ms: ssh: handshake failed: read tcp 127.0.0.1:50534->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:16.526955  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:16.526984  197285 retry.go:31] will retry after 332.312746ms: ssh: handshake failed: EOF
	W0812 00:17:16.859898  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50552->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:16.859926  197285 retry.go:31] will retry after 689.114155ms: ssh: handshake failed: read tcp 127.0.0.1:50552->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:17.549987  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50566->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:17.550054  197285 retry.go:31] will retry after 146.299281ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50566->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:17.697410  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:17.727320  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:17.728356  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:17.728379  197285 retry.go:31] will retry after 294.541819ms: ssh: handshake failed: EOF
	W0812 00:17:18.024373  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:18.024403  197285 retry.go:31] will retry after 418.732095ms: ssh: handshake failed: EOF
	W0812 00:17:18.444460  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:18.444481  197285 retry.go:31] will retry after 602.440288ms: ssh: handshake failed: EOF
	W0812 00:17:19.047508  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50606->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:19.047589  197285 provision.go:86] duration metric: configureAuth took 3.080032126s
	W0812 00:17:19.047600  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50606->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:19.047609  197285 retry.go:31] will retry after 1.372777ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50606->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:19.049796  197285 provision.go:83] configureAuth start
	I0812 00:17:19.049884  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:19.072176  197285 provision.go:138] copyHostCerts
	I0812 00:17:19.072236  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:19.072256  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:19.072315  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:19.072405  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:19.072414  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:19.072438  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:19.072496  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:19.072505  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:19.072529  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:19.072621  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:19.571225  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:19.571472  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:19.571546  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:19.599783  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:19.600673  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50618->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:19.600691  197285 retry.go:31] will retry after 318.690518ms: ssh: handshake failed: read tcp 127.0.0.1:50618->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:19.920641  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50624->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:19.920692  197285 retry.go:31] will retry after 536.329322ms: ssh: handshake failed: read tcp 127.0.0.1:50624->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:20.457631  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:20.457656  197285 retry.go:31] will retry after 473.656864ms: ssh: handshake failed: EOF
	W0812 00:17:20.931989  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50648->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:20.932013  197285 retry.go:31] will retry after 466.890087ms: ssh: handshake failed: read tcp 127.0.0.1:50648->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:21.400834  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50658->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:21.400911  197285 provision.go:86] duration metric: configureAuth took 2.351095983s
	W0812 00:17:21.400918  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50658->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:21.400928  197285 retry.go:31] will retry after 1.325938ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:50658->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:21.405219  197285 provision.go:83] configureAuth start
	I0812 00:17:21.405316  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:21.447329  197285 provision.go:138] copyHostCerts
	I0812 00:17:21.447396  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:21.447406  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:21.447478  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:21.447570  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:21.447578  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:21.447602  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:21.447666  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:21.447672  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:21.447695  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:21.447739  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:21.919614  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:21.919716  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:21.919761  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:21.948697  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:21.949713  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:21.949737  197285 retry.go:31] will retry after 267.734743ms: ssh: handshake failed: EOF
	W0812 00:17:22.218401  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:22.218425  197285 retry.go:31] will retry after 397.386184ms: ssh: handshake failed: EOF
	W0812 00:17:22.616428  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:22.616458  197285 retry.go:31] will retry after 311.979078ms: ssh: handshake failed: EOF
	W0812 00:17:22.929404  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50688->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:22.929439  197285 retry.go:31] will retry after 680.241931ms: ssh: handshake failed: read tcp 127.0.0.1:50688->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:23.610330  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:23.610405  197285 retry.go:31] will retry after 195.588322ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:23.806874  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:23.846662  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:23.848794  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:23.848821  197285 retry.go:31] will retry after 243.702409ms: ssh: handshake failed: EOF
	W0812 00:17:24.093709  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:24.093738  197285 retry.go:31] will retry after 538.656223ms: ssh: handshake failed: EOF
	W0812 00:17:24.633919  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:50736->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:24.633941  197285 retry.go:31] will retry after 664.829786ms: ssh: handshake failed: read tcp 127.0.0.1:50736->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:25.300218  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:25.300300  197285 provision.go:86] duration metric: configureAuth took 3.895061567s
	W0812 00:17:25.300312  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:25.300323  197285 retry.go:31] will retry after 2.95661ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:25.303458  197285 provision.go:83] configureAuth start
	I0812 00:17:25.303554  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:25.329306  197285 provision.go:138] copyHostCerts
	I0812 00:17:25.329439  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:25.329451  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:25.329521  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:25.329669  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:25.329681  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:25.329735  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:25.329849  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:25.329874  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:25.329900  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:25.329971  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:26.012174  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:26.012834  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:26.012917  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:26.041856  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:26.042805  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:26.042821  197285 retry.go:31] will retry after 322.902852ms: ssh: handshake failed: EOF
	W0812 00:17:26.366885  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:26.366914  197285 retry.go:31] will retry after 328.904562ms: ssh: handshake failed: EOF
	W0812 00:17:26.696649  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:26.696683  197285 retry.go:31] will retry after 773.878928ms: ssh: handshake failed: EOF
	W0812 00:17:27.472013  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:45656->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:27.472087  197285 retry.go:31] will retry after 129.840507ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:45656->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:27.602444  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:27.631419  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:27.632638  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:27.632673  197285 retry.go:31] will retry after 277.305517ms: ssh: handshake failed: EOF
	W0812 00:17:27.911920  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:27.911947  197285 retry.go:31] will retry after 222.286789ms: ssh: handshake failed: EOF
	W0812 00:17:28.135862  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:45686->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:28.135908  197285 retry.go:31] will retry after 666.111408ms: ssh: handshake failed: read tcp 127.0.0.1:45686->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:28.802630  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:28.802705  197285 provision.go:86] duration metric: configureAuth took 3.499222637s
	W0812 00:17:28.802717  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:28.802727  197285 retry.go:31] will retry after 3.709036ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:28.806881  197285 provision.go:83] configureAuth start
	I0812 00:17:28.806974  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:28.833134  197285 provision.go:138] copyHostCerts
	I0812 00:17:28.833199  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:28.833207  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:28.833272  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:28.833363  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:28.833368  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:28.833391  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:28.833452  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:28.833468  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:28.833532  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:28.833573  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:29.685968  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:29.686031  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:29.686073  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:29.706589  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:29.707439  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:29.707460  197285 retry.go:31] will retry after 192.049869ms: ssh: handshake failed: EOF
	W0812 00:17:29.900220  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:29.900249  197285 retry.go:31] will retry after 520.512062ms: ssh: handshake failed: EOF
	W0812 00:17:30.421368  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:30.421389  197285 retry.go:31] will retry after 758.263734ms: ssh: handshake failed: EOF
	W0812 00:17:31.180847  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:45736->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:31.180917  197285 retry.go:31] will retry after 303.327118ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:45736->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:31.485232  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:31.507625  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:31.509416  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:31.509435  197285 retry.go:31] will retry after 359.459392ms: ssh: handshake failed: EOF
	W0812 00:17:31.870464  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:31.870487  197285 retry.go:31] will retry after 556.142599ms: ssh: handshake failed: EOF
	W0812 00:17:32.431261  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:32.431285  197285 retry.go:31] will retry after 570.533635ms: ssh: handshake failed: EOF
	W0812 00:17:33.002587  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:45776->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:33.002673  197285 provision.go:86] duration metric: configureAuth took 4.195770883s
	W0812 00:17:33.002680  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:45776->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:33.002692  197285 retry.go:31] will retry after 5.067087ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:45776->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:33.007842  197285 provision.go:83] configureAuth start
	I0812 00:17:33.007967  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:33.028560  197285 provision.go:138] copyHostCerts
	I0812 00:17:33.028629  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:33.028647  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:33.028732  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:33.028836  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:33.028846  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:33.028874  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:33.028928  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:33.028937  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:33.028967  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:33.029018  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:33.699200  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:33.699269  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:33.699315  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:33.728941  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:33.729811  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:45792->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:33.729829  197285 retry.go:31] will retry after 138.372965ms: ssh: handshake failed: read tcp 127.0.0.1:45792->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:33.869698  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:45800->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:33.869724  197285 retry.go:31] will retry after 488.966208ms: ssh: handshake failed: read tcp 127.0.0.1:45800->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:34.359805  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:45806->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:34.359827  197285 retry.go:31] will retry after 487.876817ms: ssh: handshake failed: read tcp 127.0.0.1:45806->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:34.848627  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:34.848657  197285 retry.go:31] will retry after 874.924702ms: ssh: handshake failed: EOF
	W0812 00:17:35.724173  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55136->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:35.724252  197285 provision.go:86] duration metric: configureAuth took 2.716378924s
	W0812 00:17:35.724261  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55136->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:35.724271  197285 retry.go:31] will retry after 5.803449ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55136->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:35.730439  197285 provision.go:83] configureAuth start
	I0812 00:17:35.730514  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:35.761751  197285 provision.go:138] copyHostCerts
	I0812 00:17:35.761821  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:35.761833  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:35.761911  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:35.761999  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:35.762007  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:35.762037  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:35.762096  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:35.762105  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:35.762133  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:35.762181  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:36.542275  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:36.542391  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:36.542450  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:36.566345  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:36.567390  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:36.567411  197285 retry.go:31] will retry after 346.732605ms: ssh: handshake failed: EOF
	W0812 00:17:36.915384  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:36.915404  197285 retry.go:31] will retry after 398.083074ms: ssh: handshake failed: EOF
	W0812 00:17:37.314310  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55148->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:37.314340  197285 retry.go:31] will retry after 630.992484ms: ssh: handshake failed: read tcp 127.0.0.1:55148->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:37.946551  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55160->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:37.946618  197285 retry.go:31] will retry after 290.545094ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55160->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:38.237438  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:38.263938  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:38.264784  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55168->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:38.264801  197285 retry.go:31] will retry after 231.365834ms: ssh: handshake failed: read tcp 127.0.0.1:55168->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:38.497758  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55176->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:38.497784  197285 retry.go:31] will retry after 561.201623ms: ssh: handshake failed: read tcp 127.0.0.1:55176->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:39.059925  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:39.059954  197285 retry.go:31] will retry after 590.586ms: ssh: handshake failed: EOF
	W0812 00:17:39.651164  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55182->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:39.651245  197285 provision.go:86] duration metric: configureAuth took 3.92079269s
	W0812 00:17:39.651256  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55182->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:39.651267  197285 retry.go:31] will retry after 14.891777ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55182->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:39.666475  197285 provision.go:83] configureAuth start
	I0812 00:17:39.666574  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:39.684741  197285 provision.go:138] copyHostCerts
	I0812 00:17:39.684805  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:39.684813  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:39.684888  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:39.684972  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:39.684984  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:39.685014  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:39.685072  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:39.685082  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:39.685112  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:39.685160  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:40.019986  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:40.020107  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:40.020174  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:40.039954  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:40.040919  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:40.040948  197285 retry.go:31] will retry after 343.444407ms: ssh: handshake failed: EOF
	W0812 00:17:40.385951  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:40.385973  197285 retry.go:31] will retry after 297.535018ms: ssh: handshake failed: EOF
	W0812 00:17:40.685369  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55212->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:40.685400  197285 retry.go:31] will retry after 546.881848ms: ssh: handshake failed: read tcp 127.0.0.1:55212->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:41.233724  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55220->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:41.233747  197285 retry.go:31] will retry after 480.855328ms: ssh: handshake failed: read tcp 127.0.0.1:55220->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:41.715829  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55226->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:41.715903  197285 retry.go:31] will retry after 144.925807ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55226->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:41.861261  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:41.900599  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:41.901474  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:41.901490  197285 retry.go:31] will retry after 147.922422ms: ssh: handshake failed: EOF
	W0812 00:17:42.050353  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55244->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:42.050377  197285 retry.go:31] will retry after 493.435311ms: ssh: handshake failed: read tcp 127.0.0.1:55244->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:42.544456  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55258->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:42.544480  197285 retry.go:31] will retry after 693.918299ms: ssh: handshake failed: read tcp 127.0.0.1:55258->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:43.239879  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55268->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:43.239957  197285 provision.go:86] duration metric: configureAuth took 3.573460249s
	W0812 00:17:43.239964  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55268->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:43.239973  197285 retry.go:31] will retry after 16.660406ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:55268->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:43.257128  197285 provision.go:83] configureAuth start
	I0812 00:17:43.257225  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:43.276884  197285 provision.go:138] copyHostCerts
	I0812 00:17:43.276944  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:43.276955  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:43.277015  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:43.277106  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:43.277117  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:43.277142  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:43.277196  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:43.277206  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:43.277228  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:43.277276  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:43.863827  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:43.863955  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:43.864044  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:43.898975  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:43.900041  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55282->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:43.900062  197285 retry.go:31] will retry after 355.242902ms: ssh: handshake failed: read tcp 127.0.0.1:55282->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:44.255923  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55286->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:44.255946  197285 retry.go:31] will retry after 529.946278ms: ssh: handshake failed: read tcp 127.0.0.1:55286->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:44.787128  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:55288->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:44.787154  197285 retry.go:31] will retry after 710.350943ms: ssh: handshake failed: read tcp 127.0.0.1:55288->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:45.498231  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:45.498300  197285 retry.go:31] will retry after 236.653832ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:17:45.735715  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:45.761157  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:45.761956  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49702->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:45.761976  197285 retry.go:31] will retry after 140.149969ms: ssh: handshake failed: read tcp 127.0.0.1:49702->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:45.903062  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:45.903084  197285 retry.go:31] will retry after 293.596161ms: ssh: handshake failed: EOF
	W0812 00:17:46.197710  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49726->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:46.197741  197285 retry.go:31] will retry after 726.86181ms: ssh: handshake failed: read tcp 127.0.0.1:49726->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:46.926273  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49736->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:46.926369  197285 provision.go:86] duration metric: configureAuth took 3.669221006s
	W0812 00:17:46.926380  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:49736->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:46.926390  197285 retry.go:31] will retry after 36.327224ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:49736->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:46.963541  197285 provision.go:83] configureAuth start
	I0812 00:17:46.963642  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:47.001218  197285 provision.go:138] copyHostCerts
	I0812 00:17:47.001290  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:47.001298  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:47.001369  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:47.001499  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:47.001504  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:47.001527  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:47.001577  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:47.001581  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:47.001603  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:47.001644  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:47.273337  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:47.273447  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:47.273507  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:47.293483  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:47.294400  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:47.294415  197285 retry.go:31] will retry after 311.262584ms: ssh: handshake failed: EOF
	W0812 00:17:47.606440  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49758->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:47.606464  197285 retry.go:31] will retry after 359.438593ms: ssh: handshake failed: read tcp 127.0.0.1:49758->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:47.967475  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49766->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:47.967507  197285 retry.go:31] will retry after 288.38601ms: ssh: handshake failed: read tcp 127.0.0.1:49766->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:48.257435  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:48.257463  197285 retry.go:31] will retry after 975.1709ms: ssh: handshake failed: EOF
	W0812 00:17:49.233322  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49792->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:49.233401  197285 provision.go:86] duration metric: configureAuth took 2.269838258s
	W0812 00:17:49.233411  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:49792->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:49.233421  197285 retry.go:31] will retry after 33.784444ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:49792->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:49.267650  197285 provision.go:83] configureAuth start
	I0812 00:17:49.267749  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:49.308930  197285 provision.go:138] copyHostCerts
	I0812 00:17:49.309009  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:49.309017  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:49.309079  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:49.309199  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:49.309208  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:49.309237  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:49.309304  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:49.309309  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:49.309337  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:49.309390  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:50.034430  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:50.034500  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:50.034546  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:50.054125  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:50.055150  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49800->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:50.055173  197285 retry.go:31] will retry after 335.16162ms: ssh: handshake failed: read tcp 127.0.0.1:49800->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:50.390982  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:50.391006  197285 retry.go:31] will retry after 292.138107ms: ssh: handshake failed: EOF
	W0812 00:17:50.683884  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49826->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:50.683913  197285 retry.go:31] will retry after 499.645037ms: ssh: handshake failed: read tcp 127.0.0.1:49826->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:51.184214  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49830->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:51.184290  197285 retry.go:31] will retry after 281.960087ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:49830->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:51.466762  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:51.486930  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:51.487896  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:51.487918  197285 retry.go:31] will retry after 143.405092ms: ssh: handshake failed: EOF
	W0812 00:17:51.632619  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49848->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:51.632658  197285 retry.go:31] will retry after 442.928595ms: ssh: handshake failed: read tcp 127.0.0.1:49848->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:52.076716  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49852->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:52.076753  197285 retry.go:31] will retry after 486.48558ms: ssh: handshake failed: read tcp 127.0.0.1:49852->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:52.563805  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49854->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:52.563902  197285 provision.go:86] duration metric: configureAuth took 3.296232777s
	W0812 00:17:52.563914  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:49854->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:52.563924  197285 retry.go:31] will retry after 78.400632ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:49854->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:52.643085  197285 provision.go:83] configureAuth start
	I0812 00:17:52.643183  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:52.666991  197285 provision.go:138] copyHostCerts
	I0812 00:17:52.667076  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:52.667091  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:52.667159  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:52.667257  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:52.667263  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:52.667285  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:52.667346  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:52.667351  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:52.667385  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:52.667429  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:53.030559  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:53.030704  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:53.030786  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:53.065169  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:53.066152  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:53.066169  197285 retry.go:31] will retry after 271.020233ms: ssh: handshake failed: EOF
	W0812 00:17:53.337739  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:53.337767  197285 retry.go:31] will retry after 417.252857ms: ssh: handshake failed: EOF
	W0812 00:17:53.755615  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:53.755636  197285 retry.go:31] will retry after 327.463615ms: ssh: handshake failed: EOF
	W0812 00:17:54.084340  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49890->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:54.084422  197285 retry.go:31] will retry after 201.53592ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:49890->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:54.286861  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:54.317153  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:54.318070  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49902->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:54.318098  197285 retry.go:31] will retry after 150.233124ms: ssh: handshake failed: read tcp 127.0.0.1:49902->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:54.469762  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49904->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:54.469792  197285 retry.go:31] will retry after 307.586922ms: ssh: handshake failed: read tcp 127.0.0.1:49904->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:54.778638  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:49914->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:54.778667  197285 retry.go:31] will retry after 590.328169ms: ssh: handshake failed: read tcp 127.0.0.1:49914->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:55.369720  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42236->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:55.369797  197285 provision.go:86] duration metric: configureAuth took 2.726690763s
	W0812 00:17:55.369814  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:42236->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:55.369831  197285 retry.go:31] will retry after 137.359167ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:42236->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:55.507916  197285 provision.go:83] configureAuth start
	I0812 00:17:55.507998  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:17:55.560413  197285 provision.go:138] copyHostCerts
	I0812 00:17:55.560476  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:17:55.560483  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:17:55.560545  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:17:55.560633  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:17:55.560637  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:17:55.560659  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:17:55.560706  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:17:55.560710  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:17:55.560732  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:17:55.560772  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:17:56.483855  197285 provision.go:172] copyRemoteCerts
	I0812 00:17:56.483962  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:17:56.484032  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:56.508506  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:56.509342  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42242->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:56.509361  197285 retry.go:31] will retry after 362.723968ms: ssh: handshake failed: read tcp 127.0.0.1:42242->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:56.873312  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42248->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:56.873342  197285 retry.go:31] will retry after 263.029593ms: ssh: handshake failed: read tcp 127.0.0.1:42248->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:57.137008  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42260->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:57.137033  197285 retry.go:31] will retry after 691.770576ms: ssh: handshake failed: read tcp 127.0.0.1:42260->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:57.830344  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42274->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:57.830414  197285 retry.go:31] will retry after 359.630343ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:42274->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:58.190991  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:17:58.222455  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:17:58.226902  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:58.226921  197285 retry.go:31] will retry after 148.788816ms: ssh: handshake failed: EOF
	W0812 00:17:58.376579  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42304->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:58.376609  197285 retry.go:31] will retry after 321.467249ms: ssh: handshake failed: read tcp 127.0.0.1:42304->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:58.699705  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42316->127.0.0.1:33021: read: connection reset by peer
	I0812 00:17:58.699729  197285 retry.go:31] will retry after 840.186601ms: ssh: handshake failed: read tcp 127.0.0.1:42316->127.0.0.1:33021: read: connection reset by peer
	W0812 00:17:59.540546  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:17:59.540574  197285 retry.go:31] will retry after 610.413429ms: ssh: handshake failed: EOF
	W0812 00:18:00.159902  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42340->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:00.159987  197285 provision.go:86] duration metric: configureAuth took 4.652050254s
	W0812 00:18:00.159995  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:42340->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:00.160006  197285 retry.go:31] will retry after 220.517891ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:42340->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:00.381327  197285 provision.go:83] configureAuth start
	I0812 00:18:00.381421  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:00.406216  197285 provision.go:138] copyHostCerts
	I0812 00:18:00.406281  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:00.406289  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:00.406359  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:00.406446  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:00.406451  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:00.406475  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:00.406524  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:00.406528  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:00.406549  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:00.406590  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:01.062431  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:01.062500  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:01.062546  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:01.083677  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:01.084612  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:01.084631  197285 retry.go:31] will retry after 307.819558ms: ssh: handshake failed: EOF
	W0812 00:18:01.393637  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42362->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:01.393666  197285 retry.go:31] will retry after 533.254073ms: ssh: handshake failed: read tcp 127.0.0.1:42362->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:01.927585  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42372->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:01.927622  197285 retry.go:31] will retry after 826.015645ms: ssh: handshake failed: read tcp 127.0.0.1:42372->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:02.754115  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42374->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:02.754186  197285 retry.go:31] will retry after 144.014975ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:42374->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:02.898481  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:02.927156  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:02.928069  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:02.928088  197285 retry.go:31] will retry after 252.296327ms: ssh: handshake failed: EOF
	W0812 00:18:03.181937  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42390->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:03.181973  197285 retry.go:31] will retry after 537.998476ms: ssh: handshake failed: read tcp 127.0.0.1:42390->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:03.721028  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42404->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:03.721053  197285 retry.go:31] will retry after 449.672544ms: ssh: handshake failed: read tcp 127.0.0.1:42404->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:04.172101  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42412->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:04.172129  197285 retry.go:31] will retry after 502.347186ms: ssh: handshake failed: read tcp 127.0.0.1:42412->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:04.675218  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:42426->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:04.675304  197285 provision.go:86] duration metric: configureAuth took 4.293956233s
	W0812 00:18:04.675316  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:42426->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:04.675325  197285 retry.go:31] will retry after 166.762072ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:42426->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:04.842671  197285 provision.go:83] configureAuth start
	I0812 00:18:04.842768  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:04.860873  197285 provision.go:138] copyHostCerts
	I0812 00:18:04.860944  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:04.860956  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:04.861023  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:04.861118  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:04.861128  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:04.861151  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:04.861214  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:04.861224  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:04.861248  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:04.861296  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:05.742567  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:05.742639  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:05.742685  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:05.762770  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:05.763664  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:05.763683  197285 retry.go:31] will retry after 252.230684ms: ssh: handshake failed: EOF
	W0812 00:18:06.016601  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44432->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:06.016628  197285 retry.go:31] will retry after 298.521152ms: ssh: handshake failed: read tcp 127.0.0.1:44432->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:06.316556  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:06.316586  197285 retry.go:31] will retry after 677.836623ms: ssh: handshake failed: EOF
	W0812 00:18:06.996026  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:06.996225  197285 retry.go:31] will retry after 171.632197ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:07.168616  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:07.196604  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:07.197528  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:07.197545  197285 retry.go:31] will retry after 165.07749ms: ssh: handshake failed: EOF
	W0812 00:18:07.363296  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44480->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:07.363325  197285 retry.go:31] will retry after 282.881592ms: ssh: handshake failed: read tcp 127.0.0.1:44480->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:07.646963  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44482->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:07.646985  197285 retry.go:31] will retry after 776.48155ms: ssh: handshake failed: read tcp 127.0.0.1:44482->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:08.424277  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:08.424303  197285 retry.go:31] will retry after 462.735376ms: ssh: handshake failed: EOF
	W0812 00:18:08.888132  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44496->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:08.888218  197285 provision.go:86] duration metric: configureAuth took 4.045521105s
	W0812 00:18:08.888229  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:44496->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:08.888240  197285 retry.go:31] will retry after 407.168926ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:44496->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:09.295546  197285 provision.go:83] configureAuth start
	I0812 00:18:09.295658  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:09.316187  197285 provision.go:138] copyHostCerts
	I0812 00:18:09.316250  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:09.316264  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:09.316328  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:09.316421  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:09.316431  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:09.316455  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:09.316508  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:09.316517  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:09.316536  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:09.316583  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:09.689142  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:09.689255  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:09.689319  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:09.719116  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:09.720020  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44502->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:09.720047  197285 retry.go:31] will retry after 300.313501ms: ssh: handshake failed: read tcp 127.0.0.1:44502->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:10.021027  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44516->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:10.021059  197285 retry.go:31] will retry after 315.877698ms: ssh: handshake failed: read tcp 127.0.0.1:44516->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:10.338060  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44530->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:10.338091  197285 retry.go:31] will retry after 375.700022ms: ssh: handshake failed: read tcp 127.0.0.1:44530->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:10.715107  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:10.715130  197285 retry.go:31] will retry after 503.413564ms: ssh: handshake failed: EOF
	W0812 00:18:11.219344  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:11.219408  197285 retry.go:31] will retry after 221.368191ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:11.441857  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:11.461397  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:11.462334  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:11.462352  197285 retry.go:31] will retry after 369.849696ms: ssh: handshake failed: EOF
	W0812 00:18:11.833419  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:11.833447  197285 retry.go:31] will retry after 561.413669ms: ssh: handshake failed: EOF
	W0812 00:18:12.395453  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:12.395481  197285 retry.go:31] will retry after 357.071514ms: ssh: handshake failed: EOF
	W0812 00:18:12.755537  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44584->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:12.755616  197285 provision.go:86] duration metric: configureAuth took 3.4600469s
	W0812 00:18:12.755623  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:44584->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:12.755636  197285 retry.go:31] will retry after 418.528266ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:44584->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:13.175193  197285 provision.go:83] configureAuth start
	I0812 00:18:13.175292  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:13.194205  197285 provision.go:138] copyHostCerts
	I0812 00:18:13.194266  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:13.194273  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:13.194334  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:13.194419  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:13.194424  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:13.194448  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:13.194497  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:13.194502  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:13.194521  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:13.194563  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:14.454714  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:14.454784  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:14.454829  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:14.479522  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:14.480436  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:14.480453  197285 retry.go:31] will retry after 193.992313ms: ssh: handshake failed: EOF
	W0812 00:18:14.675245  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44610->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:14.675278  197285 retry.go:31] will retry after 224.518792ms: ssh: handshake failed: read tcp 127.0.0.1:44610->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:14.900998  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:44612->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:14.901056  197285 retry.go:31] will retry after 456.316833ms: ssh: handshake failed: read tcp 127.0.0.1:44612->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:15.357988  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57760->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:15.358019  197285 retry.go:31] will retry after 888.304503ms: ssh: handshake failed: read tcp 127.0.0.1:57760->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:16.247733  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57774->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:16.247814  197285 provision.go:86] duration metric: configureAuth took 3.072591658s
	W0812 00:18:16.247822  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:57774->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:16.247831  197285 retry.go:31] will retry after 931.735871ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:57774->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:17.180166  197285 provision.go:83] configureAuth start
	I0812 00:18:17.180242  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:17.205439  197285 provision.go:138] copyHostCerts
	I0812 00:18:17.205498  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:17.205505  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:17.205557  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:17.205638  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:17.205643  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:17.205666  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:17.205715  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:17.205720  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:17.205742  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:17.205782  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:17.470802  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:17.470910  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:17.470966  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:17.489700  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:17.490587  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:17.490602  197285 retry.go:31] will retry after 132.597615ms: ssh: handshake failed: EOF
	W0812 00:18:17.624301  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:17.624334  197285 retry.go:31] will retry after 466.003676ms: ssh: handshake failed: EOF
	W0812 00:18:18.091448  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57794->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:18.091475  197285 retry.go:31] will retry after 715.397254ms: ssh: handshake failed: read tcp 127.0.0.1:57794->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:18.807721  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57798->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:18.807747  197285 retry.go:31] will retry after 500.253401ms: ssh: handshake failed: read tcp 127.0.0.1:57798->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:19.309461  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57810->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:19.309539  197285 provision.go:86] duration metric: configureAuth took 2.129353076s
	W0812 00:18:19.309551  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:57810->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:19.309560  197285 retry.go:31] will retry after 739.600539ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:57810->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:20.050078  197285 provision.go:83] configureAuth start
	I0812 00:18:20.050215  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:20.068393  197285 provision.go:138] copyHostCerts
	I0812 00:18:20.068468  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:20.068477  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:20.068557  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:20.068651  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:20.068656  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:20.068684  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:20.068736  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:20.068741  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:20.068783  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:20.068829  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:20.560974  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:20.561043  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:20.561086  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:20.580843  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:20.581737  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:20.581758  197285 retry.go:31] will retry after 164.636721ms: ssh: handshake failed: EOF
	W0812 00:18:20.747431  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:20.747460  197285 retry.go:31] will retry after 315.235541ms: ssh: handshake failed: EOF
	W0812 00:18:21.063760  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57842->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:21.063789  197285 retry.go:31] will retry after 602.381123ms: ssh: handshake failed: read tcp 127.0.0.1:57842->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:21.666822  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57850->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:21.666854  197285 retry.go:31] will retry after 483.0712ms: ssh: handshake failed: read tcp 127.0.0.1:57850->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:22.150522  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:22.150591  197285 retry.go:31] will retry after 345.514021ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:22.497189  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:22.521649  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:22.522587  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:22.522603  197285 retry.go:31] will retry after 243.083467ms: ssh: handshake failed: EOF
	W0812 00:18:22.766317  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57878->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:22.766346  197285 retry.go:31] will retry after 271.890013ms: ssh: handshake failed: read tcp 127.0.0.1:57878->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:23.039291  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57880->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:23.039320  197285 retry.go:31] will retry after 630.392126ms: ssh: handshake failed: read tcp 127.0.0.1:57880->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:23.670550  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57890->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:23.670580  197285 retry.go:31] will retry after 795.777359ms: ssh: handshake failed: read tcp 127.0.0.1:57890->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:24.467233  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:57896->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:24.467306  197285 provision.go:86] duration metric: configureAuth took 4.417166899s
	W0812 00:18:24.467313  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:57896->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:24.467323  197285 retry.go:31] will retry after 843.222259ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:57896->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:25.311129  197285 provision.go:83] configureAuth start
	I0812 00:18:25.311247  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:25.329326  197285 provision.go:138] copyHostCerts
	I0812 00:18:25.329399  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:25.329411  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:25.329474  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:25.329567  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:25.329577  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:25.329601  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:25.329659  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:25.329668  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:25.329693  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:25.329742  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:25.964660  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:25.964726  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:25.964772  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:25.983920  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:25.984863  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:25.984884  197285 retry.go:31] will retry after 162.652791ms: ssh: handshake failed: EOF
	W0812 00:18:26.148547  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:26.148573  197285 retry.go:31] will retry after 376.715419ms: ssh: handshake failed: EOF
	W0812 00:18:26.526463  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56384->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:26.526494  197285 retry.go:31] will retry after 575.4156ms: ssh: handshake failed: read tcp 127.0.0.1:56384->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:27.102626  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56398->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:27.102699  197285 retry.go:31] will retry after 304.807269ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:56398->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:27.408239  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:27.425763  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:27.426636  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:27.426658  197285 retry.go:31] will retry after 181.060816ms: ssh: handshake failed: EOF
	W0812 00:18:27.608384  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56420->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:27.608414  197285 retry.go:31] will retry after 298.785801ms: ssh: handshake failed: read tcp 127.0.0.1:56420->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:27.908298  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56426->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:27.908322  197285 retry.go:31] will retry after 702.833796ms: ssh: handshake failed: read tcp 127.0.0.1:56426->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:28.612686  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56436->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:28.612716  197285 retry.go:31] will retry after 676.053995ms: ssh: handshake failed: read tcp 127.0.0.1:56436->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:29.289363  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56446->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:29.289446  197285 provision.go:86] duration metric: configureAuth took 3.978293648s
	W0812 00:18:29.289455  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:56446->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:29.289466  197285 retry.go:31] will retry after 3.149015949s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:56446->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:32.439867  197285 provision.go:83] configureAuth start
	I0812 00:18:32.439993  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:32.462377  197285 provision.go:138] copyHostCerts
	I0812 00:18:32.462441  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:32.462449  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:32.462666  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:32.462870  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:32.462879  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:32.462909  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:32.463063  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:32.463072  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:32.463107  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:32.463321  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:33.081657  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:33.081767  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:33.081844  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:33.104262  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:33.105236  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:33.105259  197285 retry.go:31] will retry after 285.189736ms: ssh: handshake failed: EOF
	W0812 00:18:33.391061  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:33.391089  197285 retry.go:31] will retry after 465.226883ms: ssh: handshake failed: EOF
	W0812 00:18:33.857016  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56460->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:33.857043  197285 retry.go:31] will retry after 498.475756ms: ssh: handshake failed: read tcp 127.0.0.1:56460->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:34.356114  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56468->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:34.356190  197285 retry.go:31] will retry after 374.262606ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:56468->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:34.730738  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:34.753147  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:34.753993  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:56478->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:34.754015  197285 retry.go:31] will retry after 201.075002ms: ssh: handshake failed: read tcp 127.0.0.1:56478->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:34.955678  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:34.955706  197285 retry.go:31] will retry after 532.891448ms: ssh: handshake failed: EOF
	W0812 00:18:35.489963  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:52466->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:35.490005  197285 retry.go:31] will retry after 801.056181ms: ssh: handshake failed: read tcp 127.0.0.1:52466->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:36.292492  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:36.292595  197285 provision.go:86] duration metric: configureAuth took 3.852676571s
	W0812 00:18:36.292609  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:36.292622  197285 retry.go:31] will retry after 4.117218751s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:40.413354  197285 provision.go:83] configureAuth start
	I0812 00:18:40.413445  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:40.435633  197285 provision.go:138] copyHostCerts
	I0812 00:18:40.435723  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:40.435738  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:40.435806  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:40.435903  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:40.435913  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:40.435937  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:40.435987  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:40.435996  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:40.436020  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:40.436062  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:40.864852  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:40.864919  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:40.864968  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:40.883211  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:40.884074  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:40.884096  197285 retry.go:31] will retry after 156.578524ms: ssh: handshake failed: EOF
	W0812 00:18:41.041902  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:41.041931  197285 retry.go:31] will retry after 252.412552ms: ssh: handshake failed: EOF
	W0812 00:18:41.295940  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:52508->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:41.295968  197285 retry.go:31] will retry after 785.335888ms: ssh: handshake failed: read tcp 127.0.0.1:52508->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:42.082787  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:52518->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:42.082867  197285 retry.go:31] will retry after 184.789076ms: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:52518->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:42.268315  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:42.287825  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:42.288787  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:52532->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:42.288814  197285 retry.go:31] will retry after 224.082295ms: ssh: handshake failed: read tcp 127.0.0.1:52532->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:42.513540  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:42.513570  197285 retry.go:31] will retry after 351.716266ms: ssh: handshake failed: EOF
	W0812 00:18:42.866555  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:52562->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:42.866584  197285 retry.go:31] will retry after 576.297466ms: ssh: handshake failed: read tcp 127.0.0.1:52562->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:43.443644  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:52574->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:43.443722  197285 provision.go:86] duration metric: configureAuth took 3.030346171s
	W0812 00:18:43.443738  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:52574->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:43.443748  197285 retry.go:31] will retry after 3.32298788s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:52574->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:46.767110  197285 provision.go:83] configureAuth start
	I0812 00:18:46.767197  197285 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-001161
	I0812 00:18:46.793311  197285 provision.go:138] copyHostCerts
	I0812 00:18:46.793373  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem, removing ...
	I0812 00:18:46.793380  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem
	I0812 00:18:46.793444  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/ca.pem (1078 bytes)
	I0812 00:18:46.793534  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem, removing ...
	I0812 00:18:46.793539  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem
	I0812 00:18:46.793562  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/cert.pem (1123 bytes)
	I0812 00:18:46.793612  197285 exec_runner.go:144] found /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem, removing ...
	I0812 00:18:46.793616  197285 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem
	I0812 00:18:46.793639  197285 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17044-2342/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17044-2342/.minikube/key.pem (1675 bytes)
	I0812 00:18:46.793681  197285 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17044-2342/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17044-2342/.minikube/certs/ca-key.pem org=jenkins.embed-certs-001161 san=[192.168.94.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-001161]
	I0812 00:18:47.132238  197285 provision.go:172] copyRemoteCerts
	I0812 00:18:47.132330  197285 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0812 00:18:47.132389  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:47.170243  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:47.171197  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:47.171214  197285 retry.go:31] will retry after 233.97366ms: ssh: handshake failed: EOF
	W0812 00:18:47.405949  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51462->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:47.405983  197285 retry.go:31] will retry after 466.545633ms: ssh: handshake failed: read tcp 127.0.0.1:51462->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:47.874022  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:47.874048  197285 retry.go:31] will retry after 465.846782ms: ssh: handshake failed: EOF
	W0812 00:18:48.340851  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:48.340916  197285 retry.go:31] will retry after 291.496052ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:48.633371  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:48.663297  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:48.664187  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51488->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:48.664209  197285 retry.go:31] will retry after 135.909572ms: ssh: handshake failed: read tcp 127.0.0.1:51488->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:48.800921  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51498->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:48.800946  197285 retry.go:31] will retry after 361.381899ms: ssh: handshake failed: read tcp 127.0.0.1:51498->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:49.163885  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:49.163915  197285 retry.go:31] will retry after 745.463484ms: ssh: handshake failed: EOF
	W0812 00:18:49.909974  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:49.910052  197285 provision.go:86] duration metric: configureAuth took 3.14292192s
	W0812 00:18:49.910064  197285 ubuntu.go:180] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:49.910076  197285 ubuntu.go:189] Error configuring auth during provisioning Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:49.910088  197285 machine.go:91] provisioned docker machine in 7m54.739270487s
	I0812 00:18:49.910157  197285 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0812 00:18:49.910210  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:49.928523  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:49.929359  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51512->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:49.929375  197285 retry.go:31] will retry after 236.126946ms: ssh: handshake failed: read tcp 127.0.0.1:51512->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:50.167257  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:50.167358  197285 retry.go:31] will retry after 379.062845ms: ssh: handshake failed: EOF
	W0812 00:18:50.547095  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51532->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:50.547123  197285 retry.go:31] will retry after 836.027761ms: ssh: handshake failed: read tcp 127.0.0.1:51532->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:51.383675  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51546->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:51.383708  197285 retry.go:31] will retry after 450.730516ms: ssh: handshake failed: read tcp 127.0.0.1:51546->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:51.835740  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	W0812 00:18:51.835823  197285 start.go:275] error running df -h /var: NewSession: new client: new client: ssh: handshake failed: EOF
	W0812 00:18:51.835836  197285 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:51.835889  197285 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0812 00:18:51.835941  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:51.865606  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:51.866498  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:51.866520  197285 retry.go:31] will retry after 198.750392ms: ssh: handshake failed: EOF
	W0812 00:18:52.066345  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:52.066376  197285 retry.go:31] will retry after 346.411397ms: ssh: handshake failed: EOF
	W0812 00:18:52.414406  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:52.414442  197285 retry.go:31] will retry after 817.408933ms: ssh: handshake failed: EOF
	W0812 00:18:53.232410  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0812 00:18:53.232473  197285 retry.go:31] will retry after 284.387082ms: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:53.517644  197285 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-001161
	I0812 00:18:53.546226  197285 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33021 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/embed-certs-001161/id_rsa Username:docker}
	W0812 00:18:53.547153  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51592->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:53.547174  197285 retry.go:31] will retry after 218.664545ms: ssh: handshake failed: read tcp 127.0.0.1:51592->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:53.767149  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51594->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:53.767176  197285 retry.go:31] will retry after 338.66309ms: ssh: handshake failed: read tcp 127.0.0.1:51594->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:54.107237  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 127.0.0.1:51604->127.0.0.1:33021: read: connection reset by peer
	I0812 00:18:54.107272  197285 retry.go:31] will retry after 520.91029ms: ssh: handshake failed: read tcp 127.0.0.1:51604->127.0.0.1:33021: read: connection reset by peer
	W0812 00:18:54.629359  197285 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	W0812 00:18:54.629431  197285 start.go:290] error running df -BG /var: NewSession: new client: new client: ssh: handshake failed: EOF
	W0812 00:18:54.629442  197285 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:54.629448  197285 fix.go:56] fixHost completed within 7m59.490103097s
	I0812 00:18:54.629454  197285 start.go:83] releasing machines lock for "embed-certs-001161", held for 7m59.490131929s
	W0812 00:18:54.629521  197285 out.go:239] * Failed to start docker container. Running "minikube delete -p embed-certs-001161" may fix it: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	* Failed to start docker container. Running "minikube delete -p embed-certs-001161" may fix it: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	I0812 00:18:54.634011  197285 out.go:177] 
	W0812 00:18:54.636392  197285 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: EOF
	W0812 00:18:54.636410  197285 out.go:239] * 
	* 
	W0812 00:18:54.637545  197285 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0812 00:18:54.640936  197285 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p embed-certs-001161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-001161
E0812 00:18:55.040077    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
helpers_test.go:235: (dbg) docker inspect embed-certs-001161:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217",
	        "Created": "2023-08-11T23:59:05.272559204Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 191614,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-08-11T23:59:05.608172408Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:abe4482d178dd08cce0cdcb8e444349673c3edfa8e7d6462144a8d9173479eb6",
	        "ResolvConfPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hostname",
	        "HostsPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hosts",
	        "LogPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217-json.log",
	        "Name": "/embed-certs-001161",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "embed-certs-001161:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-001161",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a-init/diff:/var/lib/docker/overlay2/d97b84d3132f258dcb9c2a1a6f715ba5f60dbe710f2671cc920145c44f465eef/diff",
	                "MergedDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/merged",
	                "UpperDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/diff",
	                "WorkDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "embed-certs-001161",
	                "Source": "/var/lib/docker/volumes/embed-certs-001161/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-001161",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-001161",
	                "name.minikube.sigs.k8s.io": "embed-certs-001161",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "4b938b1f54c578ff1bc13abe4f7ea0d83ed2c71397ab6b54925a8a5f25d207c9",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33021"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33020"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33017"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33019"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33018"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/4b938b1f54c5",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-001161": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "b742c3a7ea28",
	                        "embed-certs-001161"
	                    ],
	                    "NetworkID": "1e9e37def88d7ba246e9a20625327417fbb737f8f4521ce6ea560e7e47592ac3",
	                    "EndpointID": "07b44759e9dc648ea620292d9b0532f931873a50ca8ef672ae8a4b46b3a7c349",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161: exit status 3 (3.036706567s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 00:18:58.121949  236554 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:58582->127.0.0.1:33021: read: connection reset by peer
	E0812 00:18:58.121964  236554 status.go:249] status error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:58582->127.0.0.1:33021: read: connection reset by peer

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "embed-certs-001161" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (977.32s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (546.99s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:19:05.363375    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:19:15.073697    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:19:15.521073    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:19:33.048373    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:19:51.381053    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:19:56.482088    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:20:03.531611    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
E0812 00:20:03.537074    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
E0812 00:20:03.547416    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
E0812 00:20:03.567835    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
E0812 00:20:03.608155    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
E0812 00:20:03.688457    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
E0812 00:20:03.848900    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:20:04.169321    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
E0812 00:20:04.810110    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:20:06.090260    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:20:08.650603    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:20:13.771666    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:20:24.012372    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:20:44.493439    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:21:18.402829    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:21:25.454141    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:21:54.027767    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
E0812 00:21:54.033121    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
E0812 00:21:54.043431    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
E0812 00:21:54.063689    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
E0812 00:21:54.104012    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:21:54.184840    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
E0812 00:21:54.345229    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
E0812 00:21:54.665842    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:21:55.306118    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:21:56.586416    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:21:59.147171    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:22:04.268189    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:22:23.772115    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:22:27.982930    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:22:39.093234    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:22:47.374296    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:15.950040    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:30.061921    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
E0812 00:23:30.067257    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
E0812 00:23:30.077485    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
E0812 00:23:30.097750    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:30.138585    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
E0812 00:23:30.218856    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
E0812 00:23:30.379342    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
E0812 00:23:30.699887    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:31.340478    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:32.620900    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:34.557438    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:35.181343    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:40.302205    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:23:50.543305    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:24:02.242996    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:24:05.363335    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:24:11.023576    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:24:15.073633    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:24:37.870926    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:24:51.380680    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0812 00:24:51.984311    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:25:03.532116    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:25:31.215444    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/kindnet-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:25:32.140927    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
E0812 00:25:32.146265    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
E0812 00:25:32.156534    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
E0812 00:25:32.176846    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
E0812 00:25:32.217138    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
E0812 00:25:32.297431    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
E0812 00:25:32.457836    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
E0812 00:25:32.778490    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:25:33.419102    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:25:34.699744    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:25:37.260805    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:25:42.381513    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:25:52.622465    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:26:00.726950    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:26:13.102762    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:26:13.905511    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:26:14.426990    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:26:54.027431    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
E0812 00:26:54.063702    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:00.306052    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
E0812 00:27:00.311491    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
E0812 00:27:00.321853    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
E0812 00:27:00.342195    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
E0812 00:27:00.382552    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
E0812 00:27:00.462918    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
E0812 00:27:00.623287    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
E0812 00:27:00.944274    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:01.584932    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:02.865802    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:05.426167    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:10.546809    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:20.787354    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:21.711191    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:27.983166    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:39.092292    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:27:41.267999    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
start_stop_delete_test.go:274: ***** TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:274: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-001161 -n embed-certs-001161
start_stop_delete_test.go:274: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-001161 -n embed-certs-001161: exit status 3 (3.647346544s)

                                                
                                                
-- stdout --
	Nonexistent

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 00:28:01.771563  254178 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:37684->127.0.0.1:33021: read: connection reset by peer
	E0812 00:28:01.771582  254178 status.go:249] status error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:37684->127.0.0.1:33021: read: connection reset by peer

                                                
                                                
** /stderr **
start_stop_delete_test.go:274: status error: exit status 3 (may be ok)
start_stop_delete_test.go:274: "embed-certs-001161" apiserver is not running, skipping kubectl commands (state="Nonexistent")
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-001161
helpers_test.go:235: (dbg) docker inspect embed-certs-001161:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217",
	        "Created": "2023-08-11T23:59:05.272559204Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 191614,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-08-11T23:59:05.608172408Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:abe4482d178dd08cce0cdcb8e444349673c3edfa8e7d6462144a8d9173479eb6",
	        "ResolvConfPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hostname",
	        "HostsPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hosts",
	        "LogPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217-json.log",
	        "Name": "/embed-certs-001161",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "embed-certs-001161:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-001161",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a-init/diff:/var/lib/docker/overlay2/d97b84d3132f258dcb9c2a1a6f715ba5f60dbe710f2671cc920145c44f465eef/diff",
	                "MergedDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/merged",
	                "UpperDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/diff",
	                "WorkDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "embed-certs-001161",
	                "Source": "/var/lib/docker/volumes/embed-certs-001161/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-001161",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-001161",
	                "name.minikube.sigs.k8s.io": "embed-certs-001161",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "4b938b1f54c578ff1bc13abe4f7ea0d83ed2c71397ab6b54925a8a5f25d207c9",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33021"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33020"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33017"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33019"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33018"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/4b938b1f54c5",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-001161": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "b742c3a7ea28",
	                        "embed-certs-001161"
	                    ],
	                    "NetworkID": "1e9e37def88d7ba246e9a20625327417fbb737f8f4521ce6ea560e7e47592ac3",
	                    "EndpointID": "07b44759e9dc648ea620292d9b0532f931873a50ca8ef672ae8a4b46b3a7c349",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161: exit status 3 (3.321032788s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 00:28:05.112685  254210 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:53738->127.0.0.1:33021: read: connection reset by peer
	E0812 00:28:05.112707  254210 status.go:249] status error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:53738->127.0.0.1:33021: read: connection reset by peer

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "embed-certs-001161" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (546.99s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (59.06s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:28:15.984408    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/enable-default-cni-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:28:22.229034    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:28:30.061602    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:28:34.557544    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
E0812 00:28:57.746116    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/custom-flannel-761341/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
helpers_test.go:329: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: Get "https://192.168.94.2:8443/api/v1/namespaces/kubernetes-dashboard/pods?labelSelector=k8s-app%3Dkubernetes-dashboard": dial tcp 192.168.94.2:8443: connect: connection refused
start_stop_delete_test.go:287: ***** TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:287: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-001161 -n embed-certs-001161
start_stop_delete_test.go:287: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-001161 -n embed-certs-001161: exit status 3 (2.094253518s)

                                                
                                                
-- stdout --
	Nonexistent

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 00:29:01.358235  254242 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54998->127.0.0.1:33021: read: connection reset by peer
	E0812 00:29:01.358260  254242 status.go:249] status error: NewSession: new client: new client: ssh: handshake failed: read tcp 127.0.0.1:54998->127.0.0.1:33021: read: connection reset by peer

                                                
                                                
** /stderr **
start_stop_delete_test.go:287: status error: exit status 3 (may be ok)
start_stop_delete_test.go:287: "embed-certs-001161" apiserver is not running, skipping kubectl commands (state="Nonexistent")
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-001161 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-001161 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: context deadline exceeded (1.814µs)
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-001161 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": context deadline exceeded
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/AddonExistsAfterStop]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-001161
helpers_test.go:235: (dbg) docker inspect embed-certs-001161:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217",
	        "Created": "2023-08-11T23:59:05.272559204Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 191614,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-08-11T23:59:05.608172408Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:abe4482d178dd08cce0cdcb8e444349673c3edfa8e7d6462144a8d9173479eb6",
	        "ResolvConfPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hostname",
	        "HostsPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/hosts",
	        "LogPath": "/var/lib/docker/containers/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217/b742c3a7ea28048d61ba55a34ec3b0395bf87b9fcf7b6431333e9937a2887217-json.log",
	        "Name": "/embed-certs-001161",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "embed-certs-001161:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "embed-certs-001161",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a-init/diff:/var/lib/docker/overlay2/d97b84d3132f258dcb9c2a1a6f715ba5f60dbe710f2671cc920145c44f465eef/diff",
	                "MergedDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/merged",
	                "UpperDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/diff",
	                "WorkDir": "/var/lib/docker/overlay2/220f0e1cc7f42ee41bbd2007201c1c9f03019500df4faaf3b6e5193f3dd0090a/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "embed-certs-001161",
	                "Source": "/var/lib/docker/volumes/embed-certs-001161/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "embed-certs-001161",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "embed-certs-001161",
	                "name.minikube.sigs.k8s.io": "embed-certs-001161",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "4b938b1f54c578ff1bc13abe4f7ea0d83ed2c71397ab6b54925a8a5f25d207c9",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33021"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33020"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33017"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33019"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33018"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/4b938b1f54c5",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "embed-certs-001161": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.94.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "b742c3a7ea28",
	                        "embed-certs-001161"
	                    ],
	                    "NetworkID": "1e9e37def88d7ba246e9a20625327417fbb737f8f4521ce6ea560e7e47592ac3",
	                    "EndpointID": "07b44759e9dc648ea620292d9b0532f931873a50ca8ef672ae8a4b46b3a7c349",
	                    "Gateway": "192.168.94.1",
	                    "IPAddress": "192.168.94.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:5e:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161
E0812 00:29:02.145321    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-001161 -n embed-certs-001161: exit status 3 (2.795691924s)

                                                
                                                
-- stdout --
	Error

                                                
                                                
-- /stdout --
** stderr ** 
	E0812 00:29:04.175058  254268 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: ssh: handshake failed: EOF
	E0812 00:29:04.175079  254268 status.go:249] status error: NewSession: new client: new client: ssh: handshake failed: EOF

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "embed-certs-001161" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (59.06s)

                                                
                                    

Test pass (264/308)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 26.29
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.07
10 TestDownloadOnly/v1.27.4/json-events 14.1
11 TestDownloadOnly/v1.27.4/preload-exists 0
15 TestDownloadOnly/v1.27.4/LogsDuration 0.08
17 TestDownloadOnly/v1.28.0-rc.0/json-events 27.63
18 TestDownloadOnly/v1.28.0-rc.0/preload-exists 0
22 TestDownloadOnly/v1.28.0-rc.0/LogsDuration 0.07
23 TestDownloadOnly/DeleteAll 0.24
24 TestDownloadOnly/DeleteAlwaysSucceeds 0.16
26 TestBinaryMirror 0.6
29 TestAddons/Setup 142.34
31 TestAddons/parallel/Registry 15.42
33 TestAddons/parallel/InspektorGadget 10.98
34 TestAddons/parallel/MetricsServer 5.94
37 TestAddons/parallel/CSI 64.62
38 TestAddons/parallel/Headlamp 11.99
39 TestAddons/parallel/CloudSpanner 5.7
42 TestAddons/serial/GCPAuth/Namespaces 0.24
43 TestAddons/StoppedEnableDisable 12.36
44 TestCertOptions 49.33
45 TestCertExpiration 235.6
47 TestForceSystemdFlag 53.85
48 TestForceSystemdEnv 43.98
49 TestDockerEnvContainerd 47.09
54 TestErrorSpam/setup 28.56
55 TestErrorSpam/start 0.88
56 TestErrorSpam/status 1.15
57 TestErrorSpam/pause 1.9
58 TestErrorSpam/unpause 2.02
59 TestErrorSpam/stop 1.48
62 TestFunctional/serial/CopySyncFile 0
63 TestFunctional/serial/StartWithProxy 83.6
64 TestFunctional/serial/AuditLog 0
65 TestFunctional/serial/SoftStart 15.62
66 TestFunctional/serial/KubeContext 0.07
67 TestFunctional/serial/KubectlGetPods 0.11
70 TestFunctional/serial/CacheCmd/cache/add_remote 4.08
71 TestFunctional/serial/CacheCmd/cache/add_local 1.51
72 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
73 TestFunctional/serial/CacheCmd/cache/list 0.06
74 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.34
75 TestFunctional/serial/CacheCmd/cache/cache_reload 2.42
76 TestFunctional/serial/CacheCmd/cache/delete 0.12
77 TestFunctional/serial/MinikubeKubectlCmd 0.14
78 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.16
79 TestFunctional/serial/ExtraConfig 309.06
80 TestFunctional/serial/ComponentHealth 0.11
81 TestFunctional/serial/LogsCmd 2
82 TestFunctional/serial/LogsFileCmd 2.18
83 TestFunctional/serial/InvalidService 5.36
85 TestFunctional/parallel/ConfigCmd 0.45
86 TestFunctional/parallel/DashboardCmd 9.31
87 TestFunctional/parallel/DryRun 0.72
88 TestFunctional/parallel/InternationalLanguage 0.28
89 TestFunctional/parallel/StatusCmd 1.3
93 TestFunctional/parallel/ServiceCmdConnect 7.77
94 TestFunctional/parallel/AddonsCmd 0.2
95 TestFunctional/parallel/PersistentVolumeClaim 25.86
97 TestFunctional/parallel/SSHCmd 0.75
98 TestFunctional/parallel/CpCmd 1.47
100 TestFunctional/parallel/FileSync 0.37
101 TestFunctional/parallel/CertSync 2.26
105 TestFunctional/parallel/NodeLabels 0.09
107 TestFunctional/parallel/NonActiveRuntimeDisabled 0.77
109 TestFunctional/parallel/License 0.47
110 TestFunctional/parallel/Version/short 0.07
111 TestFunctional/parallel/Version/components 1.33
112 TestFunctional/parallel/ImageCommands/ImageListShort 0.29
113 TestFunctional/parallel/ImageCommands/ImageListTable 0.33
114 TestFunctional/parallel/ImageCommands/ImageListJson 0.28
115 TestFunctional/parallel/ImageCommands/ImageListYaml 0.34
116 TestFunctional/parallel/ImageCommands/ImageBuild 3.38
117 TestFunctional/parallel/ImageCommands/Setup 1.93
118 TestFunctional/parallel/UpdateContextCmd/no_changes 0.24
119 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.23
120 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.24
122 TestFunctional/parallel/ServiceCmd/DeployApp 10.36
125 TestFunctional/parallel/ServiceCmd/List 0.48
126 TestFunctional/parallel/ServiceCmd/JSONOutput 0.52
127 TestFunctional/parallel/ServiceCmd/HTTPS 0.53
128 TestFunctional/parallel/ServiceCmd/Format 0.52
130 TestFunctional/parallel/ServiceCmd/URL 0.54
131 TestFunctional/parallel/ImageCommands/ImageRemove 0.65
133 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.78
135 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.8
136 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
138 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.49
139 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.15
140 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
144 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
145 TestFunctional/parallel/ProfileCmd/profile_not_create 0.49
146 TestFunctional/parallel/ProfileCmd/profile_list 0.43
147 TestFunctional/parallel/ProfileCmd/profile_json_output 0.4
148 TestFunctional/parallel/MountCmd/any-port 7.45
149 TestFunctional/parallel/MountCmd/specific-port 2.73
150 TestFunctional/parallel/MountCmd/VerifyCleanup 2.33
151 TestFunctional/delete_addon-resizer_images 0.08
152 TestFunctional/delete_my-image_image 0.02
153 TestFunctional/delete_minikube_cached_images 0.02
157 TestIngressAddonLegacy/StartLegacyK8sCluster 103.78
159 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 8.08
160 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.82
164 TestJSONOutput/start/Command 67.2
165 TestJSONOutput/start/Audit 0
167 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
168 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
170 TestJSONOutput/pause/Command 0.79
171 TestJSONOutput/pause/Audit 0
173 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
174 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
176 TestJSONOutput/unpause/Command 0.75
177 TestJSONOutput/unpause/Audit 0
179 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
180 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
182 TestJSONOutput/stop/Command 5.85
183 TestJSONOutput/stop/Audit 0
185 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
186 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
187 TestErrorJSONOutput 0.22
189 TestKicCustomNetwork/create_custom_network 44.7
190 TestKicCustomNetwork/use_default_bridge_network 33.78
191 TestKicExistingNetwork 35.2
192 TestKicCustomSubnet 37.34
193 TestKicStaticIP 34.1
194 TestMainNoArgs 0.05
195 TestMinikubeProfile 84.62
198 TestMountStart/serial/StartWithMountFirst 6.78
199 TestMountStart/serial/VerifyMountFirst 0.29
200 TestMountStart/serial/StartWithMountSecond 6.82
201 TestMountStart/serial/VerifyMountSecond 0.29
202 TestMountStart/serial/DeleteFirst 1.7
203 TestMountStart/serial/VerifyMountPostDelete 0.28
204 TestMountStart/serial/Stop 1.23
205 TestMountStart/serial/RestartStopped 7.55
206 TestMountStart/serial/VerifyMountPostStop 0.29
209 TestMultiNode/serial/FreshStart2Nodes 109.51
210 TestMultiNode/serial/DeployApp2Nodes 4.91
211 TestMultiNode/serial/PingHostFrom2Pods 1.11
212 TestMultiNode/serial/AddNode 18.01
213 TestMultiNode/serial/ProfileList 0.35
214 TestMultiNode/serial/CopyFile 11.17
215 TestMultiNode/serial/StopNode 2.4
216 TestMultiNode/serial/StartAfterStop 13.11
217 TestMultiNode/serial/RestartKeepsNodes 136.59
218 TestMultiNode/serial/DeleteNode 5.18
219 TestMultiNode/serial/StopMultiNode 24.18
220 TestMultiNode/serial/RestartMultiNode 94.82
221 TestMultiNode/serial/ValidateNameConflict 35.86
226 TestPreload 184.77
228 TestScheduledStopUnix 111.52
231 TestInsufficientStorage 10.87
232 TestRunningBinaryUpgrade 114.05
234 TestKubernetesUpgrade 411.83
237 TestNoKubernetes/serial/StartNoK8sWithVersion 0.07
238 TestNoKubernetes/serial/StartWithK8s 46.16
239 TestNoKubernetes/serial/StartWithStopK8s 30.47
240 TestNoKubernetes/serial/Start 9.58
241 TestNoKubernetes/serial/VerifyK8sNotRunning 0.41
242 TestNoKubernetes/serial/ProfileList 1.06
243 TestNoKubernetes/serial/Stop 1.22
244 TestNoKubernetes/serial/StartNoArgs 6.84
245 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.34
246 TestStoppedBinaryUpgrade/Setup 1.47
247 TestStoppedBinaryUpgrade/Upgrade 150.18
248 TestStoppedBinaryUpgrade/MinikubeLogs 1.19
257 TestPause/serial/Start 64.1
258 TestPause/serial/SecondStartNoReconfiguration 13.89
262 TestPause/serial/Pause 1.01
263 TestPause/serial/VerifyStatus 0.48
264 TestPause/serial/Unpause 0.93
265 TestPause/serial/PauseAgain 1.24
266 TestPause/serial/DeletePaused 3.06
271 TestNetworkPlugins/group/false 4.89
272 TestPause/serial/VerifyDeletedResources 0.16
277 TestStartStop/group/old-k8s-version/serial/FirstStart 134.05
278 TestStartStop/group/old-k8s-version/serial/DeployApp 11.01
279 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.46
280 TestStartStop/group/old-k8s-version/serial/Stop 12.59
282 TestStartStop/group/no-preload/serial/FirstStart 71.41
283 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.39
284 TestStartStop/group/old-k8s-version/serial/SecondStart 659.63
285 TestStartStop/group/no-preload/serial/DeployApp 9.59
286 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.21
287 TestStartStop/group/no-preload/serial/Stop 12.14
288 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.18
289 TestStartStop/group/no-preload/serial/SecondStart 346.17
290 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 10.03
291 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.16
292 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.47
293 TestStartStop/group/no-preload/serial/Pause 3.53
295 TestStartStop/group/embed-certs/serial/FirstStart 60.58
296 TestStartStop/group/embed-certs/serial/DeployApp 9.03
297 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.27
299 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.03
301 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.1
302 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.38
303 TestStartStop/group/old-k8s-version/serial/Pause 3.36
306 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 82.95
307 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 8.58
308 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.26
309 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.12
310 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.2
311 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 345.11
312 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 10.03
313 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.11
314 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.34
315 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.46
317 TestStartStop/group/newest-cni/serial/FirstStart 48.21
318 TestStartStop/group/newest-cni/serial/DeployApp 0
319 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.25
320 TestStartStop/group/newest-cni/serial/Stop 1.27
321 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.18
322 TestStartStop/group/newest-cni/serial/SecondStart 37.87
323 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
324 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
325 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.36
326 TestStartStop/group/newest-cni/serial/Pause 3.2
327 TestNetworkPlugins/group/auto/Start 84.85
328 TestNetworkPlugins/group/auto/KubeletFlags 0.33
329 TestNetworkPlugins/group/auto/NetCatPod 10.42
330 TestNetworkPlugins/group/auto/DNS 0.2
331 TestNetworkPlugins/group/auto/Localhost 0.2
332 TestNetworkPlugins/group/auto/HairPin 0.26
333 TestNetworkPlugins/group/kindnet/Start 56.34
334 TestNetworkPlugins/group/kindnet/ControllerPod 5.04
335 TestNetworkPlugins/group/kindnet/KubeletFlags 0.3
336 TestNetworkPlugins/group/kindnet/NetCatPod 8.34
337 TestNetworkPlugins/group/kindnet/DNS 0.21
338 TestNetworkPlugins/group/kindnet/Localhost 0.18
339 TestNetworkPlugins/group/kindnet/HairPin 0.18
340 TestNetworkPlugins/group/calico/Start 74.93
341 TestNetworkPlugins/group/calico/ControllerPod 5.03
342 TestNetworkPlugins/group/calico/KubeletFlags 0.35
343 TestNetworkPlugins/group/calico/NetCatPod 11.41
344 TestNetworkPlugins/group/calico/DNS 0.2
345 TestNetworkPlugins/group/calico/Localhost 0.19
346 TestNetworkPlugins/group/calico/HairPin 0.28
347 TestNetworkPlugins/group/custom-flannel/Start 54.68
348 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.31
349 TestNetworkPlugins/group/custom-flannel/NetCatPod 9.43
350 TestNetworkPlugins/group/custom-flannel/DNS 0.2
351 TestNetworkPlugins/group/custom-flannel/Localhost 0.16
352 TestNetworkPlugins/group/custom-flannel/HairPin 0.18
354 TestNetworkPlugins/group/enable-default-cni/Start 88.99
355 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.32
356 TestNetworkPlugins/group/enable-default-cni/NetCatPod 9.35
357 TestNetworkPlugins/group/enable-default-cni/DNS 0.2
358 TestNetworkPlugins/group/enable-default-cni/Localhost 0.18
359 TestNetworkPlugins/group/enable-default-cni/HairPin 0.18
360 TestNetworkPlugins/group/flannel/Start 57.43
361 TestNetworkPlugins/group/flannel/ControllerPod 5.04
362 TestNetworkPlugins/group/flannel/KubeletFlags 0.31
363 TestNetworkPlugins/group/flannel/NetCatPod 8.36
364 TestNetworkPlugins/group/flannel/DNS 0.21
365 TestNetworkPlugins/group/flannel/Localhost 0.19
366 TestNetworkPlugins/group/flannel/HairPin 0.18
367 TestNetworkPlugins/group/bridge/Start 99.09
368 TestNetworkPlugins/group/bridge/KubeletFlags 0.32
369 TestNetworkPlugins/group/bridge/NetCatPod 10.35
370 TestNetworkPlugins/group/bridge/DNS 0.19
371 TestNetworkPlugins/group/bridge/Localhost 0.17
372 TestNetworkPlugins/group/bridge/HairPin 0.18
x
+
TestDownloadOnly/v1.16.0/json-events (26.29s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-462841 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-462841 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (26.294471183s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (26.29s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-462841
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-462841: exit status 85 (70.660336ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-462841 | jenkins | v1.31.1 | 11 Aug 23 23:00 UTC |          |
	|         | -p download-only-462841        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/08/11 23:00:42
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0811 23:00:42.837568    7675 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:00:42.837712    7675 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:00:42.837721    7675 out.go:309] Setting ErrFile to fd 2...
	I0811 23:00:42.837727    7675 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:00:42.837988    7675 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	W0811 23:00:42.838114    7675 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17044-2342/.minikube/config/config.json: open /home/jenkins/minikube-integration/17044-2342/.minikube/config/config.json: no such file or directory
	I0811 23:00:42.838515    7675 out.go:303] Setting JSON to true
	I0811 23:00:42.839297    7675 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":2589,"bootTime":1691792254,"procs":162,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:00:42.839367    7675 start.go:138] virtualization:  
	I0811 23:00:42.843049    7675 out.go:97] [download-only-462841] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:00:42.845659    7675 out.go:169] MINIKUBE_LOCATION=17044
	W0811 23:00:42.843215    7675 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball: no such file or directory
	I0811 23:00:42.843273    7675 notify.go:220] Checking for updates...
	I0811 23:00:42.850181    7675 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:00:42.852693    7675 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:00:42.855393    7675 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:00:42.857597    7675 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0811 23:00:42.862316    7675 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0811 23:00:42.862695    7675 driver.go:373] Setting default libvirt URI to qemu:///system
	I0811 23:00:42.891492    7675 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:00:42.891570    7675 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:00:43.285781    7675 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2023-08-11 23:00:43.275664364 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:00:43.285885    7675 docker.go:294] overlay module found
	I0811 23:00:43.288101    7675 out.go:97] Using the docker driver based on user configuration
	I0811 23:00:43.288129    7675 start.go:298] selected driver: docker
	I0811 23:00:43.288136    7675 start.go:901] validating driver "docker" against <nil>
	I0811 23:00:43.288242    7675 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:00:43.361375    7675 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2023-08-11 23:00:43.352169559 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:00:43.361532    7675 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0811 23:00:43.361832    7675 start_flags.go:382] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0811 23:00:43.362020    7675 start_flags.go:901] Wait components to verify : map[apiserver:true system_pods:true]
	I0811 23:00:43.364898    7675 out.go:169] Using Docker driver with root privileges
	I0811 23:00:43.366882    7675 cni.go:84] Creating CNI manager for ""
	I0811 23:00:43.366902    7675 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:00:43.366938    7675 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni
	I0811 23:00:43.366953    7675 start_flags.go:319] config:
	{Name:download-only-462841 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-462841 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:00:43.369349    7675 out.go:97] Starting control plane node download-only-462841 in cluster download-only-462841
	I0811 23:00:43.369372    7675 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0811 23:00:43.371241    7675 out.go:97] Pulling base image ...
	I0811 23:00:43.371263    7675 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0811 23:00:43.371406    7675 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon
	I0811 23:00:43.388758    7675 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 to local cache
	I0811 23:00:43.388937    7675 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local cache directory
	I0811 23:00:43.389040    7675 image.go:118] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 to local cache
	I0811 23:00:43.451529    7675 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4
	I0811 23:00:43.451554    7675 cache.go:57] Caching tarball of preloaded images
	I0811 23:00:43.451726    7675 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0811 23:00:43.454238    7675 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0811 23:00:43.454260    7675 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:00:43.574105    7675 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:1f1e2324dbd6e4f3d8734226d9194e9f -> /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4
	I0811 23:00:50.311762    7675 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 as a tarball
	I0811 23:00:53.713813    7675 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:00:53.713918    7675 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:00:54.765572    7675 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on containerd
	I0811 23:00:54.765943    7675 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/download-only-462841/config.json ...
	I0811 23:00:54.765977    7675 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/download-only-462841/config.json: {Name:mkafebffcde1dcaa10a6cfbebeaadba41cdde0a1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0811 23:00:54.766159    7675 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0811 23:00:54.766347    7675 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl.sha1 -> /home/jenkins/minikube-integration/17044-2342/.minikube/cache/linux/arm64/v1.16.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-462841"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.4/json-events (14.1s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.4/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-462841 --force --alsologtostderr --kubernetes-version=v1.27.4 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-462841 --force --alsologtostderr --kubernetes-version=v1.27.4 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (14.102564127s)
--- PASS: TestDownloadOnly/v1.27.4/json-events (14.10s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.4/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.4/preload-exists
--- PASS: TestDownloadOnly/v1.27.4/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.4/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.4/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-462841
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-462841: exit status 85 (75.87722ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-462841 | jenkins | v1.31.1 | 11 Aug 23 23:00 UTC |          |
	|         | -p download-only-462841        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-462841 | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC |          |
	|         | -p download-only-462841        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.27.4   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/08/11 23:01:09
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0811 23:01:09.204674    7752 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:01:09.204869    7752 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:01:09.204893    7752 out.go:309] Setting ErrFile to fd 2...
	I0811 23:01:09.204913    7752 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:01:09.205219    7752 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	W0811 23:01:09.205396    7752 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17044-2342/.minikube/config/config.json: open /home/jenkins/minikube-integration/17044-2342/.minikube/config/config.json: no such file or directory
	I0811 23:01:09.205661    7752 out.go:303] Setting JSON to true
	I0811 23:01:09.206429    7752 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":2616,"bootTime":1691792254,"procs":158,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:01:09.206518    7752 start.go:138] virtualization:  
	I0811 23:01:09.209227    7752 out.go:97] [download-only-462841] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:01:09.211119    7752 out.go:169] MINIKUBE_LOCATION=17044
	I0811 23:01:09.209475    7752 notify.go:220] Checking for updates...
	I0811 23:01:09.215478    7752 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:01:09.217372    7752 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:01:09.219305    7752 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:01:09.221245    7752 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0811 23:01:09.225336    7752 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0811 23:01:09.225841    7752 config.go:182] Loaded profile config "download-only-462841": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	W0811 23:01:09.225908    7752 start.go:809] api.Load failed for download-only-462841: filestore "download-only-462841": Docker machine "download-only-462841" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0811 23:01:09.226042    7752 driver.go:373] Setting default libvirt URI to qemu:///system
	W0811 23:01:09.226066    7752 start.go:809] api.Load failed for download-only-462841: filestore "download-only-462841": Docker machine "download-only-462841" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0811 23:01:09.251432    7752 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:01:09.251517    7752 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:01:09.347894    7752 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-08-11 23:01:09.338026999 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:01:09.347998    7752 docker.go:294] overlay module found
	I0811 23:01:09.350136    7752 out.go:97] Using the docker driver based on existing profile
	I0811 23:01:09.350164    7752 start.go:298] selected driver: docker
	I0811 23:01:09.350170    7752 start.go:901] validating driver "docker" against &{Name:download-only-462841 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-462841 Namespace:default APIServerName:
minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnet
ClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:01:09.350342    7752 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:01:09.423343    7752 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-08-11 23:01:09.414230701 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:01:09.423764    7752 cni.go:84] Creating CNI manager for ""
	I0811 23:01:09.423778    7752 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:01:09.423789    7752 start_flags.go:319] config:
	{Name:download-only-462841 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:download-only-462841 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:01:09.425785    7752 out.go:97] Starting control plane node download-only-462841 in cluster download-only-462841
	I0811 23:01:09.425808    7752 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0811 23:01:09.427831    7752 out.go:97] Pulling base image ...
	I0811 23:01:09.427860    7752 preload.go:132] Checking if preload exists for k8s version v1.27.4 and runtime containerd
	I0811 23:01:09.428015    7752 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon
	I0811 23:01:09.444823    7752 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 to local cache
	I0811 23:01:09.444962    7752 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local cache directory
	I0811 23:01:09.444983    7752 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local cache directory, skipping pull
	I0811 23:01:09.444993    7752 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 exists in cache, skipping pull
	I0811 23:01:09.445005    7752 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 as a tarball
	I0811 23:01:09.502980    7752 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.4/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4
	I0811 23:01:09.503005    7752 cache.go:57] Caching tarball of preloaded images
	I0811 23:01:09.503165    7752 preload.go:132] Checking if preload exists for k8s version v1.27.4 and runtime containerd
	I0811 23:01:09.505117    7752 out.go:97] Downloading Kubernetes v1.27.4 preload ...
	I0811 23:01:09.505142    7752 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:01:09.622544    7752 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.4/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4?checksum=md5:cf15c593d5924282ae979f284eb668e1 -> /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.4-containerd-overlay2-arm64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-462841"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.27.4/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0-rc.0/json-events (27.63s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0-rc.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-462841 --force --alsologtostderr --kubernetes-version=v1.28.0-rc.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-462841 --force --alsologtostderr --kubernetes-version=v1.28.0-rc.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (27.631460672s)
--- PASS: TestDownloadOnly/v1.28.0-rc.0/json-events (27.63s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0-rc.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0-rc.0/preload-exists
--- PASS: TestDownloadOnly/v1.28.0-rc.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0-rc.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0-rc.0/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-462841
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-462841: exit status 85 (71.455504ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|-----------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |               Args                |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only           | download-only-462841 | jenkins | v1.31.1 | 11 Aug 23 23:00 UTC |          |
	|         | -p download-only-462841           |                      |         |         |                     |          |
	|         | --force --alsologtostderr         |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0      |                      |         |         |                     |          |
	|         | --container-runtime=containerd    |                      |         |         |                     |          |
	|         | --driver=docker                   |                      |         |         |                     |          |
	|         | --container-runtime=containerd    |                      |         |         |                     |          |
	| start   | -o=json --download-only           | download-only-462841 | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC |          |
	|         | -p download-only-462841           |                      |         |         |                     |          |
	|         | --force --alsologtostderr         |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.27.4      |                      |         |         |                     |          |
	|         | --container-runtime=containerd    |                      |         |         |                     |          |
	|         | --driver=docker                   |                      |         |         |                     |          |
	|         | --container-runtime=containerd    |                      |         |         |                     |          |
	| start   | -o=json --download-only           | download-only-462841 | jenkins | v1.31.1 | 11 Aug 23 23:01 UTC |          |
	|         | -p download-only-462841           |                      |         |         |                     |          |
	|         | --force --alsologtostderr         |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.28.0-rc.0 |                      |         |         |                     |          |
	|         | --container-runtime=containerd    |                      |         |         |                     |          |
	|         | --driver=docker                   |                      |         |         |                     |          |
	|         | --container-runtime=containerd    |                      |         |         |                     |          |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/08/11 23:01:23
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0811 23:01:23.384330    7826 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:01:23.384520    7826 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:01:23.384549    7826 out.go:309] Setting ErrFile to fd 2...
	I0811 23:01:23.384570    7826 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:01:23.384845    7826 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	W0811 23:01:23.384988    7826 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17044-2342/.minikube/config/config.json: open /home/jenkins/minikube-integration/17044-2342/.minikube/config/config.json: no such file or directory
	I0811 23:01:23.385262    7826 out.go:303] Setting JSON to true
	I0811 23:01:23.386070    7826 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":2630,"bootTime":1691792254,"procs":158,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:01:23.386159    7826 start.go:138] virtualization:  
	I0811 23:01:23.388775    7826 out.go:97] [download-only-462841] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:01:23.391099    7826 out.go:169] MINIKUBE_LOCATION=17044
	I0811 23:01:23.389057    7826 notify.go:220] Checking for updates...
	I0811 23:01:23.394951    7826 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:01:23.397010    7826 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:01:23.398833    7826 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:01:23.400758    7826 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0811 23:01:23.404559    7826 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0811 23:01:23.405078    7826 config.go:182] Loaded profile config "download-only-462841": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	W0811 23:01:23.405135    7826 start.go:809] api.Load failed for download-only-462841: filestore "download-only-462841": Docker machine "download-only-462841" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0811 23:01:23.405286    7826 driver.go:373] Setting default libvirt URI to qemu:///system
	W0811 23:01:23.405311    7826 start.go:809] api.Load failed for download-only-462841: filestore "download-only-462841": Docker machine "download-only-462841" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0811 23:01:23.429759    7826 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:01:23.429844    7826 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:01:23.520667    7826 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-08-11 23:01:23.509881046 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:01:23.520776    7826 docker.go:294] overlay module found
	I0811 23:01:23.522575    7826 out.go:97] Using the docker driver based on existing profile
	I0811 23:01:23.522597    7826 start.go:298] selected driver: docker
	I0811 23:01:23.522602    7826 start.go:901] validating driver "docker" against &{Name:download-only-462841 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:download-only-462841 Namespace:default APIServerName:
minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnet
ClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:01:23.522785    7826 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:01:23.594038    7826 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-08-11 23:01:23.584198848 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:01:23.594496    7826 cni.go:84] Creating CNI manager for ""
	I0811 23:01:23.594512    7826 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0811 23:01:23.594523    7826 start_flags.go:319] config:
	{Name:download-only-462841 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0-rc.0 ClusterName:download-only-462841 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contai
nerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:01:23.596728    7826 out.go:97] Starting control plane node download-only-462841 in cluster download-only-462841
	I0811 23:01:23.596757    7826 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0811 23:01:23.598861    7826 out.go:97] Pulling base image ...
	I0811 23:01:23.598892    7826 preload.go:132] Checking if preload exists for k8s version v1.28.0-rc.0 and runtime containerd
	I0811 23:01:23.598988    7826 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local docker daemon
	I0811 23:01:23.617364    7826 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 to local cache
	I0811 23:01:23.617467    7826 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local cache directory
	I0811 23:01:23.617504    7826 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 in local cache directory, skipping pull
	I0811 23:01:23.617513    7826 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 exists in cache, skipping pull
	I0811 23:01:23.617525    7826 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 as a tarball
	I0811 23:01:23.661346    7826 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.0-rc.0/preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4
	I0811 23:01:23.661370    7826 cache.go:57] Caching tarball of preloaded images
	I0811 23:01:23.661517    7826 preload.go:132] Checking if preload exists for k8s version v1.28.0-rc.0 and runtime containerd
	I0811 23:01:23.663684    7826 out.go:97] Downloading Kubernetes v1.28.0-rc.0 preload ...
	I0811 23:01:23.663716    7826 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:01:23.785766    7826 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.0-rc.0/preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:39f739e266016260458f36b9cb5729c9 -> /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4
	I0811 23:01:44.436048    7826 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:01:44.436188    7826 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17044-2342/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-rc.0-containerd-overlay2-arm64.tar.lz4 ...
	I0811 23:01:45.289080    7826 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.0-rc.0 on containerd
	I0811 23:01:45.289242    7826 profile.go:148] Saving config to /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/download-only-462841/config.json ...
	I0811 23:01:45.289512    7826 preload.go:132] Checking if preload exists for k8s version v1.28.0-rc.0 and runtime containerd
	I0811 23:01:45.289782    7826 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.0-rc.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.0-rc.0/bin/linux/arm64/kubectl.sha256 -> /home/jenkins/minikube-integration/17044-2342/.minikube/cache/linux/arm64/v1.28.0-rc.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-462841"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.0-rc.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.24s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:187: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.24s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.16s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:199: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-462841
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.16s)

                                                
                                    
x
+
TestBinaryMirror (0.6s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:304: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-045057 --alsologtostderr --binary-mirror http://127.0.0.1:33227 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-045057" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-045057
--- PASS: TestBinaryMirror (0.60s)

                                                
                                    
x
+
TestAddons/Setup (142.34s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:88: (dbg) Run:  out/minikube-linux-arm64 start -p addons-796714 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns
addons_test.go:88: (dbg) Done: out/minikube-linux-arm64 start -p addons-796714 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns: (2m22.340542755s)
--- PASS: TestAddons/Setup (142.34s)

                                                
                                    
x
+
TestAddons/parallel/Registry (15.42s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:306: registry stabilized in 32.132042ms
addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-5fq8t" [4938621f-1e3d-4416-8891-7e69e530de46] Running
addons_test.go:308: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.027506233s
addons_test.go:311: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-qkpbr" [62399753-60b9-4d67-8c7f-0c5029bf1445] Running
addons_test.go:311: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.017873116s
addons_test.go:316: (dbg) Run:  kubectl --context addons-796714 delete po -l run=registry-test --now
addons_test.go:321: (dbg) Run:  kubectl --context addons-796714 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:321: (dbg) Done: kubectl --context addons-796714 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.141797768s)
addons_test.go:335: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 ip
2023/08/11 23:04:29 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (15.42s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.98s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-9h2fx" [bdf8c108-2780-4892-b70e-e2357cc007c8] Running
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.013229249s
addons_test.go:817: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-796714
addons_test.go:817: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-796714: (5.963005599s)
--- PASS: TestAddons/parallel/InspektorGadget (10.98s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.94s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:383: metrics-server stabilized in 4.807268ms
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-7746886d4f-pwr5j" [cce24f1f-d87f-4635-bd93-c72768e696f5] Running
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.013833799s
addons_test.go:391: (dbg) Run:  kubectl --context addons-796714 top pods -n kube-system
addons_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.94s)

                                                
                                    
x
+
TestAddons/parallel/CSI (64.62s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:537: csi-hostpath-driver pods stabilized in 8.188249ms
addons_test.go:540: (dbg) Run:  kubectl --context addons-796714 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:550: (dbg) Run:  kubectl --context addons-796714 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [ba05162f-c786-4620-afa0-0686a538db0f] Pending
helpers_test.go:344: "task-pv-pod" [ba05162f-c786-4620-afa0-0686a538db0f] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [ba05162f-c786-4620-afa0-0686a538db0f] Running
addons_test.go:555: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.032239816s
addons_test.go:560: (dbg) Run:  kubectl --context addons-796714 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-796714 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-796714 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:570: (dbg) Run:  kubectl --context addons-796714 delete pod task-pv-pod
addons_test.go:570: (dbg) Done: kubectl --context addons-796714 delete pod task-pv-pod: (1.883656946s)
addons_test.go:576: (dbg) Run:  kubectl --context addons-796714 delete pvc hpvc
addons_test.go:582: (dbg) Run:  kubectl --context addons-796714 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:587: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-796714 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:592: (dbg) Run:  kubectl --context addons-796714 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:597: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [d966c6ee-1335-43ae-853e-332ebe709c25] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [d966c6ee-1335-43ae-853e-332ebe709c25] Running
addons_test.go:597: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.01778408s
addons_test.go:602: (dbg) Run:  kubectl --context addons-796714 delete pod task-pv-pod-restore
addons_test.go:606: (dbg) Run:  kubectl --context addons-796714 delete pvc hpvc-restore
addons_test.go:610: (dbg) Run:  kubectl --context addons-796714 delete volumesnapshot new-snapshot-demo
addons_test.go:614: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:614: (dbg) Done: out/minikube-linux-arm64 -p addons-796714 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.974983313s)
addons_test.go:618: (dbg) Run:  out/minikube-linux-arm64 -p addons-796714 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (64.62s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (11.99s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:800: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-796714 --alsologtostderr -v=1
addons_test.go:800: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-796714 --alsologtostderr -v=1: (1.962351838s)
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-5c78f74d8d-4wf74" [117a9935-0cca-466a-89cd-c0cfa14082d7] Pending
helpers_test.go:344: "headlamp-5c78f74d8d-4wf74" [117a9935-0cca-466a-89cd-c0cfa14082d7] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-5c78f74d8d-4wf74" [117a9935-0cca-466a-89cd-c0cfa14082d7] Running
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.031046407s
--- PASS: TestAddons/parallel/Headlamp (11.99s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.7s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-d67854dc9-j6gcj" [cda9d343-a64c-499e-9876-f60d216d9589] Running
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.018975173s
addons_test.go:836: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-796714
--- PASS: TestAddons/parallel/CloudSpanner (5.70s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.24s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:626: (dbg) Run:  kubectl --context addons-796714 create ns new-namespace
addons_test.go:640: (dbg) Run:  kubectl --context addons-796714 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.24s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.36s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:148: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-796714
addons_test.go:148: (dbg) Done: out/minikube-linux-arm64 stop -p addons-796714: (12.077814885s)
addons_test.go:152: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-796714
addons_test.go:156: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-796714
addons_test.go:161: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-796714
--- PASS: TestAddons/StoppedEnableDisable (12.36s)

                                                
                                    
x
+
TestCertOptions (49.33s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-888884 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-888884 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (46.623646464s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-888884 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-888884 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-888884 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-888884" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-888884
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-888884: (1.995186467s)
--- PASS: TestCertOptions (49.33s)

                                                
                                    
x
+
TestCertExpiration (235.6s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-682146 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd
E0811 23:47:39.093205    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-682146 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (38.497748586s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-682146 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-682146 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (14.655020432s)
helpers_test.go:175: Cleaning up "cert-expiration-682146" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-682146
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-682146: (2.448294585s)
--- PASS: TestCertExpiration (235.60s)

                                                
                                    
x
+
TestForceSystemdFlag (53.85s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-641089 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-641089 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (51.270809923s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-641089 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-641089" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-641089
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-641089: (2.16040375s)
--- PASS: TestForceSystemdFlag (53.85s)

                                                
                                    
x
+
TestForceSystemdEnv (43.98s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-345312 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-345312 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (41.403239276s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-345312 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-345312" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-345312
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-345312: (2.214138457s)
--- PASS: TestForceSystemdEnv (43.98s)

                                                
                                    
x
+
TestDockerEnvContainerd (47.09s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux arm64
docker_test.go:181: (dbg) Run:  out/minikube-linux-arm64 start -p dockerenv-614003 --driver=docker  --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-arm64 start -p dockerenv-614003 --driver=docker  --container-runtime=containerd: (31.056721113s)
docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-614003"
docker_test.go:189: (dbg) Done: /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-614003": (1.476926954s)
docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-6lv8zqntGnHe/agent.23819" SSH_AGENT_PID="23822" DOCKER_HOST=ssh://docker@127.0.0.1:32777 docker version"
docker_test.go:243: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-6lv8zqntGnHe/agent.23819" SSH_AGENT_PID="23822" DOCKER_HOST=ssh://docker@127.0.0.1:32777 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"
docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-6lv8zqntGnHe/agent.23819" SSH_AGENT_PID="23822" DOCKER_HOST=ssh://docker@127.0.0.1:32777 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.377176075s)
docker_test.go:250: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-6lv8zqntGnHe/agent.23819" SSH_AGENT_PID="23822" DOCKER_HOST=ssh://docker@127.0.0.1:32777 docker image ls"
helpers_test.go:175: Cleaning up "dockerenv-614003" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p dockerenv-614003
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p dockerenv-614003: (2.003514465s)
--- PASS: TestDockerEnvContainerd (47.09s)

                                                
                                    
x
+
TestErrorSpam/setup (28.56s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-500692 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-500692 --driver=docker  --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-500692 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-500692 --driver=docker  --container-runtime=containerd: (28.558014208s)
--- PASS: TestErrorSpam/setup (28.56s)

                                                
                                    
x
+
TestErrorSpam/start (0.88s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 start --dry-run
--- PASS: TestErrorSpam/start (0.88s)

                                                
                                    
x
+
TestErrorSpam/status (1.15s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 status
--- PASS: TestErrorSpam/status (1.15s)

                                                
                                    
x
+
TestErrorSpam/pause (1.9s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 pause
--- PASS: TestErrorSpam/pause (1.90s)

                                                
                                    
x
+
TestErrorSpam/unpause (2.02s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 unpause
--- PASS: TestErrorSpam/unpause (2.02s)

                                                
                                    
x
+
TestErrorSpam/stop (1.48s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 stop: (1.283136256s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-500692 --log_dir /tmp/nospam-500692 stop
--- PASS: TestErrorSpam/stop (1.48s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/17044-2342/.minikube/files/etc/test/nested/copy/7670/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (83.6s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-582653 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-582653 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (1m23.595167129s)
--- PASS: TestFunctional/serial/StartWithProxy (83.60s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (15.62s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-582653 --alsologtostderr -v=8
E0811 23:09:15.076551    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:15.085636    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:15.096016    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:15.116337    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:15.156775    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:15.237099    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:15.397654    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:15.717972    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:16.358824    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:17.639439    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-582653 --alsologtostderr -v=8: (15.613670958s)
functional_test.go:659: soft start took 15.620114726s for "functional-582653" cluster.
--- PASS: TestFunctional/serial/SoftStart (15.62s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-582653 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (4.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 cache add registry.k8s.io/pause:3.1
E0811 23:09:20.199595    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 cache add registry.k8s.io/pause:3.1: (1.457959261s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 cache add registry.k8s.io/pause:3.3: (1.382005134s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 cache add registry.k8s.io/pause:latest: (1.238533955s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.08s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.51s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-582653 /tmp/TestFunctionalserialCacheCmdcacheadd_local797396394/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 cache add minikube-local-cache-test:functional-582653
functional_test.go:1085: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 cache add minikube-local-cache-test:functional-582653: (1.002094039s)
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 cache delete minikube-local-cache-test:functional-582653
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-582653
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.51s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.34s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.34s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.42s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh sudo crictl rmi registry.k8s.io/pause:latest
E0811 23:09:25.320723    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (345.215274ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 cache reload
functional_test.go:1154: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 cache reload: (1.398904378s)
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.42s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 kubectl -- --context functional-582653 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.16s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-582653 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.16s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (309.06s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-582653 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0811 23:09:35.561659    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:09:56.041978    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:10:37.002214    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:11:58.923153    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:14:15.074216    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-582653 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (5m9.063682788s)
functional_test.go:757: restart took 5m9.063785507s for "functional-582653" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (309.06s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-582653 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (2s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 logs: (1.997567478s)
--- PASS: TestFunctional/serial/LogsCmd (2.00s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (2.18s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 logs --file /tmp/TestFunctionalserialLogsFileCmd3888682950/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 logs --file /tmp/TestFunctionalserialLogsFileCmd3888682950/001/logs.txt: (2.173939541s)
--- PASS: TestFunctional/serial/LogsFileCmd (2.18s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (5.36s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-582653 apply -f testdata/invalidsvc.yaml
E0811 23:14:42.764256    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-582653
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-582653: exit status 115 (901.925446ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30079 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-582653 delete -f testdata/invalidsvc.yaml
functional_test.go:2323: (dbg) Done: kubectl --context functional-582653 delete -f testdata/invalidsvc.yaml: (1.099664941s)
--- PASS: TestFunctional/serial/InvalidService (5.36s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 config get cpus: exit status 14 (104.618121ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 config get cpus: exit status 14 (67.959533ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (9.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-582653 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-582653 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 49660: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (9.31s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-582653 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-582653 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (290.858947ms)

                                                
                                                
-- stdout --
	* [functional-582653] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17044
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0811 23:15:31.399527   49061 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:15:31.399725   49061 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:15:31.399738   49061 out.go:309] Setting ErrFile to fd 2...
	I0811 23:15:31.399745   49061 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:15:31.400034   49061 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:15:31.400471   49061 out.go:303] Setting JSON to false
	I0811 23:15:31.401456   49061 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":3478,"bootTime":1691792254,"procs":227,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:15:31.401526   49061 start.go:138] virtualization:  
	I0811 23:15:31.405351   49061 out.go:177] * [functional-582653] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:15:31.407538   49061 out.go:177]   - MINIKUBE_LOCATION=17044
	I0811 23:15:31.407732   49061 notify.go:220] Checking for updates...
	I0811 23:15:31.412385   49061 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:15:31.414818   49061 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:15:31.416926   49061 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:15:31.419000   49061 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0811 23:15:31.421378   49061 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0811 23:15:31.423964   49061 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:15:31.424480   49061 driver.go:373] Setting default libvirt URI to qemu:///system
	I0811 23:15:31.501954   49061 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:15:31.502063   49061 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:15:31.613564   49061 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:45 SystemTime:2023-08-11 23:15:31.601894586 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:15:31.613668   49061 docker.go:294] overlay module found
	I0811 23:15:31.616327   49061 out.go:177] * Using the docker driver based on existing profile
	I0811 23:15:31.618112   49061 start.go:298] selected driver: docker
	I0811 23:15:31.618125   49061 start.go:901] validating driver "docker" against &{Name:functional-582653 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:functional-582653 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersi
on:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:15:31.618227   49061 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0811 23:15:31.620765   49061 out.go:177] 
	W0811 23:15:31.622817   49061 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0811 23:15:31.624430   49061 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-582653 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.72s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-582653 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-582653 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (279.327763ms)

                                                
                                                
-- stdout --
	* [functional-582653] minikube v1.31.1 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17044
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0811 23:15:32.139826   49260 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:15:32.140012   49260 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:15:32.140023   49260 out.go:309] Setting ErrFile to fd 2...
	I0811 23:15:32.140029   49260 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:15:32.140421   49260 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:15:32.141891   49260 out.go:303] Setting JSON to false
	I0811 23:15:32.143214   49260 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":3479,"bootTime":1691792254,"procs":227,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:15:32.143368   49260 start.go:138] virtualization:  
	I0811 23:15:32.146208   49260 out.go:177] * [functional-582653] minikube v1.31.1 sur Ubuntu 20.04 (arm64)
	I0811 23:15:32.148970   49260 notify.go:220] Checking for updates...
	I0811 23:15:32.151643   49260 out.go:177]   - MINIKUBE_LOCATION=17044
	I0811 23:15:32.153676   49260 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:15:32.155652   49260 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:15:32.157676   49260 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:15:32.159518   49260 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0811 23:15:32.161236   49260 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0811 23:15:32.163285   49260 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:15:32.163814   49260 driver.go:373] Setting default libvirt URI to qemu:///system
	I0811 23:15:32.199470   49260 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:15:32.199587   49260 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:15:32.320916   49260 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:45 SystemTime:2023-08-11 23:15:32.310657309 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:15:32.321057   49260 docker.go:294] overlay module found
	I0811 23:15:32.323225   49260 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0811 23:15:32.324994   49260 start.go:298] selected driver: docker
	I0811 23:15:32.325013   49260 start.go:901] validating driver "docker" against &{Name:functional-582653 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1690799191-16971@sha256:e2b8a0768c6a1fd3ed0453a7caf63756620121eab0a25a3ecf9665353865fd37 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.4 ClusterName:functional-582653 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.4 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersi
on:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0811 23:15:32.325132   49260 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0811 23:15:32.327437   49260 out.go:177] 
	W0811 23:15:32.329593   49260 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0811 23:15:32.331834   49260 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (7.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-582653 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-582653 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-58d66798bb-ws2hg" [dadaa2c1-9a98-4747-a683-9d03f36e31ed] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-58d66798bb-ws2hg" [dadaa2c1-9a98-4747-a683-9d03f36e31ed] Running
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 7.016316125s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:31891
functional_test.go:1674: http://192.168.49.2:31891: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-58d66798bb-ws2hg

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31891
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (7.77s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (25.86s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [5650d9ee-c484-4c23-9b5f-fa8cd2abf42c] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.012246101s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-582653 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-582653 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-582653 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-582653 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [40833b0b-c4da-4a46-b608-6399a17f9e5c] Pending
helpers_test.go:344: "sp-pod" [40833b0b-c4da-4a46-b608-6399a17f9e5c] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [40833b0b-c4da-4a46-b608-6399a17f9e5c] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 10.019817489s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-582653 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-582653 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-582653 delete -f testdata/storage-provisioner/pod.yaml: (1.341064588s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-582653 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [7be66931-0953-4a92-aa05-24e636c2e007] Pending
helpers_test.go:344: "sp-pod" [7be66931-0953-4a92-aa05-24e636c2e007] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [7be66931-0953-4a92-aa05-24e636c2e007] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 8.023367812s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-582653 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (25.86s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.75s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.75s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh -n functional-582653 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 cp functional-582653:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd4287981606/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh -n functional-582653 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.47s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/7670/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo cat /etc/test/nested/copy/7670/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/7670.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo cat /etc/ssl/certs/7670.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/7670.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo cat /usr/share/ca-certificates/7670.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/76702.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo cat /etc/ssl/certs/76702.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/76702.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo cat /usr/share/ca-certificates/76702.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.26s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-582653 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo systemctl is-active docker"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 ssh "sudo systemctl is-active docker": exit status 1 (378.443932ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 ssh "sudo systemctl is-active crio": exit status 1 (388.257666ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.77s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 version --short
--- PASS: TestFunctional/parallel/Version/short (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 version -o=json --components
functional_test.go:2266: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 version -o=json --components: (1.331292826s)
--- PASS: TestFunctional/parallel/Version/components (1.33s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-582653 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.27.4
registry.k8s.io/kube-proxy:v1.27.4
registry.k8s.io/kube-controller-manager:v1.27.4
registry.k8s.io/kube-apiserver:v1.27.4
registry.k8s.io/etcd:3.5.7-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-582653
docker.io/kindest/kindnetd:v20230511-dc714da8
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-582653 image ls --format short --alsologtostderr:
I0811 23:15:39.566779   50491 out.go:296] Setting OutFile to fd 1 ...
I0811 23:15:39.567000   50491 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:39.567013   50491 out.go:309] Setting ErrFile to fd 2...
I0811 23:15:39.567035   50491 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:39.567297   50491 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
I0811 23:15:39.567902   50491 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:39.568020   50491 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:39.568468   50491 cli_runner.go:164] Run: docker container inspect functional-582653 --format={{.State.Status}}
I0811 23:15:39.592538   50491 ssh_runner.go:195] Run: systemctl --version
I0811 23:15:39.592596   50491 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-582653
I0811 23:15:39.613110   50491 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/functional-582653/id_rsa Username:docker}
I0811 23:15:39.713153   50491 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-582653 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | sha256:ba04bb | 8.03MB |
| registry.k8s.io/etcd                        | 3.5.7-0            | sha256:24bc64 | 80.7MB |
| docker.io/library/nginx                     | latest             | sha256:ff78c7 | 67.3MB |
| registry.k8s.io/kube-proxy                  | v1.27.4            | sha256:532e5a | 21.4MB |
| registry.k8s.io/pause                       | 3.9                | sha256:829e9d | 268kB  |
| docker.io/library/minikube-local-cache-test | functional-582653  | sha256:aa678a | 1.01kB |
| registry.k8s.io/pause                       | latest             | sha256:8cb209 | 71.3kB |
| docker.io/kindest/kindnetd                  | v20230511-dc714da8 | sha256:b18bf7 | 25.3MB |
| docker.io/library/nginx                     | alpine             | sha256:7987e0 | 16.4MB |
| registry.k8s.io/pause                       | 3.1                | sha256:8057e0 | 262kB  |
| registry.k8s.io/kube-apiserver              | v1.27.4            | sha256:64aece | 30.4MB |
| registry.k8s.io/kube-controller-manager     | v1.27.4            | sha256:389f6f | 28.2MB |
| registry.k8s.io/kube-scheduler              | v1.27.4            | sha256:6eb638 | 16.6MB |
| registry.k8s.io/pause                       | 3.3                | sha256:3d1873 | 249kB  |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | sha256:1611cd | 1.94MB |
| registry.k8s.io/coredns/coredns             | v1.10.1            | sha256:97e046 | 14.6MB |
| registry.k8s.io/echoserver-arm              | 1.8                | sha256:72565b | 45.3MB |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-582653 image ls --format table --alsologtostderr:
I0811 23:15:41.997094   50741 out.go:296] Setting OutFile to fd 1 ...
I0811 23:15:41.997346   50741 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:41.997358   50741 out.go:309] Setting ErrFile to fd 2...
I0811 23:15:41.997365   50741 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:41.997757   50741 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
I0811 23:15:41.999358   50741 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:41.999646   50741 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:42.001047   50741 cli_runner.go:164] Run: docker container inspect functional-582653 --format={{.State.Status}}
I0811 23:15:42.033001   50741 ssh_runner.go:195] Run: systemctl --version
I0811 23:15:42.033053   50741 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-582653
I0811 23:15:42.058048   50741 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/functional-582653/id_rsa Username:docker}
I0811 23:15:42.169301   50741 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-582653 image ls --format json --alsologtostderr:
[{"id":"sha256:ff78c7a65ec2b1fb09f58b27b0dd022ac1f4e16b9bcfe1cbdc18c36f2e0e1842","repoDigests":["docker.io/library/nginx@sha256:67f9a4f10d147a6e04629340e6493c9703300ca23a2f7f3aa56fe615d75d31ca"],"repoTags":["docker.io/library/nginx:latest"],"size":"67306163"},{"id":"sha256:532e5a30e948f1c084333316b13e68fbeff8df667f3830b082005127a6d86317","repoDigests":["registry.k8s.io/kube-proxy@sha256:4bcb707da9898d2625f5d4edc6d0c96519a24f16db914fc673aa8f97e41dbabf"],"repoTags":["registry.k8s.io/kube-proxy:v1.27.4"],"size":"21370483"},{"id":"sha256:b18bf71b941bae2e12db1c07e567ad14e4febbc778310a0fc64487f1ac877d79","repoDigests":["docker.io/kindest/kindnetd@sha256:6c00e28db008c2afa67d9ee085c86184ec9ae5281d5ae1bd15006746fb9a1974"],"repoTags":["docker.io/kindest/kindnetd:v20230511-dc714da8"],"size":"25334607"},{"id":"sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"re
poTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"8034419"},{"id":"sha256:389f6f052cf83156f82a2bbbf6ea2c24292d246b58900d91f6a1707eacf510b2","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:6286e500782ad6d0b37a1b8be57fc73f597dc931dfc73ff18ce534059803b265"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.27.4"],"size":"28222966"},{"id":"sha256:24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737","repoDigests":["registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83"],"repoTags":["registry.k8s.io/etcd:3.5.7-0"],"size":"80665728"},{"id":"sha256:6eb63895cb67fce76da3ed6eaaa865ff55e7c761c9e6a691a83855ff0987a085","repoDigests":["registry.k8s.io/kube-scheduler@sha256:5897d7a97d23dce25cbf36fcd6e919180a8ef904bf5156583ffdb6a733ab04af"],"repoTags":["registry.k8s.io/kube-scheduler:v1.27.4"],"size":"16552982"},{"id":"sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":["registry.k8s.io/pause@sha256:7031c1
b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"268051"},{"id":"sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"71300"},{"id":"sha256:7987e0c18af05e20ea2f672d05e2fe43960553df199d00536b89ea5514c1cf36","repoDigests":["docker.io/library/nginx@sha256:647c5c83418c19eef0cddc647b9899326e3081576390c4c7baa4fce545123b6c"],"repoTags":["docker.io/library/nginx:alpine"],"size":"16361831"},{"id":"sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"1935750"},{"id":"sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["reg
istry.k8s.io/echoserver-arm:1.8"],"size":"45324675"},{"id":"sha256:97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":["registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e"],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"14557471"},{"id":"sha256:64aece92d6bde5b472d8185fcd2d5ab1add8814923a26561821f7cab5e819388","repoDigests":["registry.k8s.io/kube-apiserver@sha256:697cd88d94f7f2ef42144cb3072b016dcb2e9251f0e7d41a7fede557e555452d"],"repoTags":["registry.k8s.io/kube-apiserver:v1.27.4"],"size":"30391720"},{"id":"sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"262191"},{"id":"sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"249461"},{"id":"sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kuber
netesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"74084559"},{"id":"sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"18306114"},{"id":"sha256:aa678afb299f04f7efeceaeed98692a8cb3a80d2a4042b6fbc9d0f8e9d6b4f20","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-582653"],"size":"1006"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-582653 image ls --format json --alsologtostderr:
I0811 23:15:41.702635   50713 out.go:296] Setting OutFile to fd 1 ...
I0811 23:15:41.702832   50713 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:41.702845   50713 out.go:309] Setting ErrFile to fd 2...
I0811 23:15:41.702851   50713 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:41.703189   50713 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
I0811 23:15:41.703828   50713 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:41.703987   50713 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:41.704489   50713 cli_runner.go:164] Run: docker container inspect functional-582653 --format={{.State.Status}}
I0811 23:15:41.725960   50713 ssh_runner.go:195] Run: systemctl --version
I0811 23:15:41.726019   50713 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-582653
I0811 23:15:41.745053   50713 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/functional-582653/id_rsa Username:docker}
I0811 23:15:41.852791   50713 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-582653 image ls --format yaml --alsologtostderr:
- id: sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "74084559"
- id: sha256:aa678afb299f04f7efeceaeed98692a8cb3a80d2a4042b6fbc9d0f8e9d6b4f20
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-582653
size: "1006"
- id: sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "45324675"
- id: sha256:64aece92d6bde5b472d8185fcd2d5ab1add8814923a26561821f7cab5e819388
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:697cd88d94f7f2ef42144cb3072b016dcb2e9251f0e7d41a7fede557e555452d
repoTags:
- registry.k8s.io/kube-apiserver:v1.27.4
size: "30391720"
- id: sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "1935750"
- id: sha256:24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737
repoDigests:
- registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83
repoTags:
- registry.k8s.io/etcd:3.5.7-0
size: "80665728"
- id: sha256:389f6f052cf83156f82a2bbbf6ea2c24292d246b58900d91f6a1707eacf510b2
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:6286e500782ad6d0b37a1b8be57fc73f597dc931dfc73ff18ce534059803b265
repoTags:
- registry.k8s.io/kube-controller-manager:v1.27.4
size: "28222966"
- id: sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "262191"
- id: sha256:b18bf71b941bae2e12db1c07e567ad14e4febbc778310a0fc64487f1ac877d79
repoDigests:
- docker.io/kindest/kindnetd@sha256:6c00e28db008c2afa67d9ee085c86184ec9ae5281d5ae1bd15006746fb9a1974
repoTags:
- docker.io/kindest/kindnetd:v20230511-dc714da8
size: "25334607"
- id: sha256:532e5a30e948f1c084333316b13e68fbeff8df667f3830b082005127a6d86317
repoDigests:
- registry.k8s.io/kube-proxy@sha256:4bcb707da9898d2625f5d4edc6d0c96519a24f16db914fc673aa8f97e41dbabf
repoTags:
- registry.k8s.io/kube-proxy:v1.27.4
size: "21370483"
- id: sha256:6eb63895cb67fce76da3ed6eaaa865ff55e7c761c9e6a691a83855ff0987a085
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:5897d7a97d23dce25cbf36fcd6e919180a8ef904bf5156583ffdb6a733ab04af
repoTags:
- registry.k8s.io/kube-scheduler:v1.27.4
size: "16552982"
- id: sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "249461"
- id: sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "71300"
- id: sha256:7987e0c18af05e20ea2f672d05e2fe43960553df199d00536b89ea5514c1cf36
repoDigests:
- docker.io/library/nginx@sha256:647c5c83418c19eef0cddc647b9899326e3081576390c4c7baa4fce545123b6c
repoTags:
- docker.io/library/nginx:alpine
size: "16361831"
- id: sha256:ff78c7a65ec2b1fb09f58b27b0dd022ac1f4e16b9bcfe1cbdc18c36f2e0e1842
repoDigests:
- docker.io/library/nginx@sha256:67f9a4f10d147a6e04629340e6493c9703300ca23a2f7f3aa56fe615d75d31ca
repoTags:
- docker.io/library/nginx:latest
size: "67306163"
- id: sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "8034419"
- id: sha256:97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "14557471"
- id: sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests:
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
repoTags:
- registry.k8s.io/pause:3.9
size: "268051"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-582653 image ls --format yaml --alsologtostderr:
I0811 23:15:39.860584   50521 out.go:296] Setting OutFile to fd 1 ...
I0811 23:15:39.860841   50521 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:39.860863   50521 out.go:309] Setting ErrFile to fd 2...
I0811 23:15:39.860882   50521 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:39.861167   50521 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
I0811 23:15:39.861758   50521 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:39.861901   50521 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:39.862367   50521 cli_runner.go:164] Run: docker container inspect functional-582653 --format={{.State.Status}}
I0811 23:15:39.881309   50521 ssh_runner.go:195] Run: systemctl --version
I0811 23:15:39.881358   50521 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-582653
I0811 23:15:39.900779   50521 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/functional-582653/id_rsa Username:docker}
I0811 23:15:40.026176   50521 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 ssh pgrep buildkitd: exit status 1 (433.031646ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image build -t localhost/my-image:functional-582653 testdata/build --alsologtostderr
2023/08/11 23:15:41 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-582653 image build -t localhost/my-image:functional-582653 testdata/build --alsologtostderr: (2.700109824s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-582653 image build -t localhost/my-image:functional-582653 testdata/build --alsologtostderr:
I0811 23:15:40.633702   50602 out.go:296] Setting OutFile to fd 1 ...
I0811 23:15:40.634063   50602 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:40.634091   50602 out.go:309] Setting ErrFile to fd 2...
I0811 23:15:40.634121   50602 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0811 23:15:40.634765   50602 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
I0811 23:15:40.639719   50602 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:40.640318   50602 config.go:182] Loaded profile config "functional-582653": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
I0811 23:15:40.640852   50602 cli_runner.go:164] Run: docker container inspect functional-582653 --format={{.State.Status}}
I0811 23:15:40.660328   50602 ssh_runner.go:195] Run: systemctl --version
I0811 23:15:40.660387   50602 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-582653
I0811 23:15:40.681002   50602 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/functional-582653/id_rsa Username:docker}
I0811 23:15:40.784603   50602 build_images.go:151] Building image from path: /tmp/build.439460016.tar
I0811 23:15:40.784676   50602 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0811 23:15:40.797073   50602 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.439460016.tar
I0811 23:15:40.801835   50602 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.439460016.tar: stat -c "%s %y" /var/lib/minikube/build/build.439460016.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.439460016.tar': No such file or directory
I0811 23:15:40.801906   50602 ssh_runner.go:362] scp /tmp/build.439460016.tar --> /var/lib/minikube/build/build.439460016.tar (3072 bytes)
I0811 23:15:40.836456   50602 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.439460016
I0811 23:15:40.866773   50602 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.439460016 -xf /var/lib/minikube/build/build.439460016.tar
I0811 23:15:40.893585   50602 containerd.go:378] Building image: /var/lib/minikube/build/build.439460016
I0811 23:15:40.893655   50602 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.439460016 --local dockerfile=/var/lib/minikube/build/build.439460016 --output type=image,name=localhost/my-image:functional-582653
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 97B done
#2 DONE 0.0s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.8s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.2s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.1s done
#5 DONE 0.4s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.7s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:5f55ea2b5ce7d0545bf2e05ac5a162d68715fbdc4dcb4e3361c4d62511c2afa5 0.0s done
#8 exporting config sha256:9484bb8083a4f8712fbd1a9a24298322cfc797e057cfd75c18b7bbee9a3d8b31
#8 exporting config sha256:9484bb8083a4f8712fbd1a9a24298322cfc797e057cfd75c18b7bbee9a3d8b31 0.0s done
#8 naming to localhost/my-image:functional-582653 done
#8 DONE 0.1s
I0811 23:15:43.242700   50602 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.439460016 --local dockerfile=/var/lib/minikube/build/build.439460016 --output type=image,name=localhost/my-image:functional-582653: (2.349016925s)
I0811 23:15:43.242767   50602 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.439460016
I0811 23:15:43.254001   50602 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.439460016.tar
I0811 23:15:43.264509   50602 build_images.go:207] Built localhost/my-image:functional-582653 from /tmp/build.439460016.tar
I0811 23:15:43.264537   50602 build_images.go:123] succeeded building to: functional-582653
I0811 23:15:43.264542   50602 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.38s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.93s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (1.889364599s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-582653
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.93s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (10.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-582653 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-582653 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-7b684b55f9-q2cpz" [67223a54-fc3d-4d7b-869a-aa3b666383a6] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-7b684b55f9-q2cpz" [67223a54-fc3d-4d7b-869a-aa3b666383a6] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 10.031513353s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (10.36s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.52s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 service list -o json
functional_test.go:1493: Took "521.569908ms" to run "out/minikube-linux-arm64 -p functional-582653 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.52s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.49.2:32279
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.52s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.52s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:32279
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image rm gcr.io/google-containers/addon-resizer:functional-582653 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.65s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.78s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-582653
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 image save --daemon gcr.io/google-containers/addon-resizer:functional-582653 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-582653
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.78s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.8s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-582653 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-582653 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-582653 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-582653 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 47248: os: process already finished
helpers_test.go:502: unable to terminate pid 47118: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.80s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-582653 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-582653 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [768f5ce0-a563-4f78-95a8-fc75d65c8e2e] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [768f5ce0-a563-4f78-95a8-fc75d65c8e2e] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.020290703s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.49s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-582653 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.97.71.117 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-582653 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.49s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1314: Took "368.267791ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1328: Took "57.551414ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.43s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1365: Took "341.96783ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1378: Took "59.789412ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdany-port2591608468/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1691795724883511478" to /tmp/TestFunctionalparallelMountCmdany-port2591608468/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1691795724883511478" to /tmp/TestFunctionalparallelMountCmdany-port2591608468/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1691795724883511478" to /tmp/TestFunctionalparallelMountCmdany-port2591608468/001/test-1691795724883511478
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (390.183424ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Aug 11 23:15 created-by-test
-rw-r--r-- 1 docker docker 24 Aug 11 23:15 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Aug 11 23:15 test-1691795724883511478
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh cat /mount-9p/test-1691795724883511478
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-582653 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [ccf2cd3d-4d8a-4bee-9d97-1d30e80b094d] Pending
helpers_test.go:344: "busybox-mount" [ccf2cd3d-4d8a-4bee-9d97-1d30e80b094d] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [ccf2cd3d-4d8a-4bee-9d97-1d30e80b094d] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [ccf2cd3d-4d8a-4bee-9d97-1d30e80b094d] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.028344505s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-582653 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdany-port2591608468/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.45s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdspecific-port4268882542/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (596.351586ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdspecific-port4268882542/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 ssh "sudo umount -f /mount-9p": exit status 1 (422.841294ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-582653 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdspecific-port4268882542/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.73s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (2.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3177799101/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3177799101/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3177799101/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T" /mount1: exit status 1 (823.873939ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-582653 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-582653 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3177799101/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3177799101/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-582653 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3177799101/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (2.33s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.08s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-582653
--- PASS: TestFunctional/delete_addon-resizer_images (0.08s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-582653
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-582653
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (103.78s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-arm64 start -p ingress-addon-legacy-508070 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-arm64 start -p ingress-addon-legacy-508070 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (1m43.781548855s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (103.78s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (8.08s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-508070 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-508070 addons enable ingress --alsologtostderr -v=5: (8.080965347s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (8.08s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.82s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-508070 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.82s)

                                                
                                    
x
+
TestJSONOutput/start/Command (67.2s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-445552 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
E0811 23:19:15.073395    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-445552 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (1m7.19864617s)
--- PASS: TestJSONOutput/start/Command (67.20s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.79s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-445552 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.79s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.75s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-445552 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.75s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.85s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-445552 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-445552 --output=json --user=testUser: (5.849378847s)
--- PASS: TestJSONOutput/stop/Command (5.85s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.22s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-278617 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-278617 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (77.253936ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"1b450e51-9265-45c6-8205-93686fc129d3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-278617] minikube v1.31.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"9f5e7fe2-c365-4bfc-af58-2b3d347920e3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17044"}}
	{"specversion":"1.0","id":"68f2a933-574c-4fb6-9157-0af786b482ee","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"9d112290-4eee-4e9c-abc8-05eab37a3a46","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig"}}
	{"specversion":"1.0","id":"48c09f94-9a1d-46aa-a70e-2f28ef81e214","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube"}}
	{"specversion":"1.0","id":"2bb5f88d-3d3e-4ec8-ab9b-4be9ac9f0038","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"eed59ebd-c5e1-4615-ba52-ceabb42420dd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"829bc957-590c-4e12-af18-247786c909c8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-278617" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-278617
--- PASS: TestErrorJSONOutput (0.22s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (44.7s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-622337 --network=
E0811 23:19:56.501277    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0811 23:20:01.622356    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0811 23:20:11.862567    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0811 23:20:32.342816    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-622337 --network=: (42.494399473s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-622337" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-622337
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-622337: (2.174093557s)
--- PASS: TestKicCustomNetwork/create_custom_network (44.70s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (33.78s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-687418 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-687418 --network=bridge: (31.782092845s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-687418" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-687418
E0811 23:21:13.303766    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-687418: (1.966090683s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (33.78s)

                                                
                                    
x
+
TestKicExistingNetwork (35.2s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-960846 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-960846 --network=existing-network: (33.011709991s)
helpers_test.go:175: Cleaning up "existing-network-960846" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-960846
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-960846: (2.020220969s)
--- PASS: TestKicExistingNetwork (35.20s)

                                                
                                    
x
+
TestKicCustomSubnet (37.34s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-846441 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-846441 --subnet=192.168.60.0/24: (35.174961959s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-846441 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-846441" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-846441
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-846441: (2.134632943s)
--- PASS: TestKicCustomSubnet (37.34s)

                                                
                                    
x
+
TestKicStaticIP (34.1s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-344900 --static-ip=192.168.200.200
E0811 23:22:35.224478    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0811 23:22:39.092519    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:39.099699    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:39.109932    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:39.130177    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:39.170438    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:39.250711    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:39.411085    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:39.731622    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:40.372491    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:41.653634    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:44.214342    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:22:49.335302    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-344900 --static-ip=192.168.200.200: (31.713524494s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-344900 ip
helpers_test.go:175: Cleaning up "static-ip-344900" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-344900
E0811 23:22:59.576456    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-344900: (2.210360257s)
--- PASS: TestKicStaticIP (34.10s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (84.62s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-098603 --driver=docker  --container-runtime=containerd
E0811 23:23:20.056660    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-098603 --driver=docker  --container-runtime=containerd: (33.170386826s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-101672 --driver=docker  --container-runtime=containerd
E0811 23:24:01.016861    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:24:15.073226    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-101672 --driver=docker  --container-runtime=containerd: (45.601412382s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-098603
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-101672
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-101672" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-101672
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-101672: (2.058047763s)
helpers_test.go:175: Cleaning up "first-098603" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-098603
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-098603: (2.463211082s)
--- PASS: TestMinikubeProfile (84.62s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (6.78s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-146107 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-146107 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.781850167s)
--- PASS: TestMountStart/serial/StartWithMountFirst (6.78s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-146107 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.29s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (6.82s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-148068 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-148068 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.817213476s)
--- PASS: TestMountStart/serial/StartWithMountSecond (6.82s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-148068 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.29s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.7s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-146107 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-146107 --alsologtostderr -v=5: (1.703220672s)
--- PASS: TestMountStart/serial/DeleteFirst (1.70s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-148068 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.28s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.23s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-148068
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-148068: (1.229870053s)
--- PASS: TestMountStart/serial/Stop (1.23s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.55s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-148068
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-148068: (6.554002482s)
--- PASS: TestMountStart/serial/RestartStopped (7.55s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-148068 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.29s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (109.51s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-870658 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0811 23:25:19.065348    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0811 23:25:22.937164    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:25:38.125100    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p multinode-870658 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m48.928820669s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (109.51s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (4.91s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-870658 -- rollout status deployment/busybox: (2.756246617s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-84rr7 -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-zlvhz -- nslookup kubernetes.io
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-84rr7 -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-zlvhz -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-84rr7 -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-zlvhz -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (4.91s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.11s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-84rr7 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-84rr7 -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-zlvhz -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-870658 -- exec busybox-67b7f59bb-zlvhz -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.11s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (18.01s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-870658 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-870658 -v 3 --alsologtostderr: (17.258269071s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (18.01s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.35s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (11.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp testdata/cp-test.txt multinode-870658:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile643139570/001/cp-test_multinode-870658.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658:/home/docker/cp-test.txt multinode-870658-m02:/home/docker/cp-test_multinode-870658_multinode-870658-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m02 "sudo cat /home/docker/cp-test_multinode-870658_multinode-870658-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658:/home/docker/cp-test.txt multinode-870658-m03:/home/docker/cp-test_multinode-870658_multinode-870658-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m03 "sudo cat /home/docker/cp-test_multinode-870658_multinode-870658-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp testdata/cp-test.txt multinode-870658-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile643139570/001/cp-test_multinode-870658-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658-m02:/home/docker/cp-test.txt multinode-870658:/home/docker/cp-test_multinode-870658-m02_multinode-870658.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658 "sudo cat /home/docker/cp-test_multinode-870658-m02_multinode-870658.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658-m02:/home/docker/cp-test.txt multinode-870658-m03:/home/docker/cp-test_multinode-870658-m02_multinode-870658-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m03 "sudo cat /home/docker/cp-test_multinode-870658-m02_multinode-870658-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp testdata/cp-test.txt multinode-870658-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile643139570/001/cp-test_multinode-870658-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658-m03:/home/docker/cp-test.txt multinode-870658:/home/docker/cp-test_multinode-870658-m03_multinode-870658.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658 "sudo cat /home/docker/cp-test_multinode-870658-m03_multinode-870658.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 cp multinode-870658-m03:/home/docker/cp-test.txt multinode-870658-m02:/home/docker/cp-test_multinode-870658-m03_multinode-870658-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 ssh -n multinode-870658-m02 "sudo cat /home/docker/cp-test_multinode-870658-m03_multinode-870658-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (11.17s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.4s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-arm64 -p multinode-870658 node stop m03: (1.231959809s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-870658 status: exit status 7 (557.67562ms)

                                                
                                                
-- stdout --
	multinode-870658
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-870658-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-870658-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-870658 status --alsologtostderr: exit status 7 (605.515278ms)

                                                
                                                
-- stdout --
	multinode-870658
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-870658-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-870658-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0811 23:27:19.566300   98246 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:27:19.566479   98246 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:27:19.566489   98246 out.go:309] Setting ErrFile to fd 2...
	I0811 23:27:19.566495   98246 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:27:19.566792   98246 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:27:19.566998   98246 out.go:303] Setting JSON to false
	I0811 23:27:19.567093   98246 mustload.go:65] Loading cluster: multinode-870658
	I0811 23:27:19.567186   98246 notify.go:220] Checking for updates...
	I0811 23:27:19.567512   98246 config.go:182] Loaded profile config "multinode-870658": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:27:19.567525   98246 status.go:255] checking status of multinode-870658 ...
	I0811 23:27:19.568046   98246 cli_runner.go:164] Run: docker container inspect multinode-870658 --format={{.State.Status}}
	I0811 23:27:19.588596   98246 status.go:330] multinode-870658 host status = "Running" (err=<nil>)
	I0811 23:27:19.588650   98246 host.go:66] Checking if "multinode-870658" exists ...
	I0811 23:27:19.588943   98246 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-870658
	I0811 23:27:19.608333   98246 host.go:66] Checking if "multinode-870658" exists ...
	I0811 23:27:19.608714   98246 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:27:19.608767   98246 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-870658
	I0811 23:27:19.644432   98246 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32853 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/multinode-870658/id_rsa Username:docker}
	I0811 23:27:19.745705   98246 ssh_runner.go:195] Run: systemctl --version
	I0811 23:27:19.751494   98246 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0811 23:27:19.765517   98246 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:27:19.852507   98246 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:55 SystemTime:2023-08-11 23:27:19.842286765 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:27:19.853172   98246 kubeconfig.go:92] found "multinode-870658" server: "https://192.168.58.2:8443"
	I0811 23:27:19.853194   98246 api_server.go:166] Checking apiserver status ...
	I0811 23:27:19.853239   98246 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0811 23:27:19.867150   98246 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1302/cgroup
	I0811 23:27:19.881235   98246 api_server.go:182] apiserver freezer: "9:freezer:/docker/e7e2fcafa0220d9311a9ac315bfcd56029b95e7f6a0a566e9c4555f074c074be/kubepods/burstable/poda0ef9ea7502cce25c2bc519bc387b762/fe390d44fde134b7448c425d903a4df0d3119f7dfddf31ae4a35e32daf6866d0"
	I0811 23:27:19.881361   98246 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/e7e2fcafa0220d9311a9ac315bfcd56029b95e7f6a0a566e9c4555f074c074be/kubepods/burstable/poda0ef9ea7502cce25c2bc519bc387b762/fe390d44fde134b7448c425d903a4df0d3119f7dfddf31ae4a35e32daf6866d0/freezer.state
	I0811 23:27:19.892392   98246 api_server.go:204] freezer state: "THAWED"
	I0811 23:27:19.892420   98246 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0811 23:27:19.901352   98246 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0811 23:27:19.901380   98246 status.go:421] multinode-870658 apiserver status = Running (err=<nil>)
	I0811 23:27:19.901409   98246 status.go:257] multinode-870658 status: &{Name:multinode-870658 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0811 23:27:19.901432   98246 status.go:255] checking status of multinode-870658-m02 ...
	I0811 23:27:19.901762   98246 cli_runner.go:164] Run: docker container inspect multinode-870658-m02 --format={{.State.Status}}
	I0811 23:27:19.920157   98246 status.go:330] multinode-870658-m02 host status = "Running" (err=<nil>)
	I0811 23:27:19.920182   98246 host.go:66] Checking if "multinode-870658-m02" exists ...
	I0811 23:27:19.920497   98246 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-870658-m02
	I0811 23:27:19.944787   98246 host.go:66] Checking if "multinode-870658-m02" exists ...
	I0811 23:27:19.945078   98246 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0811 23:27:19.945131   98246 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-870658-m02
	I0811 23:27:19.970883   98246 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32858 SSHKeyPath:/home/jenkins/minikube-integration/17044-2342/.minikube/machines/multinode-870658-m02/id_rsa Username:docker}
	I0811 23:27:20.078185   98246 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0811 23:27:20.093767   98246 status.go:257] multinode-870658-m02 status: &{Name:multinode-870658-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0811 23:27:20.093807   98246 status.go:255] checking status of multinode-870658-m03 ...
	I0811 23:27:20.094208   98246 cli_runner.go:164] Run: docker container inspect multinode-870658-m03 --format={{.State.Status}}
	I0811 23:27:20.115265   98246 status.go:330] multinode-870658-m03 host status = "Stopped" (err=<nil>)
	I0811 23:27:20.115288   98246 status.go:343] host is not running, skipping remaining checks
	I0811 23:27:20.115296   98246 status.go:257] multinode-870658-m03 status: &{Name:multinode-870658-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.40s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (13.11s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Done: out/minikube-linux-arm64 -p multinode-870658 node start m03 --alsologtostderr: (12.211633973s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (13.11s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (136.59s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-870658
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-870658
E0811 23:27:39.092698    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
multinode_test.go:290: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-870658: (25.211575325s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-870658 --wait=true -v=8 --alsologtostderr
E0811 23:28:06.778757    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:29:15.074239    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-arm64 start -p multinode-870658 --wait=true -v=8 --alsologtostderr: (1m51.250401643s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-870658
--- PASS: TestMultiNode/serial/RestartKeepsNodes (136.59s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.18s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 node delete m03
E0811 23:29:51.381211    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
multinode_test.go:394: (dbg) Done: out/minikube-linux-arm64 -p multinode-870658 node delete m03: (4.395822626s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.18s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (24.18s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 stop
multinode_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p multinode-870658 stop: (23.998416213s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-870658 status: exit status 7 (85.818391ms)

                                                
                                                
-- stdout --
	multinode-870658
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-870658-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-870658 status --alsologtostderr: exit status 7 (91.351879ms)

                                                
                                                
-- stdout --
	multinode-870658
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-870658-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0811 23:30:19.133070  106956 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:30:19.133476  106956 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:30:19.133487  106956 out.go:309] Setting ErrFile to fd 2...
	I0811 23:30:19.133493  106956 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:30:19.133768  106956 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:30:19.133958  106956 out.go:303] Setting JSON to false
	I0811 23:30:19.134025  106956 mustload.go:65] Loading cluster: multinode-870658
	I0811 23:30:19.134418  106956 config.go:182] Loaded profile config "multinode-870658": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:30:19.134435  106956 status.go:255] checking status of multinode-870658 ...
	I0811 23:30:19.134928  106956 cli_runner.go:164] Run: docker container inspect multinode-870658 --format={{.State.Status}}
	I0811 23:30:19.135505  106956 notify.go:220] Checking for updates...
	I0811 23:30:19.153988  106956 status.go:330] multinode-870658 host status = "Stopped" (err=<nil>)
	I0811 23:30:19.154012  106956 status.go:343] host is not running, skipping remaining checks
	I0811 23:30:19.154020  106956 status.go:257] multinode-870658 status: &{Name:multinode-870658 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0811 23:30:19.154045  106956 status.go:255] checking status of multinode-870658-m02 ...
	I0811 23:30:19.154357  106956 cli_runner.go:164] Run: docker container inspect multinode-870658-m02 --format={{.State.Status}}
	I0811 23:30:19.172055  106956 status.go:330] multinode-870658-m02 host status = "Stopped" (err=<nil>)
	I0811 23:30:19.172078  106956 status.go:343] host is not running, skipping remaining checks
	I0811 23:30:19.172085  106956 status.go:257] multinode-870658-m02 status: &{Name:multinode-870658-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (24.18s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (94.82s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-870658 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
multinode_test.go:354: (dbg) Done: out/minikube-linux-arm64 start -p multinode-870658 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m33.930955696s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-arm64 -p multinode-870658 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (94.82s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (35.86s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-870658
multinode_test.go:452: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-870658-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-870658-m02 --driver=docker  --container-runtime=containerd: exit status 14 (89.494362ms)

                                                
                                                
-- stdout --
	* [multinode-870658-m02] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17044
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-870658-m02' is duplicated with machine name 'multinode-870658-m02' in profile 'multinode-870658'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-870658-m03 --driver=docker  --container-runtime=containerd
multinode_test.go:460: (dbg) Done: out/minikube-linux-arm64 start -p multinode-870658-m03 --driver=docker  --container-runtime=containerd: (33.297857845s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-870658
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-870658: exit status 80 (377.821964ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-870658
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-870658-m03 already exists in multinode-870658-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-870658-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-870658-m03: (2.033832841s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (35.86s)

                                                
                                    
x
+
TestPreload (184.77s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-897887 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4
E0811 23:32:39.092305    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-897887 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4: (1m13.716542912s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-897887 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-897887 image pull gcr.io/k8s-minikube/busybox: (1.459707973s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-897887
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-897887: (12.00094625s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-897887 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd
E0811 23:34:15.073697    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:34:51.381287    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-897887 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd: (1m34.930880231s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-897887 image list
helpers_test.go:175: Cleaning up "test-preload-897887" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-897887
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-897887: (2.390539293s)
--- PASS: TestPreload (184.77s)

                                                
                                    
x
+
TestScheduledStopUnix (111.52s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-611203 --memory=2048 --driver=docker  --container-runtime=containerd
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-611203 --memory=2048 --driver=docker  --container-runtime=containerd: (34.8093173s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-611203 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-611203 -n scheduled-stop-611203
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-611203 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-611203 --cancel-scheduled
E0811 23:36:14.426190    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-611203 -n scheduled-stop-611203
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-611203
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-611203 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-611203
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-611203: exit status 7 (70.279711ms)

                                                
                                                
-- stdout --
	scheduled-stop-611203
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-611203 -n scheduled-stop-611203
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-611203 -n scheduled-stop-611203: exit status 7 (73.572697ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-611203" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-611203
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-611203: (5.051432944s)
--- PASS: TestScheduledStopUnix (111.52s)

                                                
                                    
x
+
TestInsufficientStorage (10.87s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-519017 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-519017 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (8.288267426s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"63c7235e-9f18-4a7b-ac0f-1686273d8353","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-519017] minikube v1.31.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"23dda7ed-7d79-4fe0-87df-63b90c02cb9a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17044"}}
	{"specversion":"1.0","id":"8ab22881-2a2d-4bba-b50e-90605232a3e5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"51748d38-6cda-4766-a3f0-43adf072e54b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig"}}
	{"specversion":"1.0","id":"25fadae2-fd83-4890-8d2b-073ff4a073a4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube"}}
	{"specversion":"1.0","id":"7551191a-8e6d-4090-8638-655d8b772858","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"38075227-e2d9-49f1-a5c8-6ab59b8a6b0d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"508a02f0-02ed-4f96-b910-8a77b543c455","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"1fe58be6-f359-4d24-90c1-9d07857de01a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"c39e82fb-a007-4097-b9ca-ad1af1a5bd47","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"162c98c0-91a1-4588-bca0-f29a61bb3a80","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"b5d1e55c-d8d0-4c32-a93f-140e8b75cbe8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-519017 in cluster insufficient-storage-519017","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"90901e95-2319-494b-9b65-311d2f5a4d22","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"4b182b5d-bd53-4161-a16a-b56e00121bbf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"4c93a2fd-594e-46e2-9ab4-07f173c54ac1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-519017 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-519017 --output=json --layout=cluster: exit status 7 (320.06954ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-519017","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.31.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-519017","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0811 23:37:38.690616  124480 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-519017" does not appear in /home/jenkins/minikube-integration/17044-2342/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-519017 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-519017 --output=json --layout=cluster: exit status 7 (332.722918ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-519017","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.31.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-519017","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0811 23:37:39.024203  124535 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-519017" does not appear in /home/jenkins/minikube-integration/17044-2342/kubeconfig
	E0811 23:37:39.037544  124535 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/insufficient-storage-519017/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-519017" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-519017
E0811 23:37:39.093076    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-519017: (1.92584734s)
--- PASS: TestInsufficientStorage (10.87s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (114.05s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.22.0.2520884907.exe start -p running-upgrade-889376 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E0811 23:44:15.074166    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:44:51.381018    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
version_upgrade_test.go:132: (dbg) Done: /tmp/minikube-v1.22.0.2520884907.exe start -p running-upgrade-889376 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m17.257871848s)
version_upgrade_test.go:142: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-889376 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:142: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-889376 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (32.350071777s)
helpers_test.go:175: Cleaning up "running-upgrade-889376" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-889376
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-889376: (3.092404852s)
--- PASS: TestRunningBinaryUpgrade (114.05s)

                                                
                                    
x
+
TestKubernetesUpgrade (411.83s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-851802 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-851802 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m3.619219024s)
version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-851802
version_upgrade_test.go:239: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-851802: (1.484330826s)
version_upgrade_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-851802 status --format={{.Host}}
version_upgrade_test.go:244: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-851802 status --format={{.Host}}: exit status 7 (101.97749ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:246: status error: exit status 7 (may be ok)
version_upgrade_test.go:255: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-851802 --memory=2200 --kubernetes-version=v1.28.0-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:255: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-851802 --memory=2200 --kubernetes-version=v1.28.0-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (5m13.973545936s)
version_upgrade_test.go:260: (dbg) Run:  kubectl --context kubernetes-upgrade-851802 version --output=json
version_upgrade_test.go:279: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:281: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-851802 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:281: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-851802 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=containerd: exit status 106 (142.003198ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-851802] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17044
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.28.0-rc.0 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-851802
	    minikube start -p kubernetes-upgrade-851802 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-8518022 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.28.0-rc.0, by running:
	    
	    minikube start -p kubernetes-upgrade-851802 --kubernetes-version=v1.28.0-rc.0
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:285: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:287: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-851802 --memory=2200 --kubernetes-version=v1.28.0-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:287: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-851802 --memory=2200 --kubernetes-version=v1.28.0-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (29.653622014s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-851802" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-851802
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-851802: (2.660918064s)
--- PASS: TestKubernetesUpgrade (411.83s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.07s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-064892 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-064892 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (71.421247ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-064892] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17044
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.07s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (46.16s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-064892 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-064892 --driver=docker  --container-runtime=containerd: (45.529802449s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-064892 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (46.16s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (30.47s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-064892 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-064892 --no-kubernetes --driver=docker  --container-runtime=containerd: (28.021346247s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-064892 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-064892 status -o json: exit status 2 (414.194758ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-064892","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-064892
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-064892: (2.024468878s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (30.47s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (9.58s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-064892 --no-kubernetes --driver=docker  --container-runtime=containerd
E0811 23:39:02.142480    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-064892 --no-kubernetes --driver=docker  --container-runtime=containerd: (9.576841218s)
--- PASS: TestNoKubernetes/serial/Start (9.58s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.41s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-064892 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-064892 "sudo systemctl is-active --quiet service kubelet": exit status 1 (413.20492ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.41s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.06s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.06s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.22s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-064892
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-064892: (1.224096327s)
--- PASS: TestNoKubernetes/serial/Stop (1.22s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (6.84s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-064892 --driver=docker  --container-runtime=containerd
E0811 23:39:15.074280    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-064892 --driver=docker  --container-runtime=containerd: (6.843058095s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (6.84s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.34s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-064892 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-064892 "sudo systemctl is-active --quiet service kubelet": exit status 1 (341.246819ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.34s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.47s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.47s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (150.18s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:195: (dbg) Run:  /tmp/minikube-v1.22.0.2832762618.exe start -p stopped-upgrade-530898 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E0811 23:42:18.125369    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
version_upgrade_test.go:195: (dbg) Done: /tmp/minikube-v1.22.0.2832762618.exe start -p stopped-upgrade-530898 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m19.048944637s)
version_upgrade_test.go:204: (dbg) Run:  /tmp/minikube-v1.22.0.2832762618.exe -p stopped-upgrade-530898 stop
E0811 23:42:39.092393    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
version_upgrade_test.go:204: (dbg) Done: /tmp/minikube-v1.22.0.2832762618.exe -p stopped-upgrade-530898 stop: (20.289923716s)
version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-530898 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:210: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-530898 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (50.84354615s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (150.18s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.19s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:218: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-530898
version_upgrade_test.go:218: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-530898: (1.185438963s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.19s)

                                                
                                    
x
+
TestPause/serial/Start (64.1s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-835239 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-835239 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (1m4.102539865s)
--- PASS: TestPause/serial/Start (64.10s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (13.89s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-835239 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-835239 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (13.866073795s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (13.89s)

                                                
                                    
x
+
TestPause/serial/Pause (1.01s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-835239 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-835239 --alsologtostderr -v=5: (1.004966467s)
--- PASS: TestPause/serial/Pause (1.01s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.48s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-835239 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-835239 --output=json --layout=cluster: exit status 2 (474.108132ms)

                                                
                                                
-- stdout --
	{"Name":"pause-835239","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.31.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-835239","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.48s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.93s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-835239 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.93s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.24s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-835239 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-835239 --alsologtostderr -v=5: (1.238524635s)
--- PASS: TestPause/serial/PauseAgain (1.24s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (3.06s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-835239 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-835239 --alsologtostderr -v=5: (3.064419688s)
--- PASS: TestPause/serial/DeletePaused (3.06s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (4.89s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-761341 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-761341 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (257.465072ms)

                                                
                                                
-- stdout --
	* [false-761341] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17044
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0811 23:47:09.696151  160517 out.go:296] Setting OutFile to fd 1 ...
	I0811 23:47:09.696367  160517 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:47:09.696388  160517 out.go:309] Setting ErrFile to fd 2...
	I0811 23:47:09.696407  160517 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0811 23:47:09.696670  160517 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17044-2342/.minikube/bin
	I0811 23:47:09.697075  160517 out.go:303] Setting JSON to false
	I0811 23:47:09.698122  160517 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":5376,"bootTime":1691792254,"procs":322,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0811 23:47:09.698214  160517 start.go:138] virtualization:  
	I0811 23:47:09.703073  160517 out.go:177] * [false-761341] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0811 23:47:09.704984  160517 out.go:177]   - MINIKUBE_LOCATION=17044
	I0811 23:47:09.705115  160517 notify.go:220] Checking for updates...
	I0811 23:47:09.711274  160517 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0811 23:47:09.716581  160517 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17044-2342/kubeconfig
	I0811 23:47:09.718544  160517 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17044-2342/.minikube
	I0811 23:47:09.720471  160517 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0811 23:47:09.722552  160517 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0811 23:47:09.724896  160517 config.go:182] Loaded profile config "pause-835239": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.4
	I0811 23:47:09.725008  160517 driver.go:373] Setting default libvirt URI to qemu:///system
	I0811 23:47:09.756589  160517 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0811 23:47:09.756682  160517 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0811 23:47:09.879255  160517 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:45 SystemTime:2023-08-11 23:47:09.868822357 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0811 23:47:09.879372  160517 docker.go:294] overlay module found
	I0811 23:47:09.881932  160517 out.go:177] * Using the docker driver based on user configuration
	I0811 23:47:09.884516  160517 start.go:298] selected driver: docker
	I0811 23:47:09.884545  160517 start.go:901] validating driver "docker" against <nil>
	I0811 23:47:09.884558  160517 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0811 23:47:09.887181  160517 out.go:177] 
	W0811 23:47:09.889121  160517 out.go:239] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0811 23:47:09.890817  160517 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-761341 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-761341" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-761341

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-761341"

                                                
                                                
----------------------- debugLogs end: false-761341 [took: 4.436050165s] --------------------------------
helpers_test.go:175: Cleaning up "false-761341" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-761341
--- PASS: TestNetworkPlugins/group/false (4.89s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.16s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-835239
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-835239: exit status 1 (19.594189ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-835239: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.16s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (134.05s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-457765 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0
E0811 23:49:15.073388    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:49:51.381237    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-457765 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: (2m14.049828488s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (134.05s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (11.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-457765 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [5b966f19-6e53-45a8-804c-f2e87e8c9cd8] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [5b966f19-6e53-45a8-804c-f2e87e8c9cd8] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 10.03689008s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-457765 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (11.01s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.46s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-457765 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-457765 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.189026031s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-457765 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.46s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12.59s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-457765 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-457765 --alsologtostderr -v=3: (12.593502014s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.59s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (71.41s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-501851 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.0-rc.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-501851 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.0-rc.0: (1m11.412855075s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (71.41s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-457765 -n old-k8s-version-457765
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-457765 -n old-k8s-version-457765: exit status 7 (151.355963ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-457765 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.39s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (659.63s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-457765 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-457765 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: (10m59.222281324s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-457765 -n old-k8s-version-457765
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (659.63s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (9.59s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-501851 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [659d1785-035f-497b-b424-a23c663e3d37] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [659d1785-035f-497b-b424-a23c663e3d37] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.034384375s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-501851 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.59s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.21s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-501851 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-501851 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.118545409s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-501851 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.21s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (12.14s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-501851 --alsologtostderr -v=3
E0811 23:52:39.092501    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-501851 --alsologtostderr -v=3: (12.136272903s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (12.14s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-501851 -n no-preload-501851
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-501851 -n no-preload-501851: exit status 7 (68.540361ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-501851 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (346.17s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-501851 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.0-rc.0
E0811 23:52:54.426397    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0811 23:54:15.073938    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:54:51.380612    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0811 23:55:42.143951    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0811 23:57:39.092408    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-501851 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.0-rc.0: (5m45.696826875s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-501851 -n no-preload-501851
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (346.17s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (10.03s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-jr94h" [ae1a44ed-88fb-4375-a225-b9365dcf6622] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-jr94h" [ae1a44ed-88fb-4375-a225-b9365dcf6622] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 10.029169477s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (10.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.16s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-jr94h" [ae1a44ed-88fb-4375-a225-b9365dcf6622] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.012072918s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-501851 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.16s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.47s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p no-preload-501851 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.47s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.53s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-501851 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-501851 -n no-preload-501851
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-501851 -n no-preload-501851: exit status 2 (385.508282ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-501851 -n no-preload-501851
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-501851 -n no-preload-501851: exit status 2 (359.820662ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-501851 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-501851 -n no-preload-501851
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-501851 -n no-preload-501851
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.53s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (60.58s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-001161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4
E0811 23:59:15.073490    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0811 23:59:51.381061    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-001161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4: (1m0.575931962s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (60.58s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-001161 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [91d96329-d3ef-455e-808b-505c4ce08975] Pending
helpers_test.go:344: "busybox" [91d96329-d3ef-455e-808b-505c4ce08975] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [91d96329-d3ef-455e-808b-505c4ce08975] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.133790417s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-001161 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.27s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-001161 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-001161 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.140164879s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-001161 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.27s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-q5fgq" [1726d284-227b-4a97-9a15-13954d6c1003] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.024154703s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-q5fgq" [1726d284-227b-4a97-9a15-13954d6c1003] Running
E0812 00:02:30.542197    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.009459128s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-457765 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.38s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p old-k8s-version-457765 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.38s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.36s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-457765 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-457765 -n old-k8s-version-457765
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-457765 -n old-k8s-version-457765: exit status 2 (342.941402ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-457765 -n old-k8s-version-457765
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-457765 -n old-k8s-version-457765: exit status 2 (359.859788ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-457765 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-457765 -n old-k8s-version-457765
E0812 00:02:38.222889    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-457765 -n old-k8s-version-457765
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.36s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (82.95s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-768905 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4
E0812 00:02:48.463176    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:03:08.943368    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:03:49.904428    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-768905 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4: (1m22.948936953s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (82.95s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.58s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-768905 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [239b7e5d-c079-4f95-80d4-ba2864c4ec99] Pending
helpers_test.go:344: "busybox" [239b7e5d-c079-4f95-80d4-ba2864c4ec99] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [239b7e5d-c079-4f95-80d4-ba2864c4ec99] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.031787199s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-768905 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.58s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.26s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-768905 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-768905 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.125771889s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-768905 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.26s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.12s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-768905 --alsologtostderr -v=3
E0812 00:04:15.073607    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-768905 --alsologtostderr -v=3: (12.124612537s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.12s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905: exit status 7 (82.233315ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-768905 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (345.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-768905 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4
E0812 00:04:51.381194    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0812 00:05:11.825155    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:06:00.727361    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:00.732639    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:00.742914    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:00.763248    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:00.803538    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:00.883872    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:01.044296    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:01.364953    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:02.006003    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:03.286840    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:05.847090    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:10.967765    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:21.208592    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:06:41.689363    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:07:22.650327    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:07:27.982938    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:07:39.093332    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0812 00:07:55.665929    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:08:44.570800    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:09:15.073424    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0812 00:09:34.426538    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
E0812 00:09:51.380831    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-768905 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.4: (5m44.613437672s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (345.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (10.03s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-fcqq8" [2e8c4168-55d8-4f69-b57f-b1d9842bb6f4] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-fcqq8" [2e8c4168-55d8-4f69-b57f-b1d9842bb6f4] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 10.028506292s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (10.03s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-fcqq8" [2e8c4168-55d8-4f69-b57f-b1d9842bb6f4] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.01146319s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-768905 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.34s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p default-k8s-diff-port-768905 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.34s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.46s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-768905 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905: exit status 2 (398.788131ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905: exit status 2 (353.706744ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-768905 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-768905 -n default-k8s-diff-port-768905
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.46s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (48.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-758461 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.0-rc.0
E0812 00:11:00.727176    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-758461 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.0-rc.0: (48.213198685s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (48.21s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.25s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-758461 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-758461 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.247791376s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.25s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.27s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-758461 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-758461 --alsologtostderr -v=3: (1.273454203s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.27s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-758461 -n newest-cni-758461
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-758461 -n newest-cni-758461: exit status 7 (70.049023ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-758461 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (37.87s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-758461 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.0-rc.0
E0812 00:11:28.411150    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-758461 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.0-rc.0: (37.485473215s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-758461 -n newest-cni-758461
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (37.87s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.36s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p newest-cni-758461 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.36s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.2s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-758461 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-758461 -n newest-cni-758461
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-758461 -n newest-cni-758461: exit status 2 (357.921211ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-758461 -n newest-cni-758461
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-758461 -n newest-cni-758461: exit status 2 (355.137175ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-758461 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-758461 -n newest-cni-758461
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-758461 -n newest-cni-758461
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (84.85s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd
E0812 00:12:22.144919    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
E0812 00:12:27.982873    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/no-preload-501851/client.crt: no such file or directory
E0812 00:12:39.092935    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd: (1m24.850870237s)
--- PASS: TestNetworkPlugins/group/auto/Start (84.85s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-761341 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (10.42s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-761341 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-9lnj6" [211edb10-f59d-48a3-b51a-a47908977fff] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-9lnj6" [211edb10-f59d-48a3-b51a-a47908977fff] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 10.011791126s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (10.42s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-761341 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (56.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd
E0812 00:14:07.922232    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
E0812 00:14:10.482895    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
E0812 00:14:15.073903    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/addons-796714/client.crt: no such file or directory
E0812 00:14:15.604057    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
E0812 00:14:25.844794    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
E0812 00:14:46.325958    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
E0812 00:14:51.381274    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/functional-582653/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd: (56.343003291s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (56.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-jhjv5" [0884bbe6-d19a-43c6-8263-9b2f81955e3f] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.034620869s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-761341 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (8.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-761341 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-ltgxz" [63adedbb-44f7-4596-a065-13e281a093e6] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-ltgxz" [63adedbb-44f7-4596-a065-13e281a093e6] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 8.010464625s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (8.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-761341 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (74.93s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd
E0812 00:16:00.726532    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/old-k8s-version-457765/client.crt: no such file or directory
E0812 00:16:49.207360    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/default-k8s-diff-port-768905/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd: (1m14.925960389s)
--- PASS: TestNetworkPlugins/group/calico/Start (74.93s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-gb9bc" [9b288f66-5f38-4d32-90a0-e828dd4ba941] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.03156746s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-761341 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-761341 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-hmprz" [58a42337-76df-4ab3-a86a-1135d62ff791] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-hmprz" [58a42337-76df-4ab3-a86a-1135d62ff791] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.016066359s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-761341 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (54.68s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd
E0812 00:17:39.092417    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/ingress-addon-legacy-508070/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd: (54.681342754s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (54.68s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-761341 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (9.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-761341 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-52t2j" [b85d9c6c-e57d-4e90-a511-9a9acf071c03] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-52t2j" [b85d9c6c-e57d-4e90-a511-9a9acf071c03] Running
E0812 00:18:34.557669    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:34.562989    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:34.573220    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:34.593581    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:34.633838    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:34.714189    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:34.875317    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:35.195956    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:35.836569    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
E0812 00:18:37.117756    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/auto-761341/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 9.016444952s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (9.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-761341 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (88.99s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (1m28.990281267s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (88.99s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-761341 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-761341 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-z5drm" [f055e6a6-37ea-4611-a885-ccf7792df91a] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-z5drm" [f055e6a6-37ea-4611-a885-ccf7792df91a] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.011396818s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-761341 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (57.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd: (57.43078753s)
--- PASS: TestNetworkPlugins/group/flannel/Start (57.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-bdhzv" [c6499d04-5d26-4408-ba7c-5c064c084315] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.029083688s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-761341 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (8.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-761341 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-5k9jd" [159b798f-37cf-4a3f-ac89-cbe197239439] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-5k9jd" [159b798f-37cf-4a3f-ac89-cbe197239439] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 8.02311453s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (8.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-761341 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
E0812 00:22:14.509321    7670 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/calico-761341/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (99.09s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-761341 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd: (1m39.08991967s)
--- PASS: TestNetworkPlugins/group/bridge/Start (99.09s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-761341 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (10.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-761341 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-vrkft" [990c019c-9411-43fc-882a-d362f7888961] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-vrkft" [990c019c-9411-43fc-882a-d362f7888961] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 10.010584456s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (10.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-761341 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-761341 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.18s)

                                                
                                    

Test skip (31/308)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.4/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.4/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.27.4/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.4/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.4/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.27.4/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.4/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.4/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.27.4/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0-rc.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0-rc.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.0-rc.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0-rc.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0-rc.0/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.0-rc.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0-rc.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0-rc.0/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.0-rc.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.55s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-818259 --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:234: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-818259" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-818259
--- SKIP: TestDownloadOnlyKic (0.55s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:420: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:474: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:459: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-338936" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-338936
--- SKIP: TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (4.78s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:522: 
----------------------- debugLogs start: kubenet-761341 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-761341" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17044-2342/.minikube/ca.crt
extensions:
- extension:
last-update: Fri, 11 Aug 2023 23:47:03 UTC
provider: minikube.sigs.k8s.io
version: v1.31.1
name: cluster_info
server: https://192.168.94.2:8443
name: pause-835239
contexts:
- context:
cluster: pause-835239
extensions:
- extension:
last-update: Fri, 11 Aug 2023 23:47:03 UTC
provider: minikube.sigs.k8s.io
version: v1.31.1
name: context_info
namespace: default
user: pause-835239
name: pause-835239
current-context: pause-835239
kind: Config
preferences: {}
users:
- name: pause-835239
user:
client-certificate: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/pause-835239/client.crt
client-key: /home/jenkins/minikube-integration/17044-2342/.minikube/profiles/pause-835239/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-761341

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-761341"

                                                
                                                
----------------------- debugLogs end: kubenet-761341 [took: 4.590691526s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-761341" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-761341
--- SKIP: TestNetworkPlugins/group/kubenet (4.78s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (6.1s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:522: 
----------------------- debugLogs start: cilium-761341 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-761341" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-761341

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-761341" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-761341"

                                                
                                                
----------------------- debugLogs end: cilium-761341 [took: 5.698692626s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-761341" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-761341
--- SKIP: TestNetworkPlugins/group/cilium (6.10s)

                                                
                                    
Copied to clipboard