Test Report: Docker_Linux_containerd 17174

                    
                      7689d73509a567ada6f3653fa0ef2156acc9a338:2023-09-07:30902
                    
                

Test fail (2/304)

Order failed test Duration
42 TestDockerEnvContainerd 38.96
228 TestMissingContainerUpgrade 218.4
x
+
TestDockerEnvContainerd (38.96s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux amd64
docker_test.go:181: (dbg) Run:  out/minikube-linux-amd64 start -p dockerenv-198309 --driver=docker  --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-amd64 start -p dockerenv-198309 --driver=docker  --container-runtime=containerd: (23.934593947s)
docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-amd64 docker-env --ssh-host --ssh-add -p dockerenv-198309"
docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-0ktuxNATN9dN/agent.596147" SSH_AGENT_PID="596148" DOCKER_HOST=ssh://docker@127.0.0.1:32777 docker version"
docker_test.go:220: (dbg) Non-zero exit: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-0ktuxNATN9dN/agent.596147" SSH_AGENT_PID="596148" DOCKER_HOST=ssh://docker@127.0.0.1:32777 docker version": exit status 1 (215.515436ms)

                                                
                                                
-- stdout --
	Client: Docker Engine - Community
	 Version:           24.0.6
	 API version:       1.43
	 Go version:        go1.20.7
	 Git commit:        ed223bc
	 Built:             Mon Sep  4 12:32:12 2023
	 OS/Arch:           linux/amd64
	 Context:           default

                                                
                                                
-- /stdout --
** stderr ** 
	error during connect: Get "http://docker.example.com/v1.24/version": command [ssh -o ConnectTimeout=30 -l docker -p 32777 -- 127.0.0.1 docker system dial-stdio] has exited with exit status 255, please make sure the URL is valid, and Docker 18.09 or later is installed on the remote host: stderr=@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
	@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
	@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
	IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
	Someone could be eavesdropping on you right now (man-in-the-middle attack)!
	It is also possible that a host key has just been changed.
	The fingerprint for the RSA key sent by the remote host is
	SHA256:uHVI9dczVaXYDPQmqb3AGbbRvPX6uVfEX2VBipP8SXw.
	Please contact your system administrator.
	Add correct host key in /home/jenkins/.ssh/known_hosts to get rid of this message.
	Offending RSA key in /home/jenkins/.ssh/known_hosts:5
	  remove with:
	  ssh-keygen -f "/home/jenkins/.ssh/known_hosts" -R "[127.0.0.1]:32777"
	RSA host key for [127.0.0.1]:32777 has changed and you have requested strict checking.
	Host key verification failed.
	

                                                
                                                
** /stderr **
docker_test.go:222: failed to execute 'docker version', error: exit status 1, output: 
-- stdout --
	Client: Docker Engine - Community
	 Version:           24.0.6
	 API version:       1.43
	 Go version:        go1.20.7
	 Git commit:        ed223bc
	 Built:             Mon Sep  4 12:32:12 2023
	 OS/Arch:           linux/amd64
	 Context:           default

                                                
                                                
-- /stdout --
** stderr ** 
	error during connect: Get "http://docker.example.com/v1.24/version": command [ssh -o ConnectTimeout=30 -l docker -p 32777 -- 127.0.0.1 docker system dial-stdio] has exited with exit status 255, please make sure the URL is valid, and Docker 18.09 or later is installed on the remote host: stderr=@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
	@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
	@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
	IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
	Someone could be eavesdropping on you right now (man-in-the-middle attack)!
	It is also possible that a host key has just been changed.
	The fingerprint for the RSA key sent by the remote host is
	SHA256:uHVI9dczVaXYDPQmqb3AGbbRvPX6uVfEX2VBipP8SXw.
	Please contact your system administrator.
	Add correct host key in /home/jenkins/.ssh/known_hosts to get rid of this message.
	Offending RSA key in /home/jenkins/.ssh/known_hosts:5
	  remove with:
	  ssh-keygen -f "/home/jenkins/.ssh/known_hosts" -R "[127.0.0.1]:32777"
	RSA host key for [127.0.0.1]:32777 has changed and you have requested strict checking.
	Host key verification failed.
	

                                                
                                                
** /stderr **
panic.go:522: *** TestDockerEnvContainerd FAILED at 2023-09-06 23:42:23.049871857 +0000 UTC m=+287.281237186
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestDockerEnvContainerd]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect dockerenv-198309
helpers_test.go:235: (dbg) docker inspect dockerenv-198309:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "789bbaaf7800124f19ea76432309e9b801ab95f3d503a669164157ed9544a919",
	        "Created": "2023-09-06T23:41:54.004586393Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 594056,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-09-06T23:41:54.285904185Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:a5b1b95d50f24b5df6a9115c9ada0cb74f27ed4b03c4761eb60ee23f0bdd5210",
	        "ResolvConfPath": "/var/lib/docker/containers/789bbaaf7800124f19ea76432309e9b801ab95f3d503a669164157ed9544a919/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/789bbaaf7800124f19ea76432309e9b801ab95f3d503a669164157ed9544a919/hostname",
	        "HostsPath": "/var/lib/docker/containers/789bbaaf7800124f19ea76432309e9b801ab95f3d503a669164157ed9544a919/hosts",
	        "LogPath": "/var/lib/docker/containers/789bbaaf7800124f19ea76432309e9b801ab95f3d503a669164157ed9544a919/789bbaaf7800124f19ea76432309e9b801ab95f3d503a669164157ed9544a919-json.log",
	        "Name": "/dockerenv-198309",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "dockerenv-198309:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "dockerenv-198309",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 8388608000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 16777216000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/8e288127fd08c636046e5f1ed15ab3f7df567116801f248674d9b76dce50be90-init/diff:/var/lib/docker/overlay2/618880dca05f65eb24170abee02c12007f357b2a80689bfc3ba8a731d6572e38/diff",
	                "MergedDir": "/var/lib/docker/overlay2/8e288127fd08c636046e5f1ed15ab3f7df567116801f248674d9b76dce50be90/merged",
	                "UpperDir": "/var/lib/docker/overlay2/8e288127fd08c636046e5f1ed15ab3f7df567116801f248674d9b76dce50be90/diff",
	                "WorkDir": "/var/lib/docker/overlay2/8e288127fd08c636046e5f1ed15ab3f7df567116801f248674d9b76dce50be90/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "dockerenv-198309",
	                "Source": "/var/lib/docker/volumes/dockerenv-198309/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "dockerenv-198309",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "dockerenv-198309",
	                "name.minikube.sigs.k8s.io": "dockerenv-198309",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "c2e57019918d48db6fa2cae7f9f25272c0d81ad25fca24917437e4a41cd224ba",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32777"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32776"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32773"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32775"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32774"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/c2e57019918d",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "dockerenv-198309": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "789bbaaf7800",
	                        "dockerenv-198309"
	                    ],
	                    "NetworkID": "51e9fa87ef7087fe32e90aa6418bd0e8e7960993eb030540a1d90b9703bf62e4",
	                    "EndpointID": "51a4072fca342ac7d09baf41d7c2604039d6a97052953b08e7d3145443019c4c",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p dockerenv-198309 -n dockerenv-198309
helpers_test.go:244: <<< TestDockerEnvContainerd FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestDockerEnvContainerd]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p dockerenv-198309 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p dockerenv-198309 logs -n 25: (1.353075198s)
helpers_test.go:252: TestDockerEnvContainerd logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |------------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	|  Command   |              Args              |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|------------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| delete     | -p download-docker-757255      | download-docker-757255 | jenkins | v1.31.2 | 06 Sep 23 23:38 UTC | 06 Sep 23 23:38 UTC |
	| start      | --download-only -p             | binary-mirror-252087   | jenkins | v1.31.2 | 06 Sep 23 23:38 UTC |                     |
	|            | binary-mirror-252087           |                        |         |         |                     |                     |
	|            | --alsologtostderr              |                        |         |         |                     |                     |
	|            | --binary-mirror                |                        |         |         |                     |                     |
	|            | http://127.0.0.1:46029         |                        |         |         |                     |                     |
	|            | --driver=docker                |                        |         |         |                     |                     |
	|            | --container-runtime=containerd |                        |         |         |                     |                     |
	| delete     | -p binary-mirror-252087        | binary-mirror-252087   | jenkins | v1.31.2 | 06 Sep 23 23:38 UTC | 06 Sep 23 23:38 UTC |
	| start      | -p addons-626363               | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:38 UTC | 06 Sep 23 23:40 UTC |
	|            | --wait=true --memory=4000      |                        |         |         |                     |                     |
	|            | --alsologtostderr              |                        |         |         |                     |                     |
	|            | --addons=registry              |                        |         |         |                     |                     |
	|            | --addons=metrics-server        |                        |         |         |                     |                     |
	|            | --addons=volumesnapshots       |                        |         |         |                     |                     |
	|            | --addons=csi-hostpath-driver   |                        |         |         |                     |                     |
	|            | --addons=gcp-auth              |                        |         |         |                     |                     |
	|            | --addons=cloud-spanner         |                        |         |         |                     |                     |
	|            | --addons=inspektor-gadget      |                        |         |         |                     |                     |
	|            | --driver=docker                |                        |         |         |                     |                     |
	|            | --container-runtime=containerd |                        |         |         |                     |                     |
	|            | --addons=ingress               |                        |         |         |                     |                     |
	|            | --addons=ingress-dns           |                        |         |         |                     |                     |
	|            | --addons=helm-tiller           |                        |         |         |                     |                     |
	| addons     | enable headlamp                | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | -p addons-626363               |                        |         |         |                     |                     |
	|            | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| addons     | disable cloud-spanner -p       | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | addons-626363                  |                        |         |         |                     |                     |
	| addons     | addons-626363 addons disable   | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | helm-tiller --alsologtostderr  |                        |         |         |                     |                     |
	|            | -v=1                           |                        |         |         |                     |                     |
	| ip         | addons-626363 ip               | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	| addons     | addons-626363 addons disable   | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | registry --alsologtostderr     |                        |         |         |                     |                     |
	|            | -v=1                           |                        |         |         |                     |                     |
	| addons     | addons-626363 addons           | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | disable metrics-server         |                        |         |         |                     |                     |
	|            | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| ssh        | addons-626363 ssh curl -s      | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | http://127.0.0.1/ -H 'Host:    |                        |         |         |                     |                     |
	|            | nginx.example.com'             |                        |         |         |                     |                     |
	| addons     | disable inspektor-gadget -p    | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | addons-626363                  |                        |         |         |                     |                     |
	| ip         | addons-626363 ip               | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	| addons     | addons-626363 addons disable   | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | ingress-dns --alsologtostderr  |                        |         |         |                     |                     |
	|            | -v=1                           |                        |         |         |                     |                     |
	| addons     | addons-626363 addons disable   | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:40 UTC | 06 Sep 23 23:40 UTC |
	|            | ingress --alsologtostderr -v=1 |                        |         |         |                     |                     |
	| addons     | addons-626363 addons           | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:41 UTC |
	|            | disable csi-hostpath-driver    |                        |         |         |                     |                     |
	|            | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| addons     | addons-626363 addons           | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:41 UTC |
	|            | disable volumesnapshots        |                        |         |         |                     |                     |
	|            | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| addons     | addons-626363 addons disable   | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:41 UTC |
	|            | gcp-auth --alsologtostderr     |                        |         |         |                     |                     |
	|            | -v=1                           |                        |         |         |                     |                     |
	| stop       | -p addons-626363               | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:41 UTC |
	| addons     | enable dashboard -p            | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:41 UTC |
	|            | addons-626363                  |                        |         |         |                     |                     |
	| addons     | disable dashboard -p           | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:41 UTC |
	|            | addons-626363                  |                        |         |         |                     |                     |
	| addons     | disable gvisor -p              | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:41 UTC |
	|            | addons-626363                  |                        |         |         |                     |                     |
	| delete     | -p addons-626363               | addons-626363          | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:41 UTC |
	| start      | -p dockerenv-198309            | dockerenv-198309       | jenkins | v1.31.2 | 06 Sep 23 23:41 UTC | 06 Sep 23 23:42 UTC |
	|            | --driver=docker                |                        |         |         |                     |                     |
	|            | --container-runtime=containerd |                        |         |         |                     |                     |
	| docker-env | --ssh-host --ssh-add -p        | dockerenv-198309       | jenkins | v1.31.2 | 06 Sep 23 23:42 UTC | 06 Sep 23 23:42 UTC |
	|            | dockerenv-198309               |                        |         |         |                     |                     |
	|------------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/09/06 23:41:48
	Running on machine: ubuntu-20-agent-6
	Binary: Built with gc go1.20.7 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0906 23:41:48.081670  593434 out.go:296] Setting OutFile to fd 1 ...
	I0906 23:41:48.081920  593434 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:41:48.081924  593434 out.go:309] Setting ErrFile to fd 2...
	I0906 23:41:48.081927  593434 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:41:48.082119  593434 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	I0906 23:41:48.082684  593434 out.go:303] Setting JSON to false
	I0906 23:41:48.084143  593434 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":19181,"bootTime":1694024527,"procs":486,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0906 23:41:48.084196  593434 start.go:138] virtualization: kvm guest
	I0906 23:41:48.086525  593434 out.go:177] * [dockerenv-198309] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	I0906 23:41:48.088417  593434 out.go:177]   - MINIKUBE_LOCATION=17174
	I0906 23:41:48.089659  593434 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0906 23:41:48.088488  593434 notify.go:220] Checking for updates...
	I0906 23:41:48.092033  593434 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0906 23:41:48.093247  593434 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	I0906 23:41:48.094553  593434 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0906 23:41:48.095769  593434 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0906 23:41:48.097304  593434 driver.go:373] Setting default libvirt URI to qemu:///system
	I0906 23:41:48.119819  593434 docker.go:121] docker version: linux-24.0.6:Docker Engine - Community
	I0906 23:41:48.119904  593434 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:41:48.171264  593434 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:37 SystemTime:2023-09-06 23:41:48.162785021 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:41:48.171350  593434 docker.go:294] overlay module found
	I0906 23:41:48.173260  593434 out.go:177] * Using the docker driver based on user configuration
	I0906 23:41:48.174637  593434 start.go:298] selected driver: docker
	I0906 23:41:48.174644  593434 start.go:902] validating driver "docker" against <nil>
	I0906 23:41:48.174655  593434 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0906 23:41:48.174752  593434 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:41:48.225127  593434 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:37 SystemTime:2023-09-06 23:41:48.216902535 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:41:48.225287  593434 start_flags.go:307] no existing cluster config was found, will generate one from the flags 
	I0906 23:41:48.225774  593434 start_flags.go:384] Using suggested 8000MB memory alloc based on sys=32089MB, container=32089MB
	I0906 23:41:48.225901  593434 start_flags.go:904] Wait components to verify : map[apiserver:true system_pods:true]
	I0906 23:41:48.227726  593434 out.go:177] * Using Docker driver with root privileges
	I0906 23:41:48.228999  593434 cni.go:84] Creating CNI manager for ""
	I0906 23:41:48.229008  593434 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0906 23:41:48.229019  593434 start_flags.go:316] Found "CNI" CNI - setting NetworkPlugin=cni
	I0906 23:41:48.229026  593434 start_flags.go:321] config:
	{Name:dockerenv-198309 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:dockerenv-198309 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:co
ntainerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0906 23:41:48.230512  593434 out.go:177] * Starting control plane node dockerenv-198309 in cluster dockerenv-198309
	I0906 23:41:48.231714  593434 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0906 23:41:48.233008  593434 out.go:177] * Pulling base image ...
	I0906 23:41:48.234177  593434 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0906 23:41:48.234211  593434 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4
	I0906 23:41:48.234217  593434 cache.go:57] Caching tarball of preloaded images
	I0906 23:41:48.234265  593434 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local docker daemon
	I0906 23:41:48.234290  593434 preload.go:174] Found /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0906 23:41:48.234299  593434 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.1 on containerd
	I0906 23:41:48.234636  593434 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/config.json ...
	I0906 23:41:48.234651  593434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/config.json: {Name:mkc9ba429173547393e1e7b339f91951e4bc93b2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:41:48.252826  593434 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local docker daemon, skipping pull
	I0906 23:41:48.252854  593434 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b exists in daemon, skipping load
	I0906 23:41:48.252880  593434 cache.go:195] Successfully downloaded all kic artifacts
	I0906 23:41:48.252912  593434 start.go:365] acquiring machines lock for dockerenv-198309: {Name:mk9a0bbbfa37f973993da230a5a7c99881dc8132 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0906 23:41:48.253014  593434 start.go:369] acquired machines lock for "dockerenv-198309" in 87.716µs
	I0906 23:41:48.253033  593434 start.go:93] Provisioning new machine with config: &{Name:dockerenv-198309 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:dockerenv-198309 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClient
Path: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0906 23:41:48.253139  593434 start.go:125] createHost starting for "" (driver="docker")
	I0906 23:41:48.255060  593434 out.go:204] * Creating docker container (CPUs=2, Memory=8000MB) ...
	I0906 23:41:48.255326  593434 start.go:159] libmachine.API.Create for "dockerenv-198309" (driver="docker")
	I0906 23:41:48.255350  593434 client.go:168] LocalClient.Create starting
	I0906 23:41:48.255443  593434 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem
	I0906 23:41:48.255482  593434 main.go:141] libmachine: Decoding PEM data...
	I0906 23:41:48.255499  593434 main.go:141] libmachine: Parsing certificate...
	I0906 23:41:48.255576  593434 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem
	I0906 23:41:48.255597  593434 main.go:141] libmachine: Decoding PEM data...
	I0906 23:41:48.255605  593434 main.go:141] libmachine: Parsing certificate...
	I0906 23:41:48.256023  593434 cli_runner.go:164] Run: docker network inspect dockerenv-198309 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0906 23:41:48.271688  593434 cli_runner.go:211] docker network inspect dockerenv-198309 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0906 23:41:48.271759  593434 network_create.go:281] running [docker network inspect dockerenv-198309] to gather additional debugging logs...
	I0906 23:41:48.271773  593434 cli_runner.go:164] Run: docker network inspect dockerenv-198309
	W0906 23:41:48.288301  593434 cli_runner.go:211] docker network inspect dockerenv-198309 returned with exit code 1
	I0906 23:41:48.288321  593434 network_create.go:284] error running [docker network inspect dockerenv-198309]: docker network inspect dockerenv-198309: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network dockerenv-198309 not found
	I0906 23:41:48.288330  593434 network_create.go:286] output of [docker network inspect dockerenv-198309]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network dockerenv-198309 not found
	
	** /stderr **
	I0906 23:41:48.288385  593434 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0906 23:41:48.304435  593434 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00138f600}
	I0906 23:41:48.304470  593434 network_create.go:123] attempt to create docker network dockerenv-198309 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0906 23:41:48.304523  593434 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=dockerenv-198309 dockerenv-198309
	I0906 23:41:48.357454  593434 network_create.go:107] docker network dockerenv-198309 192.168.49.0/24 created
	I0906 23:41:48.357473  593434 kic.go:117] calculated static IP "192.168.49.2" for the "dockerenv-198309" container
	I0906 23:41:48.357535  593434 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0906 23:41:48.372616  593434 cli_runner.go:164] Run: docker volume create dockerenv-198309 --label name.minikube.sigs.k8s.io=dockerenv-198309 --label created_by.minikube.sigs.k8s.io=true
	I0906 23:41:48.388639  593434 oci.go:103] Successfully created a docker volume dockerenv-198309
	I0906 23:41:48.388703  593434 cli_runner.go:164] Run: docker run --rm --name dockerenv-198309-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=dockerenv-198309 --entrypoint /usr/bin/test -v dockerenv-198309:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b -d /var/lib
	I0906 23:41:48.898597  593434 oci.go:107] Successfully prepared a docker volume dockerenv-198309
	I0906 23:41:48.898635  593434 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0906 23:41:48.898656  593434 kic.go:190] Starting extracting preloaded images to volume ...
	I0906 23:41:48.898722  593434 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v dockerenv-198309:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b -I lz4 -xf /preloaded.tar -C /extractDir
	I0906 23:41:53.938120  593434 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v dockerenv-198309:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b -I lz4 -xf /preloaded.tar -C /extractDir: (5.039341981s)
	I0906 23:41:53.938169  593434 kic.go:199] duration metric: took 5.039510 seconds to extract preloaded images to volume
	W0906 23:41:53.938561  593434 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0906 23:41:53.938683  593434 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0906 23:41:53.989614  593434 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname dockerenv-198309 --name dockerenv-198309 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=dockerenv-198309 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=dockerenv-198309 --network dockerenv-198309 --ip 192.168.49.2 --volume dockerenv-198309:/var --security-opt apparmor=unconfined --memory=8000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b
	I0906 23:41:54.294045  593434 cli_runner.go:164] Run: docker container inspect dockerenv-198309 --format={{.State.Running}}
	I0906 23:41:54.310923  593434 cli_runner.go:164] Run: docker container inspect dockerenv-198309 --format={{.State.Status}}
	I0906 23:41:54.328475  593434 cli_runner.go:164] Run: docker exec dockerenv-198309 stat /var/lib/dpkg/alternatives/iptables
	I0906 23:41:54.405989  593434 oci.go:144] the created container "dockerenv-198309" has a running status.
	I0906 23:41:54.406027  593434 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa...
	I0906 23:41:54.476298  593434 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0906 23:41:54.496461  593434 cli_runner.go:164] Run: docker container inspect dockerenv-198309 --format={{.State.Status}}
	I0906 23:41:54.515104  593434 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0906 23:41:54.515118  593434 kic_runner.go:114] Args: [docker exec --privileged dockerenv-198309 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0906 23:41:54.578474  593434 cli_runner.go:164] Run: docker container inspect dockerenv-198309 --format={{.State.Status}}
	I0906 23:41:54.597644  593434 machine.go:88] provisioning docker machine ...
	I0906 23:41:54.597677  593434 ubuntu.go:169] provisioning hostname "dockerenv-198309"
	I0906 23:41:54.597728  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:41:54.620125  593434 main.go:141] libmachine: Using SSH client type: native
	I0906 23:41:54.620814  593434 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32777 <nil> <nil>}
	I0906 23:41:54.620833  593434 main.go:141] libmachine: About to run SSH command:
	sudo hostname dockerenv-198309 && echo "dockerenv-198309" | sudo tee /etc/hostname
	I0906 23:41:54.621561  593434 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43902->127.0.0.1:32777: read: connection reset by peer
	I0906 23:41:57.758442  593434 main.go:141] libmachine: SSH cmd err, output: <nil>: dockerenv-198309
	
	I0906 23:41:57.758519  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:41:57.775043  593434 main.go:141] libmachine: Using SSH client type: native
	I0906 23:41:57.775428  593434 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32777 <nil> <nil>}
	I0906 23:41:57.775441  593434 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sdockerenv-198309' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 dockerenv-198309/g' /etc/hosts;
				else 
					echo '127.0.1.1 dockerenv-198309' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0906 23:41:57.904032  593434 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0906 23:41:57.904060  593434 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17174-571027/.minikube CaCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17174-571027/.minikube}
	I0906 23:41:57.904086  593434 ubuntu.go:177] setting up certificates
	I0906 23:41:57.904095  593434 provision.go:83] configureAuth start
	I0906 23:41:57.904150  593434 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" dockerenv-198309
	I0906 23:41:57.920514  593434 provision.go:138] copyHostCerts
	I0906 23:41:57.920568  593434 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem, removing ...
	I0906 23:41:57.920574  593434 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem
	I0906 23:41:57.920634  593434 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem (1078 bytes)
	I0906 23:41:57.920723  593434 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem, removing ...
	I0906 23:41:57.920726  593434 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem
	I0906 23:41:57.920748  593434 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem (1123 bytes)
	I0906 23:41:57.920794  593434 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem, removing ...
	I0906 23:41:57.920797  593434 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem
	I0906 23:41:57.920814  593434 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem (1679 bytes)
	I0906 23:41:57.920854  593434 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem org=jenkins.dockerenv-198309 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube dockerenv-198309]
	I0906 23:41:58.086735  593434 provision.go:172] copyRemoteCerts
	I0906 23:41:58.086793  593434 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0906 23:41:58.086829  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:41:58.102907  593434 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32777 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa Username:docker}
	I0906 23:41:58.192309  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0906 23:41:58.213432  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
	I0906 23:41:58.233654  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0906 23:41:58.256964  593434 provision.go:86] duration metric: configureAuth took 352.859191ms
	I0906 23:41:58.256981  593434 ubuntu.go:193] setting minikube options for container-runtime
	I0906 23:41:58.257153  593434 config.go:182] Loaded profile config "dockerenv-198309": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0906 23:41:58.257158  593434 machine.go:91] provisioned docker machine in 3.659505009s
	I0906 23:41:58.257163  593434 client.go:171] LocalClient.Create took 10.001809529s
	I0906 23:41:58.257193  593434 start.go:167] duration metric: libmachine.API.Create for "dockerenv-198309" took 10.001856241s
	I0906 23:41:58.257200  593434 start.go:300] post-start starting for "dockerenv-198309" (driver="docker")
	I0906 23:41:58.257207  593434 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0906 23:41:58.257249  593434 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0906 23:41:58.257285  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:41:58.273409  593434 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32777 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa Username:docker}
	I0906 23:41:58.364520  593434 ssh_runner.go:195] Run: cat /etc/os-release
	I0906 23:41:58.367449  593434 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0906 23:41:58.367472  593434 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0906 23:41:58.367478  593434 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0906 23:41:58.367483  593434 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I0906 23:41:58.367491  593434 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/addons for local assets ...
	I0906 23:41:58.367538  593434 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/files for local assets ...
	I0906 23:41:58.367552  593434 start.go:303] post-start completed in 110.347856ms
	I0906 23:41:58.367833  593434 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" dockerenv-198309
	I0906 23:41:58.384928  593434 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/config.json ...
	I0906 23:41:58.385153  593434 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0906 23:41:58.385209  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:41:58.401093  593434 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32777 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa Username:docker}
	I0906 23:41:58.488808  593434 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0906 23:41:58.492827  593434 start.go:128] duration metric: createHost completed in 10.239672937s
	I0906 23:41:58.492843  593434 start.go:83] releasing machines lock for "dockerenv-198309", held for 10.239821357s
	I0906 23:41:58.492906  593434 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" dockerenv-198309
	I0906 23:41:58.509422  593434 ssh_runner.go:195] Run: cat /version.json
	I0906 23:41:58.509448  593434 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0906 23:41:58.509473  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:41:58.509503  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:41:58.526818  593434 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32777 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa Username:docker}
	I0906 23:41:58.526818  593434 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32777 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa Username:docker}
	I0906 23:41:58.713207  593434 ssh_runner.go:195] Run: systemctl --version
	I0906 23:41:58.717560  593434 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0906 23:41:58.721444  593434 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0906 23:41:58.743379  593434 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0906 23:41:58.743436  593434 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0906 23:41:58.767776  593434 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0906 23:41:58.767790  593434 start.go:466] detecting cgroup driver to use...
	I0906 23:41:58.767819  593434 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0906 23:41:58.767859  593434 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0906 23:41:58.778803  593434 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0906 23:41:58.788800  593434 docker.go:196] disabling cri-docker service (if available) ...
	I0906 23:41:58.788840  593434 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0906 23:41:58.800811  593434 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0906 23:41:58.813590  593434 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0906 23:41:58.889554  593434 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0906 23:41:58.964288  593434 docker.go:212] disabling docker service ...
	I0906 23:41:58.964344  593434 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0906 23:41:58.984191  593434 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0906 23:41:58.994389  593434 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0906 23:41:59.068261  593434 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0906 23:41:59.140162  593434 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0906 23:41:59.150225  593434 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0906 23:41:59.164454  593434 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0906 23:41:59.172956  593434 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0906 23:41:59.181386  593434 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0906 23:41:59.181438  593434 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0906 23:41:59.189895  593434 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0906 23:41:59.198175  593434 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0906 23:41:59.206421  593434 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0906 23:41:59.214608  593434 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0906 23:41:59.222336  593434 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0906 23:41:59.230615  593434 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0906 23:41:59.237782  593434 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0906 23:41:59.245063  593434 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0906 23:41:59.318937  593434 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0906 23:41:59.412922  593434 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0906 23:41:59.413004  593434 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0906 23:41:59.416585  593434 start.go:534] Will wait 60s for crictl version
	I0906 23:41:59.416637  593434 ssh_runner.go:195] Run: which crictl
	I0906 23:41:59.419701  593434 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0906 23:41:59.451531  593434 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.22
	RuntimeApiVersion:  v1
	I0906 23:41:59.451593  593434 ssh_runner.go:195] Run: containerd --version
	I0906 23:41:59.475005  593434 ssh_runner.go:195] Run: containerd --version
	I0906 23:41:59.501239  593434 out.go:177] * Preparing Kubernetes v1.28.1 on containerd 1.6.22 ...
	I0906 23:41:59.502560  593434 cli_runner.go:164] Run: docker network inspect dockerenv-198309 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0906 23:41:59.518457  593434 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0906 23:41:59.521979  593434 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0906 23:41:59.531841  593434 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0906 23:41:59.531880  593434 ssh_runner.go:195] Run: sudo crictl images --output json
	I0906 23:41:59.562861  593434 containerd.go:604] all images are preloaded for containerd runtime.
	I0906 23:41:59.562872  593434 containerd.go:518] Images already preloaded, skipping extraction
	I0906 23:41:59.562912  593434 ssh_runner.go:195] Run: sudo crictl images --output json
	I0906 23:41:59.593919  593434 containerd.go:604] all images are preloaded for containerd runtime.
	I0906 23:41:59.593937  593434 cache_images.go:84] Images are preloaded, skipping loading
	I0906 23:41:59.593984  593434 ssh_runner.go:195] Run: sudo crictl info
	I0906 23:41:59.626861  593434 cni.go:84] Creating CNI manager for ""
	I0906 23:41:59.626871  593434 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0906 23:41:59.626888  593434 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0906 23:41:59.626904  593434 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.28.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:dockerenv-198309 NodeName:dockerenv-198309 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPat
h:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0906 23:41:59.627022  593434 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "dockerenv-198309"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0906 23:41:59.627082  593434 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=dockerenv-198309 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.1 ClusterName:dockerenv-198309 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0906 23:41:59.627124  593434 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.1
	I0906 23:41:59.635106  593434 binaries.go:44] Found k8s binaries, skipping transfer
	I0906 23:41:59.635158  593434 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0906 23:41:59.643025  593434 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (388 bytes)
	I0906 23:41:59.658479  593434 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0906 23:41:59.673971  593434 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2105 bytes)
	I0906 23:41:59.689272  593434 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0906 23:41:59.692310  593434 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0906 23:41:59.701669  593434 certs.go:56] Setting up /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309 for IP: 192.168.49.2
	I0906 23:41:59.701697  593434 certs.go:190] acquiring lock for shared ca certs: {Name:mkf023f174f877b5e876cc103f58e9ab0cfa5d55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:41:59.701848  593434 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.key
	I0906 23:41:59.701898  593434 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.key
	I0906 23:41:59.701941  593434 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/client.key
	I0906 23:41:59.701952  593434 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/client.crt with IP's: []
	I0906 23:41:59.859247  593434 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/client.crt ...
	I0906 23:41:59.859264  593434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/client.crt: {Name:mkeb55b1df4595214c09d4db984b8a459c296f92 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:41:59.859442  593434 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/client.key ...
	I0906 23:41:59.859448  593434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/client.key: {Name:mk43292d3e28e2ef0f53087d8cf13ed599e98d0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:41:59.859520  593434 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.key.dd3b5fb2
	I0906 23:41:59.859528  593434 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0906 23:41:59.956269  593434 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.crt.dd3b5fb2 ...
	I0906 23:41:59.956286  593434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.crt.dd3b5fb2: {Name:mk6ad5a5aaf404a8a56e80b0479657dedb5bb07f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:41:59.956433  593434 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.key.dd3b5fb2 ...
	I0906 23:41:59.956439  593434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.key.dd3b5fb2: {Name:mkebb84dc5e2b5bc34bbcf7c6f1f8e6584861d2a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:41:59.956503  593434 certs.go:337] copying /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.crt
	I0906 23:41:59.956562  593434 certs.go:341] copying /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.key
	I0906 23:41:59.956603  593434 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/proxy-client.key
	I0906 23:41:59.956612  593434 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/proxy-client.crt with IP's: []
	I0906 23:42:00.126114  593434 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/proxy-client.crt ...
	I0906 23:42:00.126130  593434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/proxy-client.crt: {Name:mk38f9c1a950405c24ce8f32bcdb6d49715af366 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:42:00.126299  593434 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/proxy-client.key ...
	I0906 23:42:00.126304  593434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/proxy-client.key: {Name:mk8ac0965fa7f57e95f72dc73a2aa82590337526 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:42:00.126523  593434 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem (1675 bytes)
	I0906 23:42:00.126555  593434 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem (1078 bytes)
	I0906 23:42:00.126575  593434 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem (1123 bytes)
	I0906 23:42:00.126595  593434 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem (1679 bytes)
	I0906 23:42:00.127160  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0906 23:42:00.149470  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0906 23:42:00.170243  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0906 23:42:00.190560  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/dockerenv-198309/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0906 23:42:00.210969  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0906 23:42:00.231311  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0906 23:42:00.251843  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0906 23:42:00.272398  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0906 23:42:00.293110  593434 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0906 23:42:00.313579  593434 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0906 23:42:00.328924  593434 ssh_runner.go:195] Run: openssl version
	I0906 23:42:00.333763  593434 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0906 23:42:00.342044  593434 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0906 23:42:00.345161  593434 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Sep  6 23:38 /usr/share/ca-certificates/minikubeCA.pem
	I0906 23:42:00.345193  593434 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0906 23:42:00.351222  593434 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0906 23:42:00.359296  593434 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0906 23:42:00.362223  593434 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0906 23:42:00.362292  593434 kubeadm.go:404] StartCluster: {Name:dockerenv-198309 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:dockerenv-198309 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: Sock
etVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0906 23:42:00.362381  593434 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0906 23:42:00.362418  593434 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0906 23:42:00.394717  593434 cri.go:89] found id: ""
	I0906 23:42:00.394780  593434 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0906 23:42:00.403019  593434 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0906 23:42:00.410936  593434 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0906 23:42:00.410990  593434 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0906 23:42:00.418685  593434 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0906 23:42:00.418718  593434 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0906 23:42:00.461976  593434 kubeadm.go:322] [init] Using Kubernetes version: v1.28.1
	I0906 23:42:00.462073  593434 kubeadm.go:322] [preflight] Running pre-flight checks
	I0906 23:42:00.497829  593434 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0906 23:42:00.497938  593434 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1040-gcp
	I0906 23:42:00.498021  593434 kubeadm.go:322] OS: Linux
	I0906 23:42:00.498067  593434 kubeadm.go:322] CGROUPS_CPU: enabled
	I0906 23:42:00.498141  593434 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0906 23:42:00.498189  593434 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0906 23:42:00.498226  593434 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0906 23:42:00.498273  593434 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0906 23:42:00.498312  593434 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0906 23:42:00.498348  593434 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0906 23:42:00.498392  593434 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0906 23:42:00.498429  593434 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0906 23:42:00.563970  593434 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0906 23:42:00.564092  593434 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0906 23:42:00.564212  593434 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0906 23:42:00.751587  593434 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0906 23:42:00.755135  593434 out.go:204]   - Generating certificates and keys ...
	I0906 23:42:00.755279  593434 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0906 23:42:00.755390  593434 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0906 23:42:01.016703  593434 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0906 23:42:01.073754  593434 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0906 23:42:01.347338  593434 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0906 23:42:01.623464  593434 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0906 23:42:01.851984  593434 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0906 23:42:01.852153  593434 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [dockerenv-198309 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0906 23:42:02.067202  593434 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0906 23:42:02.067319  593434 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [dockerenv-198309 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0906 23:42:02.255667  593434 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0906 23:42:02.328893  593434 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0906 23:42:02.421771  593434 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0906 23:42:02.421836  593434 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0906 23:42:02.659964  593434 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0906 23:42:02.722792  593434 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0906 23:42:02.909550  593434 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0906 23:42:03.111352  593434 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0906 23:42:03.111810  593434 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0906 23:42:03.114605  593434 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0906 23:42:03.116401  593434 out.go:204]   - Booting up control plane ...
	I0906 23:42:03.116549  593434 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0906 23:42:03.116650  593434 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0906 23:42:03.117148  593434 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0906 23:42:03.128351  593434 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0906 23:42:03.129017  593434 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0906 23:42:03.129067  593434 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0906 23:42:03.205120  593434 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0906 23:42:08.707041  593434 kubeadm.go:322] [apiclient] All control plane components are healthy after 5.501889 seconds
	I0906 23:42:08.707201  593434 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0906 23:42:08.719673  593434 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0906 23:42:09.239047  593434 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0906 23:42:09.239315  593434 kubeadm.go:322] [mark-control-plane] Marking the node dockerenv-198309 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0906 23:42:09.750292  593434 kubeadm.go:322] [bootstrap-token] Using token: vv647o.9xk8809pqjjfwhll
	I0906 23:42:09.751974  593434 out.go:204]   - Configuring RBAC rules ...
	I0906 23:42:09.752107  593434 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0906 23:42:09.756589  593434 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0906 23:42:09.762576  593434 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0906 23:42:09.765580  593434 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0906 23:42:09.768102  593434 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0906 23:42:09.770528  593434 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0906 23:42:09.781647  593434 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0906 23:42:09.983215  593434 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0906 23:42:10.218019  593434 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0906 23:42:10.219372  593434 kubeadm.go:322] 
	I0906 23:42:10.219467  593434 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0906 23:42:10.219473  593434 kubeadm.go:322] 
	I0906 23:42:10.219572  593434 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0906 23:42:10.219577  593434 kubeadm.go:322] 
	I0906 23:42:10.219615  593434 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0906 23:42:10.219685  593434 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0906 23:42:10.219754  593434 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0906 23:42:10.219757  593434 kubeadm.go:322] 
	I0906 23:42:10.219840  593434 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0906 23:42:10.219856  593434 kubeadm.go:322] 
	I0906 23:42:10.219931  593434 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0906 23:42:10.219952  593434 kubeadm.go:322] 
	I0906 23:42:10.220014  593434 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0906 23:42:10.220104  593434 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0906 23:42:10.220204  593434 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0906 23:42:10.220220  593434 kubeadm.go:322] 
	I0906 23:42:10.220316  593434 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0906 23:42:10.220440  593434 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0906 23:42:10.220449  593434 kubeadm.go:322] 
	I0906 23:42:10.220553  593434 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token vv647o.9xk8809pqjjfwhll \
	I0906 23:42:10.220698  593434 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:a2ada76268d5d488ce28944d82faeb083cfa6d709381a798f3683d6c7ba77a82 \
	I0906 23:42:10.220725  593434 kubeadm.go:322] 	--control-plane 
	I0906 23:42:10.220731  593434 kubeadm.go:322] 
	I0906 23:42:10.220837  593434 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0906 23:42:10.220842  593434 kubeadm.go:322] 
	I0906 23:42:10.220945  593434 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token vv647o.9xk8809pqjjfwhll \
	I0906 23:42:10.221089  593434 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:a2ada76268d5d488ce28944d82faeb083cfa6d709381a798f3683d6c7ba77a82 
	I0906 23:42:10.223975  593434 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1040-gcp\n", err: exit status 1
	I0906 23:42:10.224139  593434 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0906 23:42:10.224158  593434 cni.go:84] Creating CNI manager for ""
	I0906 23:42:10.224166  593434 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0906 23:42:10.225794  593434 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0906 23:42:10.227102  593434 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0906 23:42:10.230765  593434 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.1/kubectl ...
	I0906 23:42:10.230776  593434 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0906 23:42:10.247972  593434 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0906 23:42:10.925552  593434 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0906 23:42:10.925676  593434 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0906 23:42:10.925675  593434 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=cf47a38f14700a28a638c18f21764b75f0a296b2 minikube.k8s.io/name=dockerenv-198309 minikube.k8s.io/updated_at=2023_09_06T23_42_10_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0906 23:42:11.017230  593434 ops.go:34] apiserver oom_adj: -16
	I0906 23:42:11.026107  593434 kubeadm.go:1081] duration metric: took 100.505627ms to wait for elevateKubeSystemPrivileges.
	I0906 23:42:11.026136  593434 kubeadm.go:406] StartCluster complete in 10.663880198s
	I0906 23:42:11.026157  593434 settings.go:142] acquiring lock: {Name:mk714b238c1478a3a25e7d657d1a550b0f350806 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:42:11.026234  593434 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0906 23:42:11.026836  593434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/kubeconfig: {Name:mk612c776b3ecd195073ca96afaf72d304290efb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:42:11.027060  593434 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0906 23:42:11.027071  593434 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
	I0906 23:42:11.027148  593434 addons.go:69] Setting storage-provisioner=true in profile "dockerenv-198309"
	I0906 23:42:11.027160  593434 addons.go:69] Setting default-storageclass=true in profile "dockerenv-198309"
	I0906 23:42:11.027164  593434 addons.go:231] Setting addon storage-provisioner=true in "dockerenv-198309"
	I0906 23:42:11.027177  593434 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "dockerenv-198309"
	I0906 23:42:11.027224  593434 host.go:66] Checking if "dockerenv-198309" exists ...
	I0906 23:42:11.027251  593434 config.go:182] Loaded profile config "dockerenv-198309": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0906 23:42:11.027556  593434 cli_runner.go:164] Run: docker container inspect dockerenv-198309 --format={{.State.Status}}
	I0906 23:42:11.027731  593434 cli_runner.go:164] Run: docker container inspect dockerenv-198309 --format={{.State.Status}}
	I0906 23:42:11.049064  593434 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0906 23:42:11.048711  593434 kapi.go:248] "coredns" deployment in "kube-system" namespace and "dockerenv-198309" context rescaled to 1 replicas
	I0906 23:42:11.050569  593434 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0906 23:42:11.050554  593434 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0906 23:42:11.050582  593434 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0906 23:42:11.052104  593434 out.go:177] * Verifying Kubernetes components...
	I0906 23:42:11.050636  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:42:11.051015  593434 addons.go:231] Setting addon default-storageclass=true in "dockerenv-198309"
	I0906 23:42:11.053437  593434 host.go:66] Checking if "dockerenv-198309" exists ...
	I0906 23:42:11.053445  593434 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0906 23:42:11.053951  593434 cli_runner.go:164] Run: docker container inspect dockerenv-198309 --format={{.State.Status}}
	I0906 23:42:11.071677  593434 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0906 23:42:11.071691  593434 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0906 23:42:11.071745  593434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" dockerenv-198309
	I0906 23:42:11.074279  593434 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32777 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa Username:docker}
	I0906 23:42:11.091585  593434 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32777 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/dockerenv-198309/id_rsa Username:docker}
	I0906 23:42:11.122257  593434 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0906 23:42:11.122838  593434 api_server.go:52] waiting for apiserver process to appear ...
	I0906 23:42:11.122878  593434 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0906 23:42:11.234009  593434 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0906 23:42:11.236392  593434 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0906 23:42:11.729193  593434 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0906 23:42:11.729264  593434 api_server.go:72] duration metric: took 678.670045ms to wait for apiserver process to appear ...
	I0906 23:42:11.729279  593434 api_server.go:88] waiting for apiserver healthz status ...
	I0906 23:42:11.729298  593434 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0906 23:42:11.735957  593434 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0906 23:42:11.737466  593434 api_server.go:141] control plane version: v1.28.1
	I0906 23:42:11.737482  593434 api_server.go:131] duration metric: took 8.196631ms to wait for apiserver health ...
	I0906 23:42:11.737490  593434 system_pods.go:43] waiting for kube-system pods to appear ...
	I0906 23:42:11.743727  593434 system_pods.go:59] 4 kube-system pods found
	I0906 23:42:11.743755  593434 system_pods.go:61] "etcd-dockerenv-198309" [b42d0f6c-333d-4164-958c-fb7b22199090] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0906 23:42:11.743763  593434 system_pods.go:61] "kube-apiserver-dockerenv-198309" [1fead860-6bd4-42ed-b7ac-3ef9513b8ed7] Running
	I0906 23:42:11.743770  593434 system_pods.go:61] "kube-controller-manager-dockerenv-198309" [fd7f9104-f2f3-49f8-a6c5-7422679a6d50] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0906 23:42:11.743777  593434 system_pods.go:61] "kube-scheduler-dockerenv-198309" [5be4eaea-e0fb-406e-a01a-871199118fa4] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0906 23:42:11.743782  593434 system_pods.go:74] duration metric: took 6.287741ms to wait for pod list to return data ...
	I0906 23:42:11.743790  593434 kubeadm.go:581] duration metric: took 693.204566ms to wait for : map[apiserver:true system_pods:true] ...
	I0906 23:42:11.743803  593434 node_conditions.go:102] verifying NodePressure condition ...
	I0906 23:42:11.746646  593434 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0906 23:42:11.746657  593434 node_conditions.go:123] node cpu capacity is 8
	I0906 23:42:11.746665  593434 node_conditions.go:105] duration metric: took 2.859431ms to run NodePressure ...
	I0906 23:42:11.746675  593434 start.go:228] waiting for startup goroutines ...
	I0906 23:42:11.918235  593434 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0906 23:42:11.920110  593434 addons.go:502] enable addons completed in 893.033766ms: enabled=[storage-provisioner default-storageclass]
	I0906 23:42:11.920146  593434 start.go:233] waiting for cluster config update ...
	I0906 23:42:11.920161  593434 start.go:242] writing updated cluster config ...
	I0906 23:42:11.920417  593434 ssh_runner.go:195] Run: rm -f paused
	I0906 23:42:11.968917  593434 start.go:600] kubectl: 1.28.1, cluster: 1.28.1 (minor skew: 0)
	I0906 23:42:11.970934  593434 out.go:177] * Done! kubectl is now configured to use "dockerenv-198309" cluster and "default" namespace by default
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED                  STATE               NAME                      ATTEMPT             POD ID              POD
	2a79d424124c5       b0b1fa0f58c6e       Less than a second ago   Running             kindnet-cni               0                   b0849656201d6       kindnet-q9bjh
	fd35967b6835e       6cdbabde3874e       Less than a second ago   Running             kube-proxy                0                   dbd180a5fea6b       kube-proxy-r8mwq
	f40f12bd36f71       6e38f40d628db       Less than a second ago   Exited              storage-provisioner       1                   8e0577e52e6aa       storage-provisioner
	481ad4ba0e372       6e38f40d628db       1 second ago             Exited              storage-provisioner       0                   8e0577e52e6aa       storage-provisioner
	81b812022fc4c       b462ce0c8b1ff       19 seconds ago           Running             kube-scheduler            0                   0ee2c88e327b6       kube-scheduler-dockerenv-198309
	7a26b25f63553       73deb9a3f7025       19 seconds ago           Running             etcd                      0                   e8987b2340a59       etcd-dockerenv-198309
	ee64d925e7a7b       5c801295c21d0       19 seconds ago           Running             kube-apiserver            0                   3121d7a7e88f1       kube-apiserver-dockerenv-198309
	21d8118aaae85       821b3dfea27be       19 seconds ago           Running             kube-controller-manager   0                   e84ca5c76e9a2       kube-controller-manager-dockerenv-198309
	
	* 
	* ==> containerd <==
	* Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.277337338Z" level=warning msg="cleaning up after shim disconnected" id=f40f12bd36f71009472d584285a195a8bc828ad3a32d7aa0e87b3873380a4b7b namespace=k8s.io
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.277353219Z" level=info msg="cleaning up dead shim"
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.316494312Z" level=warning msg="cleanup warnings time=\"2023-09-06T23:42:23Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=1896 runtime=io.containerd.runc.v2\n"
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.524413630Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-r8mwq,Uid:b16a92a9-b232-4fa9-b437-c1694e6728ac,Namespace:kube-system,Attempt:0,}"
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.525958331Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kindnet-q9bjh,Uid:a9ed2b6a-a209-41c6-8cde-e896a26f2664,Namespace:kube-system,Attempt:0,}"
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.545082420Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.545158181Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.545168104Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.545374272Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/dbd180a5fea6bccc06f39ece56f98ef0c1bfb16977e6a58b035256ae190ad3f8 pid=1926 runtime=io.containerd.runc.v2
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.547567148Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.547644756Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.547661137Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.547876440Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/b0849656201d6668b0f9f7473ed2ddd668852ff4f8daeef45176b74db61ad8f2 pid=1938 runtime=io.containerd.runc.v2
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.594407637Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-r8mwq,Uid:b16a92a9-b232-4fa9-b437-c1694e6728ac,Namespace:kube-system,Attempt:0,} returns sandbox id \"dbd180a5fea6bccc06f39ece56f98ef0c1bfb16977e6a58b035256ae190ad3f8\""
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.597153366Z" level=info msg="CreateContainer within sandbox \"dbd180a5fea6bccc06f39ece56f98ef0c1bfb16977e6a58b035256ae190ad3f8\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}"
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.610322124Z" level=info msg="CreateContainer within sandbox \"dbd180a5fea6bccc06f39ece56f98ef0c1bfb16977e6a58b035256ae190ad3f8\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"fd35967b6835ea0df8d4f2051a4c892a7f9979c97cabd16e2d577b0c3a9b8203\""
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.610799506Z" level=info msg="StartContainer for \"fd35967b6835ea0df8d4f2051a4c892a7f9979c97cabd16e2d577b0c3a9b8203\""
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.638316194Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-5dd5756b68-gb5v8,Uid:3b4db2a2-c95a-40bf-be4a-d524690bfc7a,Namespace:kube-system,Attempt:0,}"
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.663620552Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-5dd5756b68-gb5v8,Uid:3b4db2a2-c95a-40bf-be4a-d524690bfc7a,Namespace:kube-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\": failed to find network info for sandbox \"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\""
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.720147070Z" level=info msg="StartContainer for \"fd35967b6835ea0df8d4f2051a4c892a7f9979c97cabd16e2d577b0c3a9b8203\" returns successfully"
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.834072568Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kindnet-q9bjh,Uid:a9ed2b6a-a209-41c6-8cde-e896a26f2664,Namespace:kube-system,Attempt:0,} returns sandbox id \"b0849656201d6668b0f9f7473ed2ddd668852ff4f8daeef45176b74db61ad8f2\""
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.837138416Z" level=info msg="CreateContainer within sandbox \"b0849656201d6668b0f9f7473ed2ddd668852ff4f8daeef45176b74db61ad8f2\" for container &ContainerMetadata{Name:kindnet-cni,Attempt:0,}"
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.850282661Z" level=info msg="CreateContainer within sandbox \"b0849656201d6668b0f9f7473ed2ddd668852ff4f8daeef45176b74db61ad8f2\" for &ContainerMetadata{Name:kindnet-cni,Attempt:0,} returns container id \"2a79d424124c56ce9e492a5666638bf0e858c19270135eaa14f0b3606e819ba8\""
	Sep 06 23:42:23 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:23.850875999Z" level=info msg="StartContainer for \"2a79d424124c56ce9e492a5666638bf0e858c19270135eaa14f0b3606e819ba8\""
	Sep 06 23:42:24 dockerenv-198309 containerd[787]: time="2023-09-06T23:42:24.035484367Z" level=info msg="StartContainer for \"2a79d424124c56ce9e492a5666638bf0e858c19270135eaa14f0b3606e819ba8\" returns successfully"
	
	* 
	* ==> describe nodes <==
	* Name:               dockerenv-198309
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=dockerenv-198309
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=cf47a38f14700a28a638c18f21764b75f0a296b2
	                    minikube.k8s.io/name=dockerenv-198309
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_09_06T23_42_10_0700
	                    minikube.k8s.io/version=v1.31.2
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 06 Sep 2023 23:42:06 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  dockerenv-198309
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 06 Sep 2023 23:42:20 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 06 Sep 2023 23:42:10 +0000   Wed, 06 Sep 2023 23:42:05 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 06 Sep 2023 23:42:10 +0000   Wed, 06 Sep 2023 23:42:05 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 06 Sep 2023 23:42:10 +0000   Wed, 06 Sep 2023 23:42:05 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 06 Sep 2023 23:42:10 +0000   Wed, 06 Sep 2023 23:42:10 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    dockerenv-198309
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32859440Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32859440Ki
	  pods:               110
	System Info:
	  Machine ID:                 94c627f0028149fb94142c5db0c1064f
	  System UUID:                ea526f2b-2bbb-4622-bb30-396cdedac15b
	  Boot ID:                    e5950180-8f0a-478c-94d9-54ec6c368fa0
	  Kernel Version:             5.15.0-1040-gcp
	  OS Image:                   Ubuntu 22.04.3 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  containerd://1.6.22
	  Kubelet Version:            v1.28.1
	  Kube-Proxy Version:         v1.28.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-5dd5756b68-gb5v8                    100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     1s
	  kube-system                 etcd-dockerenv-198309                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         14s
	  kube-system                 kindnet-q9bjh                               100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      1s
	  kube-system                 kube-apiserver-dockerenv-198309             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         15s
	  kube-system                 kube-controller-manager-dockerenv-198309    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16s
	  kube-system                 kube-proxy-r8mwq                            0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         1s
	  kube-system                 kube-scheduler-dockerenv-198309             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         14s
	  kube-system                 storage-provisioner                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (10%!)(MISSING)  100m (1%!)(MISSING)
	  memory             220Mi (0%!)(MISSING)  220Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 0s                 kube-proxy       
	  Normal  Starting                 21s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  21s (x8 over 21s)  kubelet          Node dockerenv-198309 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    21s (x8 over 21s)  kubelet          Node dockerenv-198309 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     21s (x7 over 21s)  kubelet          Node dockerenv-198309 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  21s                kubelet          Updated Node Allocatable limit across pods
	  Normal  Starting                 14s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  14s                kubelet          Node dockerenv-198309 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    14s                kubelet          Node dockerenv-198309 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     14s                kubelet          Node dockerenv-198309 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             14s                kubelet          Node dockerenv-198309 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  14s                kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                14s                kubelet          Node dockerenv-198309 status is now: NodeReady
	  Normal  RegisteredNode           2s                 node-controller  Node dockerenv-198309 event: Registered Node dockerenv-198309 in Controller
	
	* 
	* ==> dmesg <==
	* [Sep 6 21:12] kauditd_printk_skb: 3 callbacks suppressed
	
	* 
	* ==> etcd [7a26b25f63553e797ae6a40719b6a758f2e21b64dcf8b9f157687ce5a4280728] <==
	* {"level":"info","ts":"2023-09-06T23:42:04.737011Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-09-06T23:42:04.734992Z","caller":"etcdserver/server.go:738","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"aec36adc501070cc","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
	{"level":"info","ts":"2023-09-06T23:42:04.738567Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2023-09-06T23:42:04.738735Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2023-09-06T23:42:04.738773Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2023-09-06T23:42:04.738819Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-09-06T23:42:04.738839Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-09-06T23:42:05.027678Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-09-06T23:42:05.027726Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-09-06T23:42:05.027758Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-09-06T23:42:05.027781Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-09-06T23:42:05.027794Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-09-06T23:42:05.027808Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-09-06T23:42:05.027821Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-09-06T23:42:05.028719Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-09-06T23:42:05.02938Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-09-06T23:42:05.029402Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-09-06T23:42:05.029376Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:dockerenv-198309 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-09-06T23:42:05.029666Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-09-06T23:42:05.02979Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-09-06T23:42:05.029865Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-09-06T23:42:05.03003Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-09-06T23:42:05.030102Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2023-09-06T23:42:05.030682Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2023-09-06T23:42:05.030833Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	
	* 
	* ==> kernel <==
	*  23:42:24 up  5:20,  0 users,  load average: 2.35, 1.88, 1.68
	Linux dockerenv-198309 5.15.0-1040-gcp #48~20.04.1-Ubuntu SMP Fri Aug 25 04:03:42 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.3 LTS"
	
	* 
	* ==> kindnet [2a79d424124c56ce9e492a5666638bf0e858c19270135eaa14f0b3606e819ba8] <==
	* I0906 23:42:24.217359       1 main.go:102] connected to apiserver: https://10.96.0.1:443
	I0906 23:42:24.217434       1 main.go:107] hostIP = 192.168.49.2
	podIP = 192.168.49.2
	I0906 23:42:24.217561       1 main.go:116] setting mtu 1500 for CNI 
	I0906 23:42:24.217583       1 main.go:146] kindnetd IP family: "ipv4"
	I0906 23:42:24.217603       1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
	
	* 
	* ==> kube-apiserver [ee64d925e7a7b0e7416d2355651d7e7a3e0a8403b7d6b0cb30cf015be0fa1514] <==
	* I0906 23:42:06.932209       1 cache.go:32] Waiting for caches to sync for autoregister controller
	I0906 23:42:06.932216       1 cache.go:39] Caches are synced for autoregister controller
	I0906 23:42:06.932288       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0906 23:42:06.928242       1 shared_informer.go:318] Caches are synced for configmaps
	I0906 23:42:06.931721       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0906 23:42:06.931738       1 apf_controller.go:377] Running API Priority and Fairness config worker
	I0906 23:42:06.933429       1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
	I0906 23:42:06.934098       1 controller.go:624] quota admission added evaluator for: namespaces
	E0906 23:42:07.031163       1 controller.go:145] while syncing ConfigMap "kube-system/kube-apiserver-legacy-service-account-token-tracking", err: namespaces "kube-system" not found
	I0906 23:42:07.116381       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
	I0906 23:42:07.830626       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I0906 23:42:07.834208       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I0906 23:42:07.834229       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I0906 23:42:08.197204       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0906 23:42:08.227308       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0906 23:42:08.333821       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
	W0906 23:42:08.339022       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0906 23:42:08.339904       1 controller.go:624] quota admission added evaluator for: endpoints
	I0906 23:42:08.343791       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0906 23:42:08.848106       1 controller.go:624] quota admission added evaluator for: serviceaccounts
	I0906 23:42:09.971878       1 controller.go:624] quota admission added evaluator for: deployments.apps
	I0906 23:42:09.981854       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
	I0906 23:42:09.990462       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
	I0906 23:42:22.952815       1 controller.go:624] quota admission added evaluator for: replicasets.apps
	I0906 23:42:23.201217       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
	
	* 
	* ==> kube-controller-manager [21d8118aaae85c0abd9e0c3984c8750d71f77cc12e0ac1b70142cd71c0e71c3d] <==
	* I0906 23:42:22.393557       1 event.go:307] "Event occurred" object="dockerenv-198309" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node dockerenv-198309 event: Registered Node dockerenv-198309 in Controller"
	I0906 23:42:22.393639       1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="dockerenv-198309"
	I0906 23:42:22.393754       1 node_lifecycle_controller.go:1071] "Controller detected that zone is now in new state" zone="" newState="Normal"
	I0906 23:42:22.399656       1 shared_informer.go:318] Caches are synced for daemon sets
	I0906 23:42:22.399697       1 shared_informer.go:318] Caches are synced for GC
	I0906 23:42:22.403954       1 shared_informer.go:318] Caches are synced for node
	I0906 23:42:22.404005       1 range_allocator.go:174] "Sending events to api server"
	I0906 23:42:22.404035       1 range_allocator.go:178] "Starting range CIDR allocator"
	I0906 23:42:22.404042       1 shared_informer.go:311] Waiting for caches to sync for cidrallocator
	I0906 23:42:22.404051       1 shared_informer.go:318] Caches are synced for cidrallocator
	I0906 23:42:22.410202       1 range_allocator.go:380] "Set node PodCIDR" node="dockerenv-198309" podCIDRs=["10.244.0.0/24"]
	I0906 23:42:22.424015       1 shared_informer.go:318] Caches are synced for cronjob
	I0906 23:42:22.480833       1 shared_informer.go:318] Caches are synced for resource quota
	I0906 23:42:22.502831       1 shared_informer.go:318] Caches are synced for resource quota
	I0906 23:42:22.822545       1 shared_informer.go:318] Caches are synced for garbage collector
	I0906 23:42:22.899359       1 shared_informer.go:318] Caches are synced for garbage collector
	I0906 23:42:22.899393       1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
	I0906 23:42:22.957632       1 event.go:307] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-5dd5756b68 to 1"
	I0906 23:42:23.209864       1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-r8mwq"
	I0906 23:42:23.212021       1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-q9bjh"
	I0906 23:42:23.327129       1 event.go:307] "Event occurred" object="kube-system/coredns-5dd5756b68" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-5dd5756b68-gb5v8"
	I0906 23:42:23.334629       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="377.346518ms"
	I0906 23:42:23.340916       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="6.233807ms"
	I0906 23:42:23.341149       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="86.477µs"
	I0906 23:42:23.348001       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="162.21µs"
	
	* 
	* ==> kube-proxy [fd35967b6835ea0df8d4f2051a4c892a7f9979c97cabd16e2d577b0c3a9b8203] <==
	* I0906 23:42:23.752905       1 server_others.go:69] "Using iptables proxy"
	I0906 23:42:23.762714       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0906 23:42:23.782076       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0906 23:42:23.817437       1 server_others.go:152] "Using iptables Proxier"
	I0906 23:42:23.817489       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I0906 23:42:23.817501       1 server_others.go:438] "Defaulting to no-op detect-local"
	I0906 23:42:23.817541       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0906 23:42:23.817789       1 server.go:846] "Version info" version="v1.28.1"
	I0906 23:42:23.817807       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0906 23:42:23.818413       1 config.go:188] "Starting service config controller"
	I0906 23:42:23.818426       1 config.go:97] "Starting endpoint slice config controller"
	I0906 23:42:23.818452       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0906 23:42:23.818452       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0906 23:42:23.819834       1 config.go:315] "Starting node config controller"
	I0906 23:42:23.819854       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0906 23:42:23.918687       1 shared_informer.go:318] Caches are synced for service config
	I0906 23:42:23.918754       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0906 23:42:23.920664       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [81b812022fc4c0ee4df53f90b657278061257f8e7284c7f4ce3845e8b68fd104] <==
	* E0906 23:42:07.038553       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0906 23:42:07.038505       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0906 23:42:07.038575       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0906 23:42:07.038635       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0906 23:42:07.038653       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0906 23:42:07.038636       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0906 23:42:07.038783       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0906 23:42:07.038884       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0906 23:42:07.039039       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0906 23:42:07.039078       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0906 23:42:07.039102       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0906 23:42:07.039131       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0906 23:42:07.039480       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0906 23:42:07.039508       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0906 23:42:07.873186       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0906 23:42:07.873229       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0906 23:42:07.957086       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0906 23:42:07.957118       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0906 23:42:08.003404       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0906 23:42:08.003439       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0906 23:42:08.027838       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0906 23:42:08.027883       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0906 23:42:08.053651       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0906 23:42:08.053687       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0906 23:42:10.330045       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Sep 06 23:42:22 dockerenv-198309 kubelet[1511]: I0906 23:42:22.485541    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/e2420e85-890f-483d-aa91-c9efca2bb06e-tmp\") pod \"storage-provisioner\" (UID: \"e2420e85-890f-483d-aa91-c9efca2bb06e\") " pod="kube-system/storage-provisioner"
	Sep 06 23:42:22 dockerenv-198309 kubelet[1511]: I0906 23:42:22.485601    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpnxm\" (UniqueName: \"kubernetes.io/projected/e2420e85-890f-483d-aa91-c9efca2bb06e-kube-api-access-hpnxm\") pod \"storage-provisioner\" (UID: \"e2420e85-890f-483d-aa91-c9efca2bb06e\") " pod="kube-system/storage-provisioner"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.160973    1511 scope.go:117] "RemoveContainer" containerID="481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.215219    1511 topology_manager.go:215] "Topology Admit Handler" podUID="b16a92a9-b232-4fa9-b437-c1694e6728ac" podNamespace="kube-system" podName="kube-proxy-r8mwq"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.218295    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/b16a92a9-b232-4fa9-b437-c1694e6728ac-kube-proxy\") pod \"kube-proxy-r8mwq\" (UID: \"b16a92a9-b232-4fa9-b437-c1694e6728ac\") " pod="kube-system/kube-proxy-r8mwq"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.218356    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq8wx\" (UniqueName: \"kubernetes.io/projected/b16a92a9-b232-4fa9-b437-c1694e6728ac-kube-api-access-lq8wx\") pod \"kube-proxy-r8mwq\" (UID: \"b16a92a9-b232-4fa9-b437-c1694e6728ac\") " pod="kube-system/kube-proxy-r8mwq"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.218406    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/b16a92a9-b232-4fa9-b437-c1694e6728ac-xtables-lock\") pod \"kube-proxy-r8mwq\" (UID: \"b16a92a9-b232-4fa9-b437-c1694e6728ac\") " pod="kube-system/kube-proxy-r8mwq"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.218431    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b16a92a9-b232-4fa9-b437-c1694e6728ac-lib-modules\") pod \"kube-proxy-r8mwq\" (UID: \"b16a92a9-b232-4fa9-b437-c1694e6728ac\") " pod="kube-system/kube-proxy-r8mwq"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.221166    1511 topology_manager.go:215] "Topology Admit Handler" podUID="a9ed2b6a-a209-41c6-8cde-e896a26f2664" podNamespace="kube-system" podName="kindnet-q9bjh"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.318717    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/a9ed2b6a-a209-41c6-8cde-e896a26f2664-xtables-lock\") pod \"kindnet-q9bjh\" (UID: \"a9ed2b6a-a209-41c6-8cde-e896a26f2664\") " pod="kube-system/kindnet-q9bjh"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.318991    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpm4p\" (UniqueName: \"kubernetes.io/projected/a9ed2b6a-a209-41c6-8cde-e896a26f2664-kube-api-access-tpm4p\") pod \"kindnet-q9bjh\" (UID: \"a9ed2b6a-a209-41c6-8cde-e896a26f2664\") " pod="kube-system/kindnet-q9bjh"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.319041    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9ed2b6a-a209-41c6-8cde-e896a26f2664-lib-modules\") pod \"kindnet-q9bjh\" (UID: \"a9ed2b6a-a209-41c6-8cde-e896a26f2664\") " pod="kube-system/kindnet-q9bjh"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.319094    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/a9ed2b6a-a209-41c6-8cde-e896a26f2664-cni-cfg\") pod \"kindnet-q9bjh\" (UID: \"a9ed2b6a-a209-41c6-8cde-e896a26f2664\") " pod="kube-system/kindnet-q9bjh"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.332709    1511 topology_manager.go:215] "Topology Admit Handler" podUID="3b4db2a2-c95a-40bf-be4a-d524690bfc7a" podNamespace="kube-system" podName="coredns-5dd5756b68-gb5v8"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.519680    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b4db2a2-c95a-40bf-be4a-d524690bfc7a-config-volume\") pod \"coredns-5dd5756b68-gb5v8\" (UID: \"3b4db2a2-c95a-40bf-be4a-d524690bfc7a\") " pod="kube-system/coredns-5dd5756b68-gb5v8"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: I0906 23:42:23.519726    1511 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb89b\" (UniqueName: \"kubernetes.io/projected/3b4db2a2-c95a-40bf-be4a-d524690bfc7a-kube-api-access-jb89b\") pod \"coredns-5dd5756b68-gb5v8\" (UID: \"3b4db2a2-c95a-40bf-be4a-d524690bfc7a\") " pod="kube-system/coredns-5dd5756b68-gb5v8"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: E0906 23:42:23.664036    1511 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\": failed to find network info for sandbox \"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\""
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: E0906 23:42:23.664115    1511 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\": failed to find network info for sandbox \"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\"" pod="kube-system/coredns-5dd5756b68-gb5v8"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: E0906 23:42:23.664139    1511 kuberuntime_manager.go:1119] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\": failed to find network info for sandbox \"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\"" pod="kube-system/coredns-5dd5756b68-gb5v8"
	Sep 06 23:42:23 dockerenv-198309 kubelet[1511]: E0906 23:42:23.664198    1511 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-5dd5756b68-gb5v8_kube-system(3b4db2a2-c95a-40bf-be4a-d524690bfc7a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-5dd5756b68-gb5v8_kube-system(3b4db2a2-c95a-40bf-be4a-d524690bfc7a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\\\": failed to find network info for sandbox \\\"e7fd84516631fb03a0280a33d94fcaadb959dbaec6ba2936386cc3cc403c2c99\\\"\"" pod="kube-system/coredns-5dd5756b68-gb5v8" podUID="3b4db2a2-c95a-40bf-be4a-d524690bfc7a"
	Sep 06 23:42:24 dockerenv-198309 kubelet[1511]: I0906 23:42:24.165221    1511 scope.go:117] "RemoveContainer" containerID="481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec"
	Sep 06 23:42:24 dockerenv-198309 kubelet[1511]: I0906 23:42:24.165557    1511 scope.go:117] "RemoveContainer" containerID="f40f12bd36f71009472d584285a195a8bc828ad3a32d7aa0e87b3873380a4b7b"
	Sep 06 23:42:24 dockerenv-198309 kubelet[1511]: E0906 23:42:24.165839    1511 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(e2420e85-890f-483d-aa91-c9efca2bb06e)\"" pod="kube-system/storage-provisioner" podUID="e2420e85-890f-483d-aa91-c9efca2bb06e"
	Sep 06 23:42:24 dockerenv-198309 kubelet[1511]: I0906 23:42:24.196062    1511 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-proxy-r8mwq" podStartSLOduration=1.196012036 podCreationTimestamp="2023-09-06 23:42:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-06 23:42:24.187099058 +0000 UTC m=+14.240138779" watchObservedRunningTime="2023-09-06 23:42:24.196012036 +0000 UTC m=+14.249051766"
	Sep 06 23:42:24 dockerenv-198309 kubelet[1511]: I0906 23:42:24.196317    1511 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kindnet-q9bjh" podStartSLOduration=1.196171201 podCreationTimestamp="2023-09-06 23:42:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-06 23:42:24.195872163 +0000 UTC m=+14.248911892" watchObservedRunningTime="2023-09-06 23:42:24.196171201 +0000 UTC m=+14.249210929"
	
	* 
	* ==> storage-provisioner [481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec] <==
	* 
	* ==> storage-provisioner [f40f12bd36f71009472d584285a195a8bc828ad3a32d7aa0e87b3873380a4b7b] <==
	* I0906 23:42:23.253907       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0906 23:42:23.255189       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: connect: connection refused
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	E0906 23:42:24.676188  596552 logs.go:195] command /bin/bash -c "sudo /usr/bin/crictl logs --tail 25 481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec" failed with error: /bin/bash -c "sudo /usr/bin/crictl logs --tail 25 481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec": Process exited with status 1
	stdout:
	
	stderr:
	E0906 23:42:24.673466    2460 remote_runtime.go:625] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec\": not found" containerID="481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec"
	time="2023-09-06T23:42:24Z" level=fatal msg="rpc error: code = NotFound desc = an error occurred when try to find container \"481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec\": not found"
	 output: "\n** stderr ** \nE0906 23:42:24.673466    2460 remote_runtime.go:625] \"ContainerStatus from runtime service failed\" err=\"rpc error: code = NotFound desc = an error occurred when try to find container \\\"481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec\\\": not found\" containerID=\"481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec\"\ntime=\"2023-09-06T23:42:24Z\" level=fatal msg=\"rpc error: code = NotFound desc = an error occurred when try to find container \\\"481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec\\\": not found\"\n\n** /stderr **"
	! unable to fetch logs for: storage-provisioner [481ad4ba0e372743d13998503053ebb9dd8fd042ca95766c698a10f531978bec]

                                                
                                                
** /stderr **
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p dockerenv-198309 -n dockerenv-198309
helpers_test.go:261: (dbg) Run:  kubectl --context dockerenv-198309 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: coredns-5dd5756b68-gb5v8
helpers_test.go:274: ======> post-mortem[TestDockerEnvContainerd]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context dockerenv-198309 describe pod coredns-5dd5756b68-gb5v8
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context dockerenv-198309 describe pod coredns-5dd5756b68-gb5v8: exit status 1 (64.056495ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "coredns-5dd5756b68-gb5v8" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context dockerenv-198309 describe pod coredns-5dd5756b68-gb5v8: exit status 1
helpers_test.go:175: Cleaning up "dockerenv-198309" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p dockerenv-198309
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p dockerenv-198309: (1.849713007s)
--- FAIL: TestDockerEnvContainerd (38.96s)

                                                
                                    
x
+
TestMissingContainerUpgrade (218.4s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:321: (dbg) Run:  /tmp/minikube-v1.22.0.2940080389.exe start -p missing-upgrade-599530 --memory=2200 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:321: (dbg) Done: /tmp/minikube-v1.22.0.2940080389.exe start -p missing-upgrade-599530 --memory=2200 --driver=docker  --container-runtime=containerd: (1m41.732846148s)
version_upgrade_test.go:330: (dbg) Run:  docker stop missing-upgrade-599530
version_upgrade_test.go:330: (dbg) Done: docker stop missing-upgrade-599530: (10.344865514s)
version_upgrade_test.go:335: (dbg) Run:  docker rm missing-upgrade-599530
version_upgrade_test.go:341: (dbg) Run:  out/minikube-linux-amd64 start -p missing-upgrade-599530 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:341: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p missing-upgrade-599530 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: exit status 90 (1m40.35477973s)

                                                
                                                
-- stdout --
	* [missing-upgrade-599530] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=17174
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.28.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.1
	* Using the docker driver based on existing profile
	* Starting control plane node missing-upgrade-599530 in cluster missing-upgrade-599530
	* Pulling base image ...
	* Downloading Kubernetes v1.21.2 preload ...
	* docker "missing-upgrade-599530" container is missing, will recreate.
	* Creating docker container (CPUs=2, Memory=2200MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0907 00:05:42.904385  731404 out.go:296] Setting OutFile to fd 1 ...
	I0907 00:05:42.904506  731404 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0907 00:05:42.904517  731404 out.go:309] Setting ErrFile to fd 2...
	I0907 00:05:42.904524  731404 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0907 00:05:42.904736  731404 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	I0907 00:05:42.905296  731404 out.go:303] Setting JSON to false
	I0907 00:05:42.906815  731404 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":20616,"bootTime":1694024527,"procs":796,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0907 00:05:42.906878  731404 start.go:138] virtualization: kvm guest
	I0907 00:05:42.911296  731404 out.go:177] * [missing-upgrade-599530] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	I0907 00:05:42.912918  731404 out.go:177]   - MINIKUBE_LOCATION=17174
	I0907 00:05:42.912970  731404 preload.go:306] deleting older generation preload /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-containerd-overlay2-amd64.tar.lz4
	I0907 00:05:42.912985  731404 notify.go:220] Checking for updates...
	I0907 00:05:42.915846  731404 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0907 00:05:42.917436  731404 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0907 00:05:42.918866  731404 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	I0907 00:05:42.920402  731404 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0907 00:05:42.922144  731404 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0907 00:05:42.924404  731404 config.go:182] Loaded profile config "missing-upgrade-599530": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0907 00:05:42.926958  731404 out.go:177] * Kubernetes 1.28.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.1
	I0907 00:05:42.928457  731404 driver.go:373] Setting default libvirt URI to qemu:///system
	I0907 00:05:42.955233  731404 docker.go:121] docker version: linux-24.0.6:Docker Engine - Community
	I0907 00:05:42.955373  731404 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0907 00:05:43.018213  731404 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:65 SystemTime:2023-09-07 00:05:43.008247253 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0907 00:05:43.018397  731404 docker.go:294] overlay module found
	I0907 00:05:43.020643  731404 out.go:177] * Using the docker driver based on existing profile
	I0907 00:05:43.022021  731404 start.go:298] selected driver: docker
	I0907 00:05:43.022039  731404 start.go:902] validating driver "docker" against &{Name:missing-upgrade-599530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:missing-upgrade-599530 Namespace:default APIServerName:minikubeCA APIServer
Names:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.21.2 ContainerRuntime: ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID: BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:0s}
	I0907 00:05:43.022153  731404 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0907 00:05:43.023388  731404 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0907 00:05:43.057475  731404 preload.go:306] deleting older generation preload /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-containerd-overlay2-amd64.tar.lz4.checksum
	I0907 00:05:43.080864  731404 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:65 SystemTime:2023-09-07 00:05:43.071889854 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0907 00:05:43.081188  731404 cni.go:84] Creating CNI manager for ""
	I0907 00:05:43.081208  731404 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0907 00:05:43.081219  731404 start_flags.go:321] config:
	{Name:missing-upgrade-599530 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:missing-upgrade-599530 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.21.2 ContainerRuntime: ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID: BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAut
hSock: SSHAgentPID:0 AutoPauseInterval:0s}
	I0907 00:05:43.083809  731404 out.go:177] * Starting control plane node missing-upgrade-599530 in cluster missing-upgrade-599530
	I0907 00:05:43.085219  731404 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0907 00:05:43.086582  731404 out.go:177] * Pulling base image ...
	I0907 00:05:43.087873  731404 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0907 00:05:43.087904  731404 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon
	I0907 00:05:43.106586  731404 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon, skipping pull
	I0907 00:05:43.106613  731404 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 exists in daemon, skipping load
	I0907 00:05:43.437529  731404 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.21.2/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-amd64.tar.lz4
	I0907 00:05:43.437561  731404 cache.go:57] Caching tarball of preloaded images
	I0907 00:05:43.437716  731404 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0907 00:05:43.439913  731404 out.go:177] * Downloading Kubernetes v1.21.2 preload ...
	I0907 00:05:43.441510  731404 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-amd64.tar.lz4 ...
	I0907 00:05:43.574770  731404 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.21.2/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-amd64.tar.lz4?checksum=md5:1962145810117db2773062d16463a139 -> /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-amd64.tar.lz4
	I0907 00:05:56.544480  731404 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-amd64.tar.lz4 ...
	I0907 00:05:56.544572  731404 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-amd64.tar.lz4 ...
	I0907 00:05:57.464370  731404 cache.go:60] Finished verifying existence of preloaded tar for  v1.21.2 on containerd
	I0907 00:05:57.464513  731404 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/missing-upgrade-599530/config.json ...
	I0907 00:05:57.464732  731404 cache.go:195] Successfully downloaded all kic artifacts
	I0907 00:05:57.464776  731404 start.go:365] acquiring machines lock for missing-upgrade-599530: {Name:mk68a46b899a590a79c8edab2ee6d37ae0e0423a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0907 00:05:57.464870  731404 start.go:369] acquired machines lock for "missing-upgrade-599530" in 52.731µs
	I0907 00:05:57.464888  731404 start.go:96] Skipping create...Using existing machine configuration
	I0907 00:05:57.464893  731404 fix.go:54] fixHost starting: 
	I0907 00:05:57.465177  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:05:57.480028  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:05:57.480127  731404 fix.go:102] recreateIfNeeded on missing-upgrade-599530: state= err=unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:57.480150  731404 fix.go:107] machineExists: false. err=machine does not exist
	I0907 00:05:57.483336  731404 out.go:177] * docker "missing-upgrade-599530" container is missing, will recreate.
	I0907 00:05:57.484661  731404 delete.go:124] DEMOLISHING missing-upgrade-599530 ...
	I0907 00:05:57.484735  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:05:57.499456  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	W0907 00:05:57.499509  731404 stop.go:75] unable to get state: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:57.499531  731404 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:57.499873  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:05:57.513987  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:05:57.514057  731404 delete.go:82] Unable to get host status for missing-upgrade-599530, assuming it has already been deleted: state: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:57.514118  731404 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-599530
	W0907 00:05:57.528465  731404 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-599530 returned with exit code 1
	I0907 00:05:57.528504  731404 kic.go:367] could not find the container missing-upgrade-599530 to remove it. will try anyways
	I0907 00:05:57.528542  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:05:57.542898  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	W0907 00:05:57.542960  731404 oci.go:84] error getting container status, will try to delete anyways: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:57.543013  731404 cli_runner.go:164] Run: docker exec --privileged -t missing-upgrade-599530 /bin/bash -c "sudo init 0"
	W0907 00:05:57.556963  731404 cli_runner.go:211] docker exec --privileged -t missing-upgrade-599530 /bin/bash -c "sudo init 0" returned with exit code 1
	I0907 00:05:57.556998  731404 oci.go:647] error shutdown missing-upgrade-599530: docker exec --privileged -t missing-upgrade-599530 /bin/bash -c "sudo init 0": exit status 1
	stdout:
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:58.558043  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:05:58.575464  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:05:58.575541  731404 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:58.575557  731404 oci.go:661] temporary error: container missing-upgrade-599530 status is  but expect it to be exited
	I0907 00:05:58.575591  731404 retry.go:31] will retry after 420.226726ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:58.996277  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:05:59.013097  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:05:59.013181  731404 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:59.013200  731404 oci.go:661] temporary error: container missing-upgrade-599530 status is  but expect it to be exited
	I0907 00:05:59.013225  731404 retry.go:31] will retry after 739.104564ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:59.753196  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:05:59.769450  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:05:59.769516  731404 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:05:59.769539  731404 oci.go:661] temporary error: container missing-upgrade-599530 status is  but expect it to be exited
	I0907 00:05:59.769561  731404 retry.go:31] will retry after 1.435116326s: couldn't verify container is exited. %v: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:01.206152  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:06:01.222549  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:06:01.222624  731404 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:01.222636  731404 oci.go:661] temporary error: container missing-upgrade-599530 status is  but expect it to be exited
	I0907 00:06:01.222660  731404 retry.go:31] will retry after 1.997747336s: couldn't verify container is exited. %v: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:03.220735  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:06:03.239392  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:06:03.239474  731404 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:03.239491  731404 oci.go:661] temporary error: container missing-upgrade-599530 status is  but expect it to be exited
	I0907 00:06:03.239524  731404 retry.go:31] will retry after 2.854134475s: couldn't verify container is exited. %v: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:06.096106  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:06:06.110854  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:06:06.110922  731404 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:06.110955  731404 oci.go:661] temporary error: container missing-upgrade-599530 status is  but expect it to be exited
	I0907 00:06:06.110988  731404 retry.go:31] will retry after 4.098366143s: couldn't verify container is exited. %v: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:10.209604  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:06:10.235322  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:06:10.235399  731404 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:10.235422  731404 oci.go:661] temporary error: container missing-upgrade-599530 status is  but expect it to be exited
	I0907 00:06:10.235458  731404 retry.go:31] will retry after 3.023196901s: couldn't verify container is exited. %v: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:13.259340  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:06:13.275836  731404 cli_runner.go:211] docker container inspect missing-upgrade-599530 --format={{.State.Status}} returned with exit code 1
	I0907 00:06:13.275913  731404 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	I0907 00:06:13.275927  731404 oci.go:661] temporary error: container missing-upgrade-599530 status is  but expect it to be exited
	I0907 00:06:13.275977  731404 oci.go:88] couldn't shut down missing-upgrade-599530 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "missing-upgrade-599530": docker container inspect missing-upgrade-599530 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-599530
	 
	I0907 00:06:13.276046  731404 cli_runner.go:164] Run: docker rm -f -v missing-upgrade-599530
	I0907 00:06:13.291517  731404 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-599530
	W0907 00:06:13.307590  731404 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-599530 returned with exit code 1
	I0907 00:06:13.307691  731404 cli_runner.go:164] Run: docker network inspect missing-upgrade-599530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0907 00:06:13.324490  731404 cli_runner.go:164] Run: docker network rm missing-upgrade-599530
	I0907 00:06:13.440863  731404 fix.go:114] Sleeping 1 second for extra luck!
	I0907 00:06:14.441960  731404 start.go:125] createHost starting for "" (driver="docker")
	I0907 00:06:14.443608  731404 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0907 00:06:14.443751  731404 start.go:159] libmachine.API.Create for "missing-upgrade-599530" (driver="docker")
	I0907 00:06:14.443774  731404 client.go:168] LocalClient.Create starting
	I0907 00:06:14.443864  731404 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem
	I0907 00:06:14.443901  731404 main.go:141] libmachine: Decoding PEM data...
	I0907 00:06:14.443918  731404 main.go:141] libmachine: Parsing certificate...
	I0907 00:06:14.444026  731404 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem
	I0907 00:06:14.444057  731404 main.go:141] libmachine: Decoding PEM data...
	I0907 00:06:14.444069  731404 main.go:141] libmachine: Parsing certificate...
	I0907 00:06:14.444294  731404 cli_runner.go:164] Run: docker network inspect missing-upgrade-599530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0907 00:06:14.460981  731404 cli_runner.go:211] docker network inspect missing-upgrade-599530 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0907 00:06:14.461066  731404 network_create.go:281] running [docker network inspect missing-upgrade-599530] to gather additional debugging logs...
	I0907 00:06:14.461092  731404 cli_runner.go:164] Run: docker network inspect missing-upgrade-599530
	W0907 00:06:14.477436  731404 cli_runner.go:211] docker network inspect missing-upgrade-599530 returned with exit code 1
	I0907 00:06:14.477476  731404 network_create.go:284] error running [docker network inspect missing-upgrade-599530]: docker network inspect missing-upgrade-599530: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network missing-upgrade-599530 not found
	I0907 00:06:14.477497  731404 network_create.go:286] output of [docker network inspect missing-upgrade-599530]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network missing-upgrade-599530 not found
	
	** /stderr **
	I0907 00:06:14.477584  731404 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0907 00:06:14.495198  731404 network.go:214] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-e51a5a8e7767 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:69:3a:ee:53} reservation:<nil>}
	I0907 00:06:14.496131  731404 network.go:214] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-205627a57fc4 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:78:9e:51:86} reservation:<nil>}
	I0907 00:06:14.497090  731404 network.go:214] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-0e93685c5366 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:7e:23:50:24} reservation:<nil>}
	I0907 00:06:14.498119  731404 network.go:214] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-3df51fa1a0f9 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:84:a6:dd:26} reservation:<nil>}
	I0907 00:06:14.499346  731404 network.go:209] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0006f15b0}
	I0907 00:06:14.499376  731404 network_create.go:123] attempt to create docker network missing-upgrade-599530 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
	I0907 00:06:14.499432  731404 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=missing-upgrade-599530 missing-upgrade-599530
	I0907 00:06:14.559514  731404 network_create.go:107] docker network missing-upgrade-599530 192.168.85.0/24 created
	I0907 00:06:14.559549  731404 kic.go:117] calculated static IP "192.168.85.2" for the "missing-upgrade-599530" container
	I0907 00:06:14.559617  731404 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0907 00:06:14.577688  731404 cli_runner.go:164] Run: docker volume create missing-upgrade-599530 --label name.minikube.sigs.k8s.io=missing-upgrade-599530 --label created_by.minikube.sigs.k8s.io=true
	I0907 00:06:14.597201  731404 oci.go:103] Successfully created a docker volume missing-upgrade-599530
	I0907 00:06:14.597279  731404 cli_runner.go:164] Run: docker run --rm --name missing-upgrade-599530-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-599530 --entrypoint /usr/bin/test -v missing-upgrade-599530:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib
	I0907 00:06:17.752857  731404 cli_runner.go:217] Completed: docker run --rm --name missing-upgrade-599530-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-599530 --entrypoint /usr/bin/test -v missing-upgrade-599530:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib: (3.15553309s)
	I0907 00:06:17.752890  731404 oci.go:107] Successfully prepared a docker volume missing-upgrade-599530
	I0907 00:06:17.752952  731404 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0907 00:06:17.752980  731404 kic.go:190] Starting extracting preloaded images to volume ...
	I0907 00:06:17.753053  731404 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-599530:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir
	I0907 00:06:27.481150  731404 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-599530:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir: (9.728041717s)
	I0907 00:06:27.481190  731404 kic.go:199] duration metric: took 9.728204 seconds to extract preloaded images to volume
	W0907 00:06:27.481324  731404 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0907 00:06:27.481450  731404 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0907 00:06:27.576275  731404 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-599530 --name missing-upgrade-599530 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-599530 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-599530 --network missing-upgrade-599530 --ip 192.168.85.2 --volume missing-upgrade-599530:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79
	I0907 00:06:28.040789  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Running}}
	I0907 00:06:28.072847  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	I0907 00:06:28.098596  731404 cli_runner.go:164] Run: docker exec missing-upgrade-599530 stat /var/lib/dpkg/alternatives/iptables
	I0907 00:06:28.190472  731404 oci.go:144] the created container "missing-upgrade-599530" has a running status.
	I0907 00:06:28.190501  731404 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa...
	I0907 00:06:28.501093  731404 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0907 00:06:28.525770  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	I0907 00:06:28.565737  731404 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0907 00:06:28.565762  731404 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-599530 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0907 00:06:28.689078  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	I0907 00:06:28.716074  731404 machine.go:88] provisioning docker machine ...
	I0907 00:06:28.716114  731404 ubuntu.go:169] provisioning hostname "missing-upgrade-599530"
	I0907 00:06:28.716205  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:28.751217  731404 main.go:141] libmachine: Using SSH client type: native
	I0907 00:06:28.752095  731404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32972 <nil> <nil>}
	I0907 00:06:28.752213  731404 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-599530 && echo "missing-upgrade-599530" | sudo tee /etc/hostname
	I0907 00:06:28.904238  731404 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-599530
	
	I0907 00:06:28.904399  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:28.926017  731404 main.go:141] libmachine: Using SSH client type: native
	I0907 00:06:28.926502  731404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32972 <nil> <nil>}
	I0907 00:06:28.926524  731404 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-599530' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-599530/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-599530' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0907 00:06:29.057841  731404 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0907 00:06:29.057874  731404 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17174-571027/.minikube CaCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17174-571027/.minikube}
	I0907 00:06:29.057898  731404 ubuntu.go:177] setting up certificates
	I0907 00:06:29.057909  731404 provision.go:83] configureAuth start
	I0907 00:06:29.057968  731404 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-599530
	I0907 00:06:29.085303  731404 provision.go:138] copyHostCerts
	I0907 00:06:29.085378  731404 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem, removing ...
	I0907 00:06:29.085389  731404 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem
	I0907 00:06:29.085468  731404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem (1078 bytes)
	I0907 00:06:29.085568  731404 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem, removing ...
	I0907 00:06:29.085586  731404 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem
	I0907 00:06:29.085623  731404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem (1123 bytes)
	I0907 00:06:29.085695  731404 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem, removing ...
	I0907 00:06:29.085705  731404 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem
	I0907 00:06:29.085737  731404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem (1679 bytes)
	I0907 00:06:29.085794  731404 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-599530 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-599530]
	I0907 00:06:29.385522  731404 provision.go:172] copyRemoteCerts
	I0907 00:06:29.385583  731404 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0907 00:06:29.385634  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:29.402253  731404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32972 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa Username:docker}
	I0907 00:06:29.491779  731404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0907 00:06:29.511900  731404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0907 00:06:29.534969  731404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0907 00:06:29.565663  731404 provision.go:86] duration metric: configureAuth took 507.739796ms
	I0907 00:06:29.565692  731404 ubuntu.go:193] setting minikube options for container-runtime
	I0907 00:06:29.565900  731404 config.go:182] Loaded profile config "missing-upgrade-599530": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0907 00:06:29.565915  731404 machine.go:91] provisioned docker machine in 849.818235ms
	I0907 00:06:29.565923  731404 client.go:171] LocalClient.Create took 15.122143574s
	I0907 00:06:29.565943  731404 start.go:167] duration metric: libmachine.API.Create for "missing-upgrade-599530" took 15.122192203s
	I0907 00:06:29.565956  731404 start.go:300] post-start starting for "missing-upgrade-599530" (driver="docker")
	I0907 00:06:29.565967  731404 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0907 00:06:29.566024  731404 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0907 00:06:29.566069  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:29.585596  731404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32972 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa Username:docker}
	I0907 00:06:29.672617  731404 ssh_runner.go:195] Run: cat /etc/os-release
	I0907 00:06:29.675751  731404 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0907 00:06:29.675771  731404 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0907 00:06:29.675782  731404 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0907 00:06:29.675788  731404 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0907 00:06:29.675797  731404 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/addons for local assets ...
	I0907 00:06:29.675845  731404 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/files for local assets ...
	I0907 00:06:29.675908  731404 filesync.go:149] local asset: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem -> 5777822.pem in /etc/ssl/certs
	I0907 00:06:29.676015  731404 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0907 00:06:29.682940  731404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem --> /etc/ssl/certs/5777822.pem (1708 bytes)
	I0907 00:06:29.702154  731404 start.go:303] post-start completed in 136.181196ms
	I0907 00:06:29.702519  731404 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-599530
	I0907 00:06:29.723429  731404 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/missing-upgrade-599530/config.json ...
	I0907 00:06:29.724678  731404 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0907 00:06:29.724748  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:29.774356  731404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32972 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa Username:docker}
	I0907 00:06:29.862042  731404 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0907 00:06:29.867464  731404 start.go:128] duration metric: createHost completed in 15.42546889s
	I0907 00:06:29.867575  731404 cli_runner.go:164] Run: docker container inspect missing-upgrade-599530 --format={{.State.Status}}
	W0907 00:06:29.888120  731404 fix.go:128] unexpected machine state, will restart: <nil>
	I0907 00:06:29.888150  731404 machine.go:88] provisioning docker machine ...
	I0907 00:06:29.888174  731404 ubuntu.go:169] provisioning hostname "missing-upgrade-599530"
	I0907 00:06:29.888243  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:29.908618  731404 main.go:141] libmachine: Using SSH client type: native
	I0907 00:06:29.909087  731404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32972 <nil> <nil>}
	I0907 00:06:29.909108  731404 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-599530 && echo "missing-upgrade-599530" | sudo tee /etc/hostname
	I0907 00:06:30.054423  731404 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-599530
	
	I0907 00:06:30.054512  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:30.081316  731404 main.go:141] libmachine: Using SSH client type: native
	I0907 00:06:30.081730  731404 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32972 <nil> <nil>}
	I0907 00:06:30.081748  731404 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-599530' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-599530/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-599530' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0907 00:06:30.211898  731404 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0907 00:06:30.211946  731404 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17174-571027/.minikube CaCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17174-571027/.minikube}
	I0907 00:06:30.211970  731404 ubuntu.go:177] setting up certificates
	I0907 00:06:30.211981  731404 provision.go:83] configureAuth start
	I0907 00:06:30.212042  731404 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-599530
	I0907 00:06:30.235397  731404 provision.go:138] copyHostCerts
	I0907 00:06:30.235484  731404 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem, removing ...
	I0907 00:06:30.235494  731404 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem
	I0907 00:06:30.235566  731404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem (1078 bytes)
	I0907 00:06:30.235743  731404 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem, removing ...
	I0907 00:06:30.235751  731404 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem
	I0907 00:06:30.235789  731404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem (1123 bytes)
	I0907 00:06:30.235917  731404 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem, removing ...
	I0907 00:06:30.235928  731404 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem
	I0907 00:06:30.236056  731404 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem (1679 bytes)
	I0907 00:06:30.236141  731404 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-599530 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-599530]
	I0907 00:06:30.456209  731404 provision.go:172] copyRemoteCerts
	I0907 00:06:30.456282  731404 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0907 00:06:30.456337  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:30.477674  731404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32972 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa Username:docker}
	I0907 00:06:30.568838  731404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0907 00:06:30.587924  731404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0907 00:06:30.606374  731404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0907 00:06:30.624647  731404 provision.go:86] duration metric: configureAuth took 412.653442ms
	I0907 00:06:30.624674  731404 ubuntu.go:193] setting minikube options for container-runtime
	I0907 00:06:30.624896  731404 config.go:182] Loaded profile config "missing-upgrade-599530": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0907 00:06:30.624913  731404 machine.go:91] provisioned docker machine in 736.755889ms
	I0907 00:06:30.624923  731404 start.go:300] post-start starting for "missing-upgrade-599530" (driver="docker")
	I0907 00:06:30.624948  731404 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0907 00:06:30.625002  731404 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0907 00:06:30.625048  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:30.659340  731404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32972 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa Username:docker}
	I0907 00:06:30.752613  731404 ssh_runner.go:195] Run: cat /etc/os-release
	I0907 00:06:30.756598  731404 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0907 00:06:30.756631  731404 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0907 00:06:30.756643  731404 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0907 00:06:30.756651  731404 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0907 00:06:30.756664  731404 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/addons for local assets ...
	I0907 00:06:30.756725  731404 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/files for local assets ...
	I0907 00:06:30.756837  731404 filesync.go:149] local asset: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem -> 5777822.pem in /etc/ssl/certs
	I0907 00:06:30.756985  731404 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0907 00:06:30.767933  731404 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem --> /etc/ssl/certs/5777822.pem (1708 bytes)
	I0907 00:06:30.788808  731404 start.go:303] post-start completed in 163.862159ms
	I0907 00:06:30.788913  731404 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0907 00:06:30.788981  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:30.842513  731404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32972 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa Username:docker}
	I0907 00:06:30.934602  731404 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0907 00:06:30.941748  731404 fix.go:56] fixHost completed within 33.476844175s
	I0907 00:06:30.941780  731404 start.go:83] releasing machines lock for "missing-upgrade-599530", held for 33.476896072s
	I0907 00:06:30.941856  731404 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-599530
	I0907 00:06:30.964413  731404 ssh_runner.go:195] Run: cat /version.json
	I0907 00:06:30.964472  731404 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0907 00:06:30.964485  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:30.964536  731404 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-599530
	I0907 00:06:30.981141  731404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32972 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa Username:docker}
	I0907 00:06:30.984971  731404 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32972 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/missing-upgrade-599530/id_rsa Username:docker}
	W0907 00:06:31.067925  731404 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0907 00:06:31.068031  731404 ssh_runner.go:195] Run: systemctl --version
	I0907 00:06:31.109732  731404 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0907 00:06:31.114372  731404 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0907 00:06:31.139750  731404 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0907 00:06:31.139852  731404 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0907 00:06:31.167454  731404 cni.go:262] disabled [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0907 00:06:31.167481  731404 start.go:466] detecting cgroup driver to use...
	I0907 00:06:31.167508  731404 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0907 00:06:31.167547  731404 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0907 00:06:31.179294  731404 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0907 00:06:31.190520  731404 docker.go:196] disabling cri-docker service (if available) ...
	I0907 00:06:31.190586  731404 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0907 00:06:31.201269  731404 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0907 00:06:31.210090  731404 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	W0907 00:06:31.220717  731404 docker.go:206] Failed to disable socket "cri-docker.socket" (might be ok): sudo systemctl disable cri-docker.socket: Process exited with status 1
	stdout:
	
	stderr:
	Failed to disable unit: Unit file cri-docker.socket does not exist.
	I0907 00:06:31.220779  731404 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0907 00:06:31.310578  731404 docker.go:212] disabling docker service ...
	I0907 00:06:31.310657  731404 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0907 00:06:31.329223  731404 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0907 00:06:31.339462  731404 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0907 00:06:31.425195  731404 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0907 00:06:31.525901  731404 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0907 00:06:31.537207  731404 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0907 00:06:31.551733  731404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.4.1"|' /etc/containerd/config.toml"
	I0907 00:06:31.559698  731404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0907 00:06:31.567846  731404 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0907 00:06:31.567917  731404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0907 00:06:31.575892  731404 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0907 00:06:31.584274  731404 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0907 00:06:31.592361  731404 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0907 00:06:31.600412  731404 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0907 00:06:31.607692  731404 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0907 00:06:31.615675  731404 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0907 00:06:31.622463  731404 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0907 00:06:31.629743  731404 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0907 00:06:31.743068  731404 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0907 00:06:31.818531  731404 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0907 00:06:31.818607  731404 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0907 00:06:31.822520  731404 start.go:534] Will wait 60s for crictl version
	I0907 00:06:31.822582  731404 ssh_runner.go:195] Run: which crictl
	I0907 00:06:31.825672  731404 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0907 00:06:31.850182  731404 retry.go:31] will retry after 5.770313434s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:06:31Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0907 00:06:37.624065  731404 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0907 00:06:37.657915  731404 retry.go:31] will retry after 21.353962257s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:06:37Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0907 00:06:59.012104  731404 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0907 00:06:59.036911  731404 retry.go:31] will retry after 24.141700699s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:06:59Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0907 00:07:23.179567  731404 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0907 00:07:23.208195  731404 out.go:177] 
	W0907 00:07:23.209628  731404 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	W0907 00:07:23.209663  731404 out.go:239] * 
	* 
	W0907 00:07:23.210777  731404 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0907 00:07:23.212304  731404 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:343: failed missing container upgrade from v1.22.0. args: out/minikube-linux-amd64 start -p missing-upgrade-599530 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd : exit status 90
version_upgrade_test.go:345: *** TestMissingContainerUpgrade FAILED at 2023-09-07 00:07:23.241070131 +0000 UTC m=+1787.472435461
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestMissingContainerUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect missing-upgrade-599530
helpers_test.go:235: (dbg) docker inspect missing-upgrade-599530:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "77a08a083f8ea5fe68125793afc591c202fe8a7d294a078a5a6437d7746b3099",
	        "Created": "2023-09-07T00:06:27.599561368Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 738056,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-09-07T00:06:28.028171318Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:8768eddc4356afffe3e639d96dfedd92c4546269e9e4366ab52cf09f53c80b71",
	        "ResolvConfPath": "/var/lib/docker/containers/77a08a083f8ea5fe68125793afc591c202fe8a7d294a078a5a6437d7746b3099/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/77a08a083f8ea5fe68125793afc591c202fe8a7d294a078a5a6437d7746b3099/hostname",
	        "HostsPath": "/var/lib/docker/containers/77a08a083f8ea5fe68125793afc591c202fe8a7d294a078a5a6437d7746b3099/hosts",
	        "LogPath": "/var/lib/docker/containers/77a08a083f8ea5fe68125793afc591c202fe8a7d294a078a5a6437d7746b3099/77a08a083f8ea5fe68125793afc591c202fe8a7d294a078a5a6437d7746b3099-json.log",
	        "Name": "/missing-upgrade-599530",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "missing-upgrade-599530:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "missing-upgrade-599530",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/71516c273d66dae7686215051c758ce06ff09b2ec01103f1461a297a7ec4e933-init/diff:/var/lib/docker/overlay2/027408ca372bcb7369d84b96df808fefd2b3ca30ab27cce5941e211005cc9555/diff:/var/lib/docker/overlay2/8507cefbee4e3f7ed94d4a882f5d09a23302aec6ad6dd7953ca8f1b9c598711b/diff:/var/lib/docker/overlay2/8476ae0be3e93f7cca386d92102256e3289e2e8929380f766d75dcc9d5aa3f99/diff:/var/lib/docker/overlay2/ede190db4810d854f5a86532f4ecf63a3acd94a561d1d58f312208f44b2f2fa1/diff:/var/lib/docker/overlay2/e5e6f307e039fef41f0a6f9d35b4de661320acfd1a62db8f3acc222e43b9582a/diff:/var/lib/docker/overlay2/1100d2285bd3778de65d1417181039e79f81bbf9bec3c34f721e0177c480c3e6/diff:/var/lib/docker/overlay2/d1d744f991ffe9ddd5751e988740e98b7605acc0721c79602b4824ce1257795d/diff:/var/lib/docker/overlay2/91c63acb60660e7bb57cb0a38c4d14135dff606ba7bdeb65cff87ce2cfee511c/diff:/var/lib/docker/overlay2/18c158c24c93e412c3863150c048defa26580808f370bdd12b20c0e21a7f7405/diff:/var/lib/docker/overlay2/a86ae0
2ba8ed489fc2a0638aeec82ee33621f0d41512129ce27537347eaf57a6/diff:/var/lib/docker/overlay2/c9018bce4d7f75cd30de0118bf190fd822b26075af767a3431f9542e4c6f01b3/diff:/var/lib/docker/overlay2/b1ac7262431c721950671bee32cf0a02ef574463a1bfe54399a03f439e2b1c9e/diff:/var/lib/docker/overlay2/aefcce648e3ce9cc7bc556b01e8db5a71cc0b76f5282d27858afb036d5673270/diff:/var/lib/docker/overlay2/e6150f84a0b4ce6f59def2a20ef8a24a77bf2212095e605069f15a778bf49505/diff:/var/lib/docker/overlay2/a023f32142d84c5206265ced9ab7a11735ed0763b4c3fce3e21d6cea91e99420/diff:/var/lib/docker/overlay2/53d8dd84149cee72f778de36e478b38ca0d6d8bfb4df205983f982dedaea08fd/diff:/var/lib/docker/overlay2/56878a6bc377253f96cb5dfbbd21a7ed0f5f7f77535ddaafae951cf1494208c6/diff:/var/lib/docker/overlay2/245c618d15f3dbe1048df047c5141556115f296a0bc3941573a350faea0d2d9d/diff:/var/lib/docker/overlay2/ec88039eb7ebc841f019ff9ba9d2d4f7807a05437250631328d3cc9e89bcb25e/diff:/var/lib/docker/overlay2/0e29486f31a15df8d3a358b32f2d27b82cf4a4645706ea805f5c37b6b5e79b70/diff:/var/lib/d
ocker/overlay2/3e96773a82182ae79a44988aa910e731d38d224b07e1c58da5f51e508e8eb41f/diff:/var/lib/docker/overlay2/61e7ebe1e2f1d7bb8f0d224411c8a79bb8379f1b2a778011c72daca30b2a67ad/diff:/var/lib/docker/overlay2/686cc3eaf3711ad347f36ffa9f2234be2d07387bc7a2f5aaf2067cecc4a9c75c/diff:/var/lib/docker/overlay2/521b665c780b3bd38f8069a8e8f5a83d2e586c29f51d2881ec94a538ceb8efc9/diff:/var/lib/docker/overlay2/3fb57ab7dc91228d665cdd9092fdc6240cfe55ddd2521803f91e7f910f4b26fd/diff:/var/lib/docker/overlay2/7dcaec54c0facf2a31a30741f8cedbdb6e98d4f5473487847e610db0560da7be/diff:/var/lib/docker/overlay2/398c05187fdeb46c26feb3f00d0663e09c670407920764b2a9321ab280773163/diff:/var/lib/docker/overlay2/8b03bacf1f1f3e1262afe12ce6e7b7a63830d6a5ebbb6705df64a3ead2f87c96/diff:/var/lib/docker/overlay2/392dc1e7e9a7445117a72bd01a01e820dfb51a70446ca17f1a20b4506284bdf6/diff:/var/lib/docker/overlay2/f23f8fddcfe5ceb08e423d1008518e2b75c3dd305f91551367ad1bd53a5c2fbf/diff:/var/lib/docker/overlay2/aa430506c6d68e78ca21d4fbd6551e7ced44cbdaa8d332360fab45bb543
0f4b9/diff:/var/lib/docker/overlay2/b101b50136e40c52ecad7b469d78ea663fb6b72563e0c9bb9621945a59e87ea7/diff:/var/lib/docker/overlay2/954a22ecdea194f73428b7e04b3f2a3093e72f5bd7ab4fa9d5d916087d7ed3b7/diff:/var/lib/docker/overlay2/5b804881f7a8a304ceb2ebc45e4fedb8a1370e9436d1a407e8a56ea3ade05b78/diff:/var/lib/docker/overlay2/47fff529c94cf810d57f2443d13e216b880257fb4ea8ae1e0612ea0a3dc4dbc5/diff:/var/lib/docker/overlay2/bff5e8924e1a442ee68bb271f92d2e4cb521cb116cadc9cd5c4988952755cd52/diff",
	                "MergedDir": "/var/lib/docker/overlay2/71516c273d66dae7686215051c758ce06ff09b2ec01103f1461a297a7ec4e933/merged",
	                "UpperDir": "/var/lib/docker/overlay2/71516c273d66dae7686215051c758ce06ff09b2ec01103f1461a297a7ec4e933/diff",
	                "WorkDir": "/var/lib/docker/overlay2/71516c273d66dae7686215051c758ce06ff09b2ec01103f1461a297a7ec4e933/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "missing-upgrade-599530",
	                "Source": "/var/lib/docker/volumes/missing-upgrade-599530/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "missing-upgrade-599530",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "missing-upgrade-599530",
	                "name.minikube.sigs.k8s.io": "missing-upgrade-599530",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "cb824305d69d176c625d285f979bf54f8a6016823f0859f14b882270ccfa1ca2",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32972"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32971"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32968"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32970"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32969"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/cb824305d69d",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "missing-upgrade-599530": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "77a08a083f8e",
	                        "missing-upgrade-599530"
	                    ],
	                    "NetworkID": "d9adcad66a94f12d18db8e63ddfe5a15f842f3728d7ac4a78e70dbe8799aa54b",
	                    "EndpointID": "7438b103a9d19904efe506a0b1b142f22b8d98df1a307771085f7f3ce3b32758",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:55:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p missing-upgrade-599530 -n missing-upgrade-599530
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p missing-upgrade-599530 -n missing-upgrade-599530: exit status 2 (262.216975ms)

                                                
                                                
-- stdout --
	Running

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestMissingContainerUpgrade FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestMissingContainerUpgrade]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p missing-upgrade-599530 logs -n 25
helpers_test.go:252: TestMissingContainerUpgrade logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                         Args                         |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| ssh     | -p cilium-972540 sudo cat                            | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | /etc/kubernetes/kubelet.conf                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo cat                            | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | /var/lib/kubelet/config.yaml                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | systemctl status docker --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | systemctl cat docker                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo cat                            | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | /etc/docker/daemon.json                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo docker                         | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | system info                                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | systemctl status cri-docker                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | systemctl cat cri-docker                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo cat                            | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo cat                            | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | cri-dockerd --version                                |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | systemctl status containerd                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | systemctl cat containerd                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo cat                            | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | /lib/systemd/system/containerd.service               |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo cat                            | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | /etc/containerd/config.toml                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | containerd config dump                               |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | systemctl status crio --all                          |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo                                | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | systemctl cat crio --no-pager                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo find                           | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | /etc/crio -type f -exec sh -c                        |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-972540 sudo crio                           | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC |                     |
	|         | config                                               |                           |         |         |                     |                     |
	| delete  | -p cilium-972540                                     | cilium-972540             | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC | 07 Sep 23 00:06 UTC |
	| start   | -p cert-expiration-754141                            | cert-expiration-754141    | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC | 07 Sep 23 00:07 UTC |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --cert-expiration=3m                                 |                           |         |         |                     |                     |
	|         | --driver=docker                                      |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                       |                           |         |         |                     |                     |
	| ssh     | force-systemd-env-717311                             | force-systemd-env-717311  | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC | 07 Sep 23 00:06 UTC |
	|         | ssh cat                                              |                           |         |         |                     |                     |
	|         | /etc/containerd/config.toml                          |                           |         |         |                     |                     |
	| delete  | -p force-systemd-env-717311                          | force-systemd-env-717311  | jenkins | v1.31.2 | 07 Sep 23 00:06 UTC | 07 Sep 23 00:07 UTC |
	| start   | -p force-systemd-flag-448041                         | force-systemd-flag-448041 | jenkins | v1.31.2 | 07 Sep 23 00:07 UTC |                     |
	|         | --memory=2048 --force-systemd                        |                           |         |         |                     |                     |
	|         | --alsologtostderr                                    |                           |         |         |                     |                     |
	|         | -v=5 --driver=docker                                 |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                       |                           |         |         |                     |                     |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/09/07 00:07:01
	Running on machine: ubuntu-20-agent-6
	Binary: Built with gc go1.20.7 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0907 00:07:01.928477  747137 out.go:296] Setting OutFile to fd 1 ...
	I0907 00:07:01.928628  747137 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0907 00:07:01.928638  747137 out.go:309] Setting ErrFile to fd 2...
	I0907 00:07:01.928645  747137 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0907 00:07:01.928999  747137 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	I0907 00:07:01.929774  747137 out.go:303] Setting JSON to false
	I0907 00:07:01.932020  747137 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":20695,"bootTime":1694024527,"procs":1007,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0907 00:07:01.932103  747137 start.go:138] virtualization: kvm guest
	I0907 00:07:01.934763  747137 out.go:177] * [force-systemd-flag-448041] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	I0907 00:07:01.936899  747137 out.go:177]   - MINIKUBE_LOCATION=17174
	I0907 00:07:01.938340  747137 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0907 00:07:01.936951  747137 notify.go:220] Checking for updates...
	I0907 00:07:01.940171  747137 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0907 00:07:01.941623  747137 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	I0907 00:07:01.943387  747137 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0907 00:07:01.945280  747137 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0907 00:07:01.948397  747137 config.go:182] Loaded profile config "cert-expiration-754141": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0907 00:07:01.948525  747137 config.go:182] Loaded profile config "kubernetes-upgrade-500801": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0907 00:07:01.948632  747137 config.go:182] Loaded profile config "missing-upgrade-599530": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0907 00:07:01.948765  747137 driver.go:373] Setting default libvirt URI to qemu:///system
	I0907 00:07:01.971428  747137 docker.go:121] docker version: linux-24.0.6:Docker Engine - Community
	I0907 00:07:01.971546  747137 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0907 00:07:02.047351  747137 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:79 SystemTime:2023-09-07 00:07:02.037108662 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0907 00:07:02.047457  747137 docker.go:294] overlay module found
	I0907 00:07:02.050064  747137 out.go:177] * Using the docker driver based on user configuration
	I0907 00:07:02.051647  747137 start.go:298] selected driver: docker
	I0907 00:07:02.051658  747137 start.go:902] validating driver "docker" against <nil>
	I0907 00:07:02.051670  747137 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0907 00:07:02.068968  747137 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0907 00:07:02.154848  747137 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:52 OomKillDisable:true NGoroutines:67 SystemTime:2023-09-07 00:07:02.139709109 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0907 00:07:02.155088  747137 start_flags.go:307] no existing cluster config was found, will generate one from the flags 
	I0907 00:07:02.155366  747137 start_flags.go:904] Wait components to verify : map[apiserver:true system_pods:true]
	I0907 00:07:02.157764  747137 out.go:177] * Using Docker driver with root privileges
	I0907 00:07:02.159446  747137 cni.go:84] Creating CNI manager for ""
	I0907 00:07:02.159476  747137 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0907 00:07:02.159496  747137 start_flags.go:316] Found "CNI" CNI - setting NetworkPlugin=cni
	I0907 00:07:02.159515  747137 start_flags.go:321] config:
	{Name:force-systemd-flag-448041 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:force-systemd-flag-448041 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0907 00:07:02.161083  747137 out.go:177] * Starting control plane node force-systemd-flag-448041 in cluster force-systemd-flag-448041
	I0907 00:07:02.162375  747137 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0907 00:07:02.163846  747137 out.go:177] * Pulling base image ...
	I0907 00:07:02.165325  747137 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0907 00:07:02.165401  747137 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4
	I0907 00:07:02.165416  747137 cache.go:57] Caching tarball of preloaded images
	I0907 00:07:02.165426  747137 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local docker daemon
	I0907 00:07:02.165500  747137 preload.go:174] Found /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
	I0907 00:07:02.165511  747137 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.1 on containerd
	I0907 00:07:02.165664  747137 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/config.json ...
	I0907 00:07:02.165685  747137 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/config.json: {Name:mk5fbb0da3656e86e57032fc7823928c19c3fbe6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:02.185834  747137 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local docker daemon, skipping pull
	I0907 00:07:02.185859  747137 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b exists in daemon, skipping load
	I0907 00:07:02.185873  747137 cache.go:195] Successfully downloaded all kic artifacts
	I0907 00:07:02.185908  747137 start.go:365] acquiring machines lock for force-systemd-flag-448041: {Name:mkf3875240790b28c283531986af60272e7ee554 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0907 00:07:02.186009  747137 start.go:369] acquired machines lock for "force-systemd-flag-448041" in 83.504µs
	I0907 00:07:02.186033  747137 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-448041 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:force-systemd-flag-448041 Namespace:default AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:
SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0907 00:07:02.186123  747137 start.go:125] createHost starting for "" (driver="docker")
	I0907 00:06:59.012104  731404 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0907 00:06:59.036911  731404 retry.go:31] will retry after 24.141700699s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:06:59Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0907 00:06:58.668520  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:06:58.669053  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:06:59.168646  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:06:59.169157  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:06:59.668665  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:06:59.669153  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:00.168671  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:00.169188  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:00.668704  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:00.669207  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:01.168742  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:01.169237  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:01.668765  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:01.669187  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:02.168766  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:02.169191  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:02.668792  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:02.669209  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:03.168720  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:03.169147  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:01.091193  745693 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cert-expiration-754141:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b -I lz4 -xf /preloaded.tar -C /extractDir: (4.766218704s)
	I0907 00:07:01.091220  745693 kic.go:199] duration metric: took 4.766363 seconds to extract preloaded images to volume
	W0907 00:07:01.091773  745693 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0907 00:07:01.092128  745693 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0907 00:07:01.151011  745693 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cert-expiration-754141 --name cert-expiration-754141 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cert-expiration-754141 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cert-expiration-754141 --network cert-expiration-754141 --ip 192.168.112.2 --volume cert-expiration-754141:/var --security-opt apparmor=unconfined --memory=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b
	I0907 00:07:01.693749  745693 cli_runner.go:164] Run: docker container inspect cert-expiration-754141 --format={{.State.Running}}
	I0907 00:07:01.713552  745693 cli_runner.go:164] Run: docker container inspect cert-expiration-754141 --format={{.State.Status}}
	I0907 00:07:01.732354  745693 cli_runner.go:164] Run: docker exec cert-expiration-754141 stat /var/lib/dpkg/alternatives/iptables
	I0907 00:07:01.806220  745693 oci.go:144] the created container "cert-expiration-754141" has a running status.
	I0907 00:07:01.806251  745693 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa...
	I0907 00:07:01.960890  745693 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0907 00:07:01.984890  745693 cli_runner.go:164] Run: docker container inspect cert-expiration-754141 --format={{.State.Status}}
	I0907 00:07:02.005506  745693 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0907 00:07:02.005522  745693 kic_runner.go:114] Args: [docker exec --privileged cert-expiration-754141 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0907 00:07:02.082726  745693 cli_runner.go:164] Run: docker container inspect cert-expiration-754141 --format={{.State.Status}}
	I0907 00:07:02.106067  745693 machine.go:88] provisioning docker machine ...
	I0907 00:07:02.106106  745693 ubuntu.go:169] provisioning hostname "cert-expiration-754141"
	I0907 00:07:02.106169  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:02.133567  745693 main.go:141] libmachine: Using SSH client type: native
	I0907 00:07:02.134009  745693 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32982 <nil> <nil>}
	I0907 00:07:02.134020  745693 main.go:141] libmachine: About to run SSH command:
	sudo hostname cert-expiration-754141 && echo "cert-expiration-754141" | sudo tee /etc/hostname
	I0907 00:07:02.134705  745693 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:36534->127.0.0.1:32982: read: connection reset by peer
	I0907 00:07:02.189296  747137 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...
	I0907 00:07:02.189538  747137 start.go:159] libmachine.API.Create for "force-systemd-flag-448041" (driver="docker")
	I0907 00:07:02.189566  747137 client.go:168] LocalClient.Create starting
	I0907 00:07:02.189621  747137 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem
	I0907 00:07:02.189655  747137 main.go:141] libmachine: Decoding PEM data...
	I0907 00:07:02.189675  747137 main.go:141] libmachine: Parsing certificate...
	I0907 00:07:02.189752  747137 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem
	I0907 00:07:02.189770  747137 main.go:141] libmachine: Decoding PEM data...
	I0907 00:07:02.189781  747137 main.go:141] libmachine: Parsing certificate...
	I0907 00:07:02.190110  747137 cli_runner.go:164] Run: docker network inspect force-systemd-flag-448041 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0907 00:07:02.206093  747137 cli_runner.go:211] docker network inspect force-systemd-flag-448041 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0907 00:07:02.206162  747137 network_create.go:281] running [docker network inspect force-systemd-flag-448041] to gather additional debugging logs...
	I0907 00:07:02.206183  747137 cli_runner.go:164] Run: docker network inspect force-systemd-flag-448041
	W0907 00:07:02.226035  747137 cli_runner.go:211] docker network inspect force-systemd-flag-448041 returned with exit code 1
	I0907 00:07:02.226073  747137 network_create.go:284] error running [docker network inspect force-systemd-flag-448041]: docker network inspect force-systemd-flag-448041: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network force-systemd-flag-448041 not found
	I0907 00:07:02.226097  747137 network_create.go:286] output of [docker network inspect force-systemd-flag-448041]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network force-systemd-flag-448041 not found
	
	** /stderr **
	I0907 00:07:02.226168  747137 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0907 00:07:02.244135  747137 network.go:214] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-e51a5a8e7767 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:69:3a:ee:53} reservation:<nil>}
	I0907 00:07:02.245010  747137 network.go:214] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-205627a57fc4 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:78:9e:51:86} reservation:<nil>}
	I0907 00:07:02.246044  747137 network.go:214] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-0e93685c5366 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:7e:23:50:24} reservation:<nil>}
	I0907 00:07:02.247063  747137 network.go:214] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-3df51fa1a0f9 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:84:a6:dd:26} reservation:<nil>}
	I0907 00:07:02.248441  747137 network.go:214] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName:br-d9adcad66a94 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:02:42:fe:a1:bc:17} reservation:<nil>}
	I0907 00:07:02.249675  747137 network.go:214] skipping subnet 192.168.94.0/24 that is taken: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName:br-ce378ebedf53 IfaceIPv4:192.168.94.1 IfaceMTU:1500 IfaceMAC:02:42:4d:82:fd:bb} reservation:<nil>}
	I0907 00:07:02.252493  747137 network.go:209] using free private subnet 192.168.103.0/24: &{IP:192.168.103.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.103.0/24 Gateway:192.168.103.1 ClientMin:192.168.103.2 ClientMax:192.168.103.254 Broadcast:192.168.103.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00180e000}
	I0907 00:07:02.252568  747137 network_create.go:123] attempt to create docker network force-systemd-flag-448041 192.168.103.0/24 with gateway 192.168.103.1 and MTU of 1500 ...
	I0907 00:07:02.252693  747137 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.103.0/24 --gateway=192.168.103.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=force-systemd-flag-448041 force-systemd-flag-448041
	I0907 00:07:02.321705  747137 network_create.go:107] docker network force-systemd-flag-448041 192.168.103.0/24 created
	I0907 00:07:02.321746  747137 kic.go:117] calculated static IP "192.168.103.2" for the "force-systemd-flag-448041" container
	I0907 00:07:02.321821  747137 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0907 00:07:02.351025  747137 cli_runner.go:164] Run: docker volume create force-systemd-flag-448041 --label name.minikube.sigs.k8s.io=force-systemd-flag-448041 --label created_by.minikube.sigs.k8s.io=true
	I0907 00:07:02.370633  747137 oci.go:103] Successfully created a docker volume force-systemd-flag-448041
	I0907 00:07:02.370730  747137 cli_runner.go:164] Run: docker run --rm --name force-systemd-flag-448041-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-448041 --entrypoint /usr/bin/test -v force-systemd-flag-448041:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b -d /var/lib
	I0907 00:07:02.892187  747137 oci.go:107] Successfully prepared a docker volume force-systemd-flag-448041
	I0907 00:07:02.892229  747137 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0907 00:07:02.892253  747137 kic.go:190] Starting extracting preloaded images to volume ...
	I0907 00:07:02.892326  747137 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-flag-448041:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b -I lz4 -xf /preloaded.tar -C /extractDir
	I0907 00:07:05.338208  745693 main.go:141] libmachine: SSH cmd err, output: <nil>: cert-expiration-754141
	
	I0907 00:07:05.401320  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:05.418489  745693 main.go:141] libmachine: Using SSH client type: native
	I0907 00:07:05.418912  745693 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32982 <nil> <nil>}
	I0907 00:07:05.418926  745693 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\scert-expiration-754141' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 cert-expiration-754141/g' /etc/hosts;
				else 
					echo '127.0.1.1 cert-expiration-754141' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0907 00:07:05.548263  745693 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0907 00:07:05.548284  745693 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17174-571027/.minikube CaCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17174-571027/.minikube}
	I0907 00:07:05.548304  745693 ubuntu.go:177] setting up certificates
	I0907 00:07:05.548312  745693 provision.go:83] configureAuth start
	I0907 00:07:05.548361  745693 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cert-expiration-754141
	I0907 00:07:05.565664  745693 provision.go:138] copyHostCerts
	I0907 00:07:05.565715  745693 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem, removing ...
	I0907 00:07:05.565721  745693 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem
	I0907 00:07:05.565784  745693 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem (1078 bytes)
	I0907 00:07:05.565867  745693 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem, removing ...
	I0907 00:07:05.565870  745693 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem
	I0907 00:07:05.565891  745693 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem (1123 bytes)
	I0907 00:07:05.565941  745693 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem, removing ...
	I0907 00:07:05.565944  745693 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem
	I0907 00:07:05.565962  745693 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem (1679 bytes)
	I0907 00:07:05.566003  745693 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem org=jenkins.cert-expiration-754141 san=[192.168.112.2 127.0.0.1 localhost 127.0.0.1 minikube cert-expiration-754141]
	I0907 00:07:05.655828  745693 provision.go:172] copyRemoteCerts
	I0907 00:07:05.655894  745693 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0907 00:07:05.655966  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:05.674263  745693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32982 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa Username:docker}
	I0907 00:07:05.773127  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0907 00:07:05.796329  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0907 00:07:05.818966  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0907 00:07:05.841132  745693 provision.go:86] duration metric: configureAuth took 292.807342ms
	I0907 00:07:05.841150  745693 ubuntu.go:193] setting minikube options for container-runtime
	I0907 00:07:05.841300  745693 config.go:182] Loaded profile config "cert-expiration-754141": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0907 00:07:05.841305  745693 machine.go:91] provisioned docker machine in 3.735220936s
	I0907 00:07:05.841309  745693 client.go:171] LocalClient.Create took 10.303303786s
	I0907 00:07:05.841326  745693 start.go:167] duration metric: libmachine.API.Create for "cert-expiration-754141" took 10.303372689s
	I0907 00:07:05.841331  745693 start.go:300] post-start starting for "cert-expiration-754141" (driver="docker")
	I0907 00:07:05.841338  745693 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0907 00:07:05.841384  745693 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0907 00:07:05.841421  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:05.860332  745693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32982 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa Username:docker}
	I0907 00:07:05.953713  745693 ssh_runner.go:195] Run: cat /etc/os-release
	I0907 00:07:05.957207  745693 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0907 00:07:05.957233  745693 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0907 00:07:05.957240  745693 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0907 00:07:05.957246  745693 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I0907 00:07:05.957257  745693 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/addons for local assets ...
	I0907 00:07:05.957306  745693 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/files for local assets ...
	I0907 00:07:05.957367  745693 filesync.go:149] local asset: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem -> 5777822.pem in /etc/ssl/certs
	I0907 00:07:05.957440  745693 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0907 00:07:05.965947  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem --> /etc/ssl/certs/5777822.pem (1708 bytes)
	I0907 00:07:05.990547  745693 start.go:303] post-start completed in 149.202818ms
	I0907 00:07:05.990897  745693 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cert-expiration-754141
	I0907 00:07:06.009017  745693 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/config.json ...
	I0907 00:07:06.052214  745693 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0907 00:07:06.052281  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:06.069439  745693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32982 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa Username:docker}
	I0907 00:07:06.160907  745693 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0907 00:07:06.165062  745693 start.go:128] duration metric: createHost completed in 10.629564259s
	I0907 00:07:06.165077  745693 start.go:83] releasing machines lock for "cert-expiration-754141", held for 10.629705107s
	I0907 00:07:06.165135  745693 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cert-expiration-754141
	I0907 00:07:06.182791  745693 ssh_runner.go:195] Run: cat /version.json
	I0907 00:07:06.182834  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:06.182869  745693 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0907 00:07:06.182935  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:06.199134  745693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32982 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa Username:docker}
	I0907 00:07:06.200840  745693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32982 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa Username:docker}
	I0907 00:07:06.388001  745693 ssh_runner.go:195] Run: systemctl --version
	I0907 00:07:06.392428  745693 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0907 00:07:06.396779  745693 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0907 00:07:06.442161  745693 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0907 00:07:06.442244  745693 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0907 00:07:06.669268  745693 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0907 00:07:06.669282  745693 start.go:466] detecting cgroup driver to use...
	I0907 00:07:06.669317  745693 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0907 00:07:06.669373  745693 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0907 00:07:06.680853  745693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0907 00:07:06.691363  745693 docker.go:196] disabling cri-docker service (if available) ...
	I0907 00:07:06.691412  745693 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0907 00:07:06.703718  745693 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0907 00:07:06.716559  745693 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0907 00:07:06.785661  745693 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0907 00:07:06.861276  745693 docker.go:212] disabling docker service ...
	I0907 00:07:06.861350  745693 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0907 00:07:06.880685  745693 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0907 00:07:06.892003  745693 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0907 00:07:06.960015  745693 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0907 00:07:07.036637  745693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0907 00:07:07.048031  745693 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0907 00:07:07.063752  745693 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0907 00:07:07.073208  745693 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0907 00:07:07.082683  745693 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0907 00:07:07.082743  745693 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0907 00:07:07.102801  745693 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0907 00:07:07.114132  745693 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0907 00:07:07.124984  745693 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0907 00:07:07.135302  745693 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0907 00:07:07.145166  745693 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0907 00:07:07.155074  745693 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0907 00:07:07.163784  745693 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0907 00:07:07.172162  745693 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0907 00:07:07.257735  745693 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0907 00:07:07.378586  745693 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0907 00:07:07.378654  745693 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0907 00:07:07.382387  745693 start.go:534] Will wait 60s for crictl version
	I0907 00:07:07.382440  745693 ssh_runner.go:195] Run: which crictl
	I0907 00:07:07.385808  745693 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0907 00:07:07.423216  745693 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.22
	RuntimeApiVersion:  v1
	I0907 00:07:07.423268  745693 ssh_runner.go:195] Run: containerd --version
	I0907 00:07:07.450727  745693 ssh_runner.go:195] Run: containerd --version
	I0907 00:07:07.478325  745693 out.go:177] * Preparing Kubernetes v1.28.1 on containerd 1.6.22 ...
	I0907 00:07:03.669103  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:03.669550  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:04.169131  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:04.169577  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:04.669188  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:04.669658  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:05.169113  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:05.169604  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:05.669111  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:05.669538  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:06.169118  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:06.169501  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:06.669223  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:06.669748  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:07.169079  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:07.169494  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:07.669100  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:07.669469  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0907 00:07:08.169146  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0907 00:07:08.169214  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0907 00:07:08.205235  731563 cri.go:89] found id: "3a9150038c8d1e7f5f2f679d7f40db47bab9fa30b65d2fbd965e47e1635c9988"
	I0907 00:07:08.205267  731563 cri.go:89] found id: ""
	I0907 00:07:08.205277  731563 logs.go:284] 1 containers: [3a9150038c8d1e7f5f2f679d7f40db47bab9fa30b65d2fbd965e47e1635c9988]
	I0907 00:07:08.205337  731563 ssh_runner.go:195] Run: which crictl
	I0907 00:07:08.209043  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0907 00:07:08.209096  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0907 00:07:07.480113  745693 cli_runner.go:164] Run: docker network inspect cert-expiration-754141 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0907 00:07:07.499403  745693 ssh_runner.go:195] Run: grep 192.168.112.1	host.minikube.internal$ /etc/hosts
	I0907 00:07:07.502870  745693 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.112.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0907 00:07:07.514750  745693 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0907 00:07:07.514804  745693 ssh_runner.go:195] Run: sudo crictl images --output json
	I0907 00:07:07.554804  745693 containerd.go:604] all images are preloaded for containerd runtime.
	I0907 00:07:07.554817  745693 containerd.go:518] Images already preloaded, skipping extraction
	I0907 00:07:07.554870  745693 ssh_runner.go:195] Run: sudo crictl images --output json
	I0907 00:07:07.613481  745693 containerd.go:604] all images are preloaded for containerd runtime.
	I0907 00:07:07.613493  745693 cache_images.go:84] Images are preloaded, skipping loading
	I0907 00:07:07.613543  745693 ssh_runner.go:195] Run: sudo crictl info
	I0907 00:07:07.650213  745693 cni.go:84] Creating CNI manager for ""
	I0907 00:07:07.650228  745693 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0907 00:07:07.650248  745693 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0907 00:07:07.650275  745693 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.112.2 APIServerPort:8443 KubernetesVersion:v1.28.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:cert-expiration-754141 NodeName:cert-expiration-754141 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.112.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.112.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0907 00:07:07.650459  745693 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.112.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "cert-expiration-754141"
	  kubeletExtraArgs:
	    node-ip: 192.168.112.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.112.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0907 00:07:07.650574  745693 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=cert-expiration-754141 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.112.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.1 ClusterName:cert-expiration-754141 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0907 00:07:07.650642  745693 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.1
	I0907 00:07:07.659346  745693 binaries.go:44] Found k8s binaries, skipping transfer
	I0907 00:07:07.659421  745693 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0907 00:07:07.667445  745693 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (395 bytes)
	I0907 00:07:07.683093  745693 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0907 00:07:07.700588  745693 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2114 bytes)
	I0907 00:07:07.717210  745693 ssh_runner.go:195] Run: grep 192.168.112.2	control-plane.minikube.internal$ /etc/hosts
	I0907 00:07:07.721115  745693 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.112.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0907 00:07:07.732540  745693 certs.go:56] Setting up /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141 for IP: 192.168.112.2
	I0907 00:07:07.732569  745693 certs.go:190] acquiring lock for shared ca certs: {Name:mkf023f174f877b5e876cc103f58e9ab0cfa5d55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:07.732746  745693 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.key
	I0907 00:07:07.732791  745693 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.key
	I0907 00:07:07.732843  745693 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/client.key
	I0907 00:07:07.732854  745693 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/client.crt with IP's: []
	I0907 00:07:07.832160  745693 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/client.crt ...
	I0907 00:07:07.832174  745693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/client.crt: {Name:mk31cb0feb3f07b0998f3611fb7759ac372ff5e9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:07.832321  745693 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/client.key ...
	I0907 00:07:07.832327  745693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/client.key: {Name:mkcefb5129d3c4ef02f08dbe1378ee82cee2619c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:07.832400  745693 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.key.9c554139
	I0907 00:07:07.832409  745693 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.crt.9c554139 with IP's: [192.168.112.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0907 00:07:08.035734  745693 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.crt.9c554139 ...
	I0907 00:07:08.035754  745693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.crt.9c554139: {Name:mk92f8eddffd51d3cc4b1a4cba5e467573613e2c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:08.035922  745693 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.key.9c554139 ...
	I0907 00:07:08.035933  745693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.key.9c554139: {Name:mk2afbf845a1e7817e86061da9cf1450dd4bfa05 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:08.036090  745693 certs.go:337] copying /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.crt.9c554139 -> /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.crt
	I0907 00:07:08.036185  745693 certs.go:341] copying /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.key.9c554139 -> /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.key
	I0907 00:07:08.036251  745693 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/proxy-client.key
	I0907 00:07:08.036265  745693 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/proxy-client.crt with IP's: []
	I0907 00:07:08.334428  745693 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/proxy-client.crt ...
	I0907 00:07:08.334446  745693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/proxy-client.crt: {Name:mk6dc3c23f8609d76b1dc0c01f6c1289b46e3ef5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:08.334639  745693 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/proxy-client.key ...
	I0907 00:07:08.334647  745693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/proxy-client.key: {Name:mk02032d9b45837fb03cd20ce5cf1b99e93cf4c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:08.334855  745693 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/577782.pem (1338 bytes)
	W0907 00:07:08.334895  745693 certs.go:433] ignoring /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/577782_empty.pem, impossibly tiny 0 bytes
	I0907 00:07:08.334906  745693 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem (1675 bytes)
	I0907 00:07:08.334933  745693 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem (1078 bytes)
	I0907 00:07:08.334962  745693 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem (1123 bytes)
	I0907 00:07:08.334988  745693 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem (1679 bytes)
	I0907 00:07:08.335039  745693 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem (1708 bytes)
	I0907 00:07:08.335624  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0907 00:07:08.360863  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0907 00:07:08.383812  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0907 00:07:08.406709  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/cert-expiration-754141/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0907 00:07:08.431037  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0907 00:07:08.454422  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0907 00:07:08.478346  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0907 00:07:08.502128  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0907 00:07:08.523805  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/certs/577782.pem --> /usr/share/ca-certificates/577782.pem (1338 bytes)
	I0907 00:07:08.547675  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem --> /usr/share/ca-certificates/5777822.pem (1708 bytes)
	I0907 00:07:08.569146  745693 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0907 00:07:08.591618  745693 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0907 00:07:08.609565  745693 ssh_runner.go:195] Run: openssl version
	I0907 00:07:08.614799  745693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/577782.pem && ln -fs /usr/share/ca-certificates/577782.pem /etc/ssl/certs/577782.pem"
	I0907 00:07:08.624152  745693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/577782.pem
	I0907 00:07:08.628111  745693 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Sep  6 23:43 /usr/share/ca-certificates/577782.pem
	I0907 00:07:08.628155  745693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/577782.pem
	I0907 00:07:08.634458  745693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/577782.pem /etc/ssl/certs/51391683.0"
	I0907 00:07:08.643311  745693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5777822.pem && ln -fs /usr/share/ca-certificates/5777822.pem /etc/ssl/certs/5777822.pem"
	I0907 00:07:08.652333  745693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5777822.pem
	I0907 00:07:08.655784  745693 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Sep  6 23:43 /usr/share/ca-certificates/5777822.pem
	I0907 00:07:08.655831  745693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5777822.pem
	I0907 00:07:08.662277  745693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5777822.pem /etc/ssl/certs/3ec20f2e.0"
	I0907 00:07:08.671037  745693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0907 00:07:08.680307  745693 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0907 00:07:08.684331  745693 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Sep  6 23:38 /usr/share/ca-certificates/minikubeCA.pem
	I0907 00:07:08.684376  745693 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0907 00:07:08.690786  745693 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0907 00:07:08.700095  745693 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0907 00:07:08.703394  745693 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0907 00:07:08.703437  745693 kubeadm.go:404] StartCluster: {Name:cert-expiration-754141 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:cert-expiration-754141 Namespace:default APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.112.2 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:3m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPat
h: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0907 00:07:08.703529  745693 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0907 00:07:08.703561  745693 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0907 00:07:08.737271  745693 cri.go:89] found id: ""
	I0907 00:07:08.737336  745693 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0907 00:07:08.746532  745693 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0907 00:07:08.754821  745693 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0907 00:07:08.754866  745693 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0907 00:07:08.763142  745693 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0907 00:07:08.763178  745693 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0907 00:07:08.811605  745693 kubeadm.go:322] [init] Using Kubernetes version: v1.28.1
	I0907 00:07:08.811655  745693 kubeadm.go:322] [preflight] Running pre-flight checks
	I0907 00:07:08.849193  745693 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0907 00:07:08.849286  745693 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1040-gcp
	I0907 00:07:08.849317  745693 kubeadm.go:322] OS: Linux
	I0907 00:07:08.849377  745693 kubeadm.go:322] CGROUPS_CPU: enabled
	I0907 00:07:08.849413  745693 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0907 00:07:08.849447  745693 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0907 00:07:08.849521  745693 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0907 00:07:08.849561  745693 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0907 00:07:08.849597  745693 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0907 00:07:08.849630  745693 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0907 00:07:08.849699  745693 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0907 00:07:08.849740  745693 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0907 00:07:08.913568  745693 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0907 00:07:08.913684  745693 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0907 00:07:08.913782  745693 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0907 00:07:09.106295  745693 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0907 00:07:09.110120  745693 out.go:204]   - Generating certificates and keys ...
	I0907 00:07:09.110239  745693 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0907 00:07:09.110309  745693 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0907 00:07:09.179367  745693 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0907 00:07:09.494853  745693 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0907 00:07:09.542979  745693 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0907 00:07:09.660500  745693 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0907 00:07:09.781920  745693 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0907 00:07:09.782176  745693 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [cert-expiration-754141 localhost] and IPs [192.168.112.2 127.0.0.1 ::1]
	I0907 00:07:10.008806  745693 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0907 00:07:10.008986  745693 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [cert-expiration-754141 localhost] and IPs [192.168.112.2 127.0.0.1 ::1]
	I0907 00:07:10.134185  745693 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0907 00:07:10.338302  745693 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0907 00:07:10.628425  745693 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0907 00:07:10.628840  745693 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0907 00:07:10.805423  745693 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0907 00:07:10.988214  745693 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0907 00:07:11.234697  745693 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0907 00:07:11.549090  745693 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0907 00:07:11.549773  745693 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0907 00:07:11.553240  745693 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0907 00:07:07.118687  747137 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-flag-448041:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b -I lz4 -xf /preloaded.tar -C /extractDir: (4.226277992s)
	I0907 00:07:07.118718  747137 kic.go:199] duration metric: took 4.226463 seconds to extract preloaded images to volume
	W0907 00:07:07.118834  747137 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0907 00:07:07.118918  747137 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0907 00:07:07.178548  747137 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname force-systemd-flag-448041 --name force-systemd-flag-448041 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-448041 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=force-systemd-flag-448041 --network force-systemd-flag-448041 --ip 192.168.103.2 --volume force-systemd-flag-448041:/var --security-opt apparmor=unconfined --memory=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b
	I0907 00:07:07.497004  747137 cli_runner.go:164] Run: docker container inspect force-systemd-flag-448041 --format={{.State.Running}}
	I0907 00:07:07.515234  747137 cli_runner.go:164] Run: docker container inspect force-systemd-flag-448041 --format={{.State.Status}}
	I0907 00:07:07.534316  747137 cli_runner.go:164] Run: docker exec force-systemd-flag-448041 stat /var/lib/dpkg/alternatives/iptables
	I0907 00:07:07.606477  747137 oci.go:144] the created container "force-systemd-flag-448041" has a running status.
	I0907 00:07:07.606510  747137 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/force-systemd-flag-448041/id_rsa...
	I0907 00:07:07.711046  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/force-systemd-flag-448041/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0907 00:07:07.711086  747137 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17174-571027/.minikube/machines/force-systemd-flag-448041/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0907 00:07:07.733319  747137 cli_runner.go:164] Run: docker container inspect force-systemd-flag-448041 --format={{.State.Status}}
	I0907 00:07:07.750922  747137 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0907 00:07:07.750953  747137 kic_runner.go:114] Args: [docker exec --privileged force-systemd-flag-448041 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0907 00:07:07.812816  747137 cli_runner.go:164] Run: docker container inspect force-systemd-flag-448041 --format={{.State.Status}}
	I0907 00:07:07.829232  747137 machine.go:88] provisioning docker machine ...
	I0907 00:07:07.829278  747137 ubuntu.go:169] provisioning hostname "force-systemd-flag-448041"
	I0907 00:07:07.829338  747137 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-448041
	I0907 00:07:07.853504  747137 main.go:141] libmachine: Using SSH client type: native
	I0907 00:07:07.854199  747137 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32987 <nil> <nil>}
	I0907 00:07:07.854229  747137 main.go:141] libmachine: About to run SSH command:
	sudo hostname force-systemd-flag-448041 && echo "force-systemd-flag-448041" | sudo tee /etc/hostname
	I0907 00:07:07.854990  747137 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51012->127.0.0.1:32987: read: connection reset by peer
	I0907 00:07:10.995256  747137 main.go:141] libmachine: SSH cmd err, output: <nil>: force-systemd-flag-448041
	
	I0907 00:07:10.995359  747137 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-448041
	I0907 00:07:11.014552  747137 main.go:141] libmachine: Using SSH client type: native
	I0907 00:07:11.014982  747137 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80ff00] 0x812fa0 <nil>  [] 0s} 127.0.0.1 32987 <nil> <nil>}
	I0907 00:07:11.015009  747137 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sforce-systemd-flag-448041' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 force-systemd-flag-448041/g' /etc/hosts;
				else 
					echo '127.0.1.1 force-systemd-flag-448041' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0907 00:07:11.140845  747137 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0907 00:07:11.140877  747137 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17174-571027/.minikube CaCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17174-571027/.minikube}
	I0907 00:07:11.140904  747137 ubuntu.go:177] setting up certificates
	I0907 00:07:11.140914  747137 provision.go:83] configureAuth start
	I0907 00:07:11.140962  747137 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-flag-448041
	I0907 00:07:11.156890  747137 provision.go:138] copyHostCerts
	I0907 00:07:11.156933  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem
	I0907 00:07:11.156969  747137 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem, removing ...
	I0907 00:07:11.156982  747137 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem
	I0907 00:07:11.157048  747137 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/key.pem (1679 bytes)
	I0907 00:07:11.157140  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem
	I0907 00:07:11.157167  747137 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem, removing ...
	I0907 00:07:11.157178  747137 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem
	I0907 00:07:11.157217  747137 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/ca.pem (1078 bytes)
	I0907 00:07:11.157282  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem
	I0907 00:07:11.157306  747137 exec_runner.go:144] found /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem, removing ...
	I0907 00:07:11.157315  747137 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem
	I0907 00:07:11.157351  747137 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17174-571027/.minikube/cert.pem (1123 bytes)
	I0907 00:07:11.157416  747137 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem org=jenkins.force-systemd-flag-448041 san=[192.168.103.2 127.0.0.1 localhost 127.0.0.1 minikube force-systemd-flag-448041]
	I0907 00:07:11.401052  747137 provision.go:172] copyRemoteCerts
	I0907 00:07:11.401132  747137 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0907 00:07:11.401181  747137 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-448041
	I0907 00:07:11.417791  747137 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32987 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/force-systemd-flag-448041/id_rsa Username:docker}
	I0907 00:07:11.512706  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0907 00:07:11.512771  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0907 00:07:11.534620  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0907 00:07:11.534685  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
	I0907 00:07:11.557132  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0907 00:07:11.557196  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0907 00:07:11.581263  747137 provision.go:86] duration metric: configureAuth took 440.33403ms
	I0907 00:07:11.581292  747137 ubuntu.go:193] setting minikube options for container-runtime
	I0907 00:07:11.581512  747137 config.go:182] Loaded profile config "force-systemd-flag-448041": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0907 00:07:11.581532  747137 machine.go:91] provisioned docker machine in 3.752273279s
	I0907 00:07:11.581541  747137 client.go:171] LocalClient.Create took 9.391968998s
	I0907 00:07:11.581562  747137 start.go:167] duration metric: libmachine.API.Create for "force-systemd-flag-448041" took 9.392023922s
	I0907 00:07:11.581575  747137 start.go:300] post-start starting for "force-systemd-flag-448041" (driver="docker")
	I0907 00:07:11.581585  747137 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0907 00:07:11.581643  747137 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0907 00:07:11.581698  747137 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-448041
	I0907 00:07:11.599527  747137 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32987 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/force-systemd-flag-448041/id_rsa Username:docker}
	I0907 00:07:11.693895  747137 ssh_runner.go:195] Run: cat /etc/os-release
	I0907 00:07:11.697254  747137 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0907 00:07:11.697300  747137 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0907 00:07:11.697315  747137 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0907 00:07:11.697326  747137 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I0907 00:07:11.697338  747137 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/addons for local assets ...
	I0907 00:07:11.697399  747137 filesync.go:126] Scanning /home/jenkins/minikube-integration/17174-571027/.minikube/files for local assets ...
	I0907 00:07:11.697496  747137 filesync.go:149] local asset: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem -> 5777822.pem in /etc/ssl/certs
	I0907 00:07:11.697508  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem -> /etc/ssl/certs/5777822.pem
	I0907 00:07:11.697619  747137 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0907 00:07:11.705652  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem --> /etc/ssl/certs/5777822.pem (1708 bytes)
	I0907 00:07:11.728730  747137 start.go:303] post-start completed in 147.138432ms
	I0907 00:07:11.729115  747137 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-flag-448041
	I0907 00:07:11.746662  747137 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/config.json ...
	I0907 00:07:11.746946  747137 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0907 00:07:11.747000  747137 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-448041
	I0907 00:07:11.763309  747137 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32987 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/force-systemd-flag-448041/id_rsa Username:docker}
	I0907 00:07:11.858719  747137 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0907 00:07:11.864293  747137 start.go:128] duration metric: createHost completed in 9.678150122s
	I0907 00:07:11.864329  747137 start.go:83] releasing machines lock for "force-systemd-flag-448041", held for 9.678307482s
	I0907 00:07:11.864412  747137 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-flag-448041
	I0907 00:07:11.885091  747137 ssh_runner.go:195] Run: cat /version.json
	I0907 00:07:11.885146  747137 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-448041
	I0907 00:07:11.885164  747137 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0907 00:07:11.885226  747137 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-448041
	I0907 00:07:11.903474  747137 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32987 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/force-systemd-flag-448041/id_rsa Username:docker}
	I0907 00:07:11.905208  747137 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32987 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/force-systemd-flag-448041/id_rsa Username:docker}
	I0907 00:07:12.087262  747137 ssh_runner.go:195] Run: systemctl --version
	I0907 00:07:12.091671  747137 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0907 00:07:12.096026  747137 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0907 00:07:12.120368  747137 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0907 00:07:12.120463  747137 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0907 00:07:12.146620  747137 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0907 00:07:12.146647  747137 start.go:466] detecting cgroup driver to use...
	I0907 00:07:12.146663  747137 start.go:470] using "systemd" cgroup driver as enforced via flags
	I0907 00:07:12.146719  747137 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0907 00:07:12.158920  747137 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0907 00:07:12.169415  747137 docker.go:196] disabling cri-docker service (if available) ...
	I0907 00:07:12.169488  747137 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0907 00:07:12.182213  747137 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0907 00:07:12.195203  747137 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0907 00:07:12.276842  747137 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0907 00:07:12.353349  747137 docker.go:212] disabling docker service ...
	I0907 00:07:12.353439  747137 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0907 00:07:12.372140  747137 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0907 00:07:12.382953  747137 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0907 00:07:12.481059  747137 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0907 00:07:12.587077  747137 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0907 00:07:12.598009  747137 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0907 00:07:12.613760  747137 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0907 00:07:12.624793  747137 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0907 00:07:12.634644  747137 containerd.go:145] configuring containerd to use "systemd" as cgroup driver...
	I0907 00:07:12.634743  747137 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = true|g' /etc/containerd/config.toml"
	I0907 00:07:12.645586  747137 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0907 00:07:12.655648  747137 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0907 00:07:12.664943  747137 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0907 00:07:12.676252  747137 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0907 00:07:12.688355  747137 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0907 00:07:12.700986  747137 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0907 00:07:12.709280  747137 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0907 00:07:12.717529  747137 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0907 00:07:12.804133  747137 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0907 00:07:12.918575  747137 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0907 00:07:12.918666  747137 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0907 00:07:12.923857  747137 start.go:534] Will wait 60s for crictl version
	I0907 00:07:12.923984  747137 ssh_runner.go:195] Run: which crictl
	I0907 00:07:12.928196  747137 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0907 00:07:12.974563  747137 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.22
	RuntimeApiVersion:  v1
	I0907 00:07:12.974624  747137 ssh_runner.go:195] Run: containerd --version
	I0907 00:07:12.999281  747137 ssh_runner.go:195] Run: containerd --version
	I0907 00:07:13.032317  747137 out.go:177] * Preparing Kubernetes v1.28.1 on containerd 1.6.22 ...
	I0907 00:07:08.243722  731563 cri.go:89] found id: ""
	I0907 00:07:08.243745  731563 logs.go:284] 0 containers: []
	W0907 00:07:08.243752  731563 logs.go:286] No container was found matching "etcd"
	I0907 00:07:08.243758  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0907 00:07:08.243802  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0907 00:07:08.278034  731563 cri.go:89] found id: ""
	I0907 00:07:08.278061  731563 logs.go:284] 0 containers: []
	W0907 00:07:08.278071  731563 logs.go:286] No container was found matching "coredns"
	I0907 00:07:08.278078  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0907 00:07:08.278151  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0907 00:07:08.315215  731563 cri.go:89] found id: "bd5fda7fa109e7bdb2d7a49f0765c6457ce3aee9146f62d813e15770436e5400"
	I0907 00:07:08.315241  731563 cri.go:89] found id: ""
	I0907 00:07:08.315252  731563 logs.go:284] 1 containers: [bd5fda7fa109e7bdb2d7a49f0765c6457ce3aee9146f62d813e15770436e5400]
	I0907 00:07:08.315299  731563 ssh_runner.go:195] Run: which crictl
	I0907 00:07:08.318891  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0907 00:07:08.318983  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0907 00:07:08.352175  731563 cri.go:89] found id: ""
	I0907 00:07:08.352200  731563 logs.go:284] 0 containers: []
	W0907 00:07:08.352208  731563 logs.go:286] No container was found matching "kube-proxy"
	I0907 00:07:08.352214  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0907 00:07:08.352281  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0907 00:07:08.387790  731563 cri.go:89] found id: "e7f9f4ac3c125814317ff56cfe36350d487e40cde63093a820917dea6d70ad14"
	I0907 00:07:08.387810  731563 cri.go:89] found id: ""
	I0907 00:07:08.387816  731563 logs.go:284] 1 containers: [e7f9f4ac3c125814317ff56cfe36350d487e40cde63093a820917dea6d70ad14]
	I0907 00:07:08.387852  731563 ssh_runner.go:195] Run: which crictl
	I0907 00:07:08.391541  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0907 00:07:08.391607  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0907 00:07:08.426849  731563 cri.go:89] found id: ""
	I0907 00:07:08.426874  731563 logs.go:284] 0 containers: []
	W0907 00:07:08.426882  731563 logs.go:286] No container was found matching "kindnet"
	I0907 00:07:08.426888  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0907 00:07:08.426957  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0907 00:07:08.463587  731563 cri.go:89] found id: ""
	I0907 00:07:08.463623  731563 logs.go:284] 0 containers: []
	W0907 00:07:08.463634  731563 logs.go:286] No container was found matching "storage-provisioner"
	I0907 00:07:08.463647  731563 logs.go:123] Gathering logs for kube-apiserver [3a9150038c8d1e7f5f2f679d7f40db47bab9fa30b65d2fbd965e47e1635c9988] ...
	I0907 00:07:08.463684  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a9150038c8d1e7f5f2f679d7f40db47bab9fa30b65d2fbd965e47e1635c9988"
	I0907 00:07:08.503402  731563 logs.go:123] Gathering logs for kube-scheduler [bd5fda7fa109e7bdb2d7a49f0765c6457ce3aee9146f62d813e15770436e5400] ...
	I0907 00:07:08.503433  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd5fda7fa109e7bdb2d7a49f0765c6457ce3aee9146f62d813e15770436e5400"
	I0907 00:07:08.574097  731563 logs.go:123] Gathering logs for kube-controller-manager [e7f9f4ac3c125814317ff56cfe36350d487e40cde63093a820917dea6d70ad14] ...
	I0907 00:07:08.574134  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7f9f4ac3c125814317ff56cfe36350d487e40cde63093a820917dea6d70ad14"
	I0907 00:07:08.609130  731563 logs.go:123] Gathering logs for containerd ...
	I0907 00:07:08.609162  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0907 00:07:08.648555  731563 logs.go:123] Gathering logs for container status ...
	I0907 00:07:08.648597  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0907 00:07:08.685382  731563 logs.go:123] Gathering logs for kubelet ...
	I0907 00:07:08.685410  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0907 00:07:08.753019  731563 logs.go:123] Gathering logs for dmesg ...
	I0907 00:07:08.753056  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0907 00:07:08.770191  731563 logs.go:123] Gathering logs for describe nodes ...
	I0907 00:07:08.770222  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	W0907 00:07:08.830089  731563 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: 
	** stderr ** 
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	
	** /stderr **
	I0907 00:07:11.330920  731563 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0907 00:07:13.033917  747137 cli_runner.go:164] Run: docker network inspect force-systemd-flag-448041 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0907 00:07:13.054281  747137 ssh_runner.go:195] Run: grep 192.168.103.1	host.minikube.internal$ /etc/hosts
	I0907 00:07:13.058255  747137 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.103.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0907 00:07:13.068927  747137 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0907 00:07:13.069005  747137 ssh_runner.go:195] Run: sudo crictl images --output json
	I0907 00:07:13.100328  747137 containerd.go:604] all images are preloaded for containerd runtime.
	I0907 00:07:13.100349  747137 containerd.go:518] Images already preloaded, skipping extraction
	I0907 00:07:13.100391  747137 ssh_runner.go:195] Run: sudo crictl images --output json
	I0907 00:07:13.138114  747137 containerd.go:604] all images are preloaded for containerd runtime.
	I0907 00:07:13.138150  747137 cache_images.go:84] Images are preloaded, skipping loading
	I0907 00:07:13.138213  747137 ssh_runner.go:195] Run: sudo crictl info
	I0907 00:07:13.178495  747137 cni.go:84] Creating CNI manager for ""
	I0907 00:07:13.178523  747137 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0907 00:07:13.178549  747137 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0907 00:07:13.178574  747137 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.28.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:force-systemd-flag-448041 NodeName:force-systemd-flag-448041 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs
/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0907 00:07:13.178753  747137 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.103.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "force-systemd-flag-448041"
	  kubeletExtraArgs:
	    node-ip: 192.168.103.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0907 00:07:13.178843  747137 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=force-systemd-flag-448041 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.1 ClusterName:force-systemd-flag-448041 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0907 00:07:13.178918  747137 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.1
	I0907 00:07:13.187797  747137 binaries.go:44] Found k8s binaries, skipping transfer
	I0907 00:07:13.187879  747137 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0907 00:07:13.196439  747137 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (398 bytes)
	I0907 00:07:13.213313  747137 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0907 00:07:13.229705  747137 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2116 bytes)
	I0907 00:07:13.247454  747137 ssh_runner.go:195] Run: grep 192.168.103.2	control-plane.minikube.internal$ /etc/hosts
	I0907 00:07:13.250791  747137 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0907 00:07:13.260901  747137 certs.go:56] Setting up /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041 for IP: 192.168.103.2
	I0907 00:07:13.260941  747137 certs.go:190] acquiring lock for shared ca certs: {Name:mkf023f174f877b5e876cc103f58e9ab0cfa5d55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:13.261108  747137 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.key
	I0907 00:07:13.261159  747137 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.key
	I0907 00:07:13.261214  747137 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/client.key
	I0907 00:07:13.261230  747137 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/client.crt with IP's: []
	I0907 00:07:13.488643  747137 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/client.crt ...
	I0907 00:07:13.488678  747137 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/client.crt: {Name:mkc7c593f4bd30d2fad4513e709d33e3995c9dc5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:13.488878  747137 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/client.key ...
	I0907 00:07:13.488894  747137 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/client.key: {Name:mkc538a6caf0317f3bf0a6580531907c49bf9757 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:13.489003  747137 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.key.33fce0b9
	I0907 00:07:13.489023  747137 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.crt.33fce0b9 with IP's: [192.168.103.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0907 00:07:13.586500  747137 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.crt.33fce0b9 ...
	I0907 00:07:13.586534  747137 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.crt.33fce0b9: {Name:mkdbc24bba5883ae23ecb3a27bd7c22f847b5e3f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:13.586715  747137 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.key.33fce0b9 ...
	I0907 00:07:13.586731  747137 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.key.33fce0b9: {Name:mkae4cc7c4e5c0694d308dbc3eb5eadf7a8d2f1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:13.586829  747137 certs.go:337] copying /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.crt.33fce0b9 -> /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.crt
	I0907 00:07:13.586914  747137 certs.go:341] copying /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.key.33fce0b9 -> /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.key
	I0907 00:07:13.586988  747137 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.key
	I0907 00:07:13.587010  747137 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.crt with IP's: []
	I0907 00:07:13.735290  747137 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.crt ...
	I0907 00:07:13.735321  747137 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.crt: {Name:mk0c7f47e9502f2d0bb5d939fed77184bb973de5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:13.735507  747137 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.key ...
	I0907 00:07:13.735523  747137 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.key: {Name:mkfcf97387da5fbed001d8f424f14fe370946afc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:13.735625  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0907 00:07:13.735649  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0907 00:07:13.735665  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0907 00:07:13.735684  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0907 00:07:13.735703  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0907 00:07:13.735726  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0907 00:07:13.735745  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0907 00:07:13.735764  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0907 00:07:13.735840  747137 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/577782.pem (1338 bytes)
	W0907 00:07:13.735888  747137 certs.go:433] ignoring /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/577782_empty.pem, impossibly tiny 0 bytes
	I0907 00:07:13.735904  747137 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca-key.pem (1675 bytes)
	I0907 00:07:13.735955  747137 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/ca.pem (1078 bytes)
	I0907 00:07:13.735997  747137 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/cert.pem (1123 bytes)
	I0907 00:07:13.736032  747137 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/home/jenkins/minikube-integration/17174-571027/.minikube/certs/key.pem (1679 bytes)
	I0907 00:07:13.736095  747137 certs.go:437] found cert: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem (1708 bytes)
	I0907 00:07:13.736136  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/certs/577782.pem -> /usr/share/ca-certificates/577782.pem
	I0907 00:07:13.736163  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem -> /usr/share/ca-certificates/5777822.pem
	I0907 00:07:13.736177  747137 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0907 00:07:13.736797  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0907 00:07:13.763366  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0907 00:07:13.786216  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0907 00:07:13.808808  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/force-systemd-flag-448041/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0907 00:07:13.833058  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0907 00:07:13.858197  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0907 00:07:13.880772  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0907 00:07:13.901953  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0907 00:07:13.923576  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/certs/577782.pem --> /usr/share/ca-certificates/577782.pem (1338 bytes)
	I0907 00:07:13.950836  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/ssl/certs/5777822.pem --> /usr/share/ca-certificates/5777822.pem (1708 bytes)
	I0907 00:07:13.976152  747137 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0907 00:07:13.998112  747137 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0907 00:07:14.013962  747137 ssh_runner.go:195] Run: openssl version
	I0907 00:07:14.020054  747137 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/577782.pem && ln -fs /usr/share/ca-certificates/577782.pem /etc/ssl/certs/577782.pem"
	I0907 00:07:14.030473  747137 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/577782.pem
	I0907 00:07:14.034265  747137 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Sep  6 23:43 /usr/share/ca-certificates/577782.pem
	I0907 00:07:14.034318  747137 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/577782.pem
	I0907 00:07:14.041773  747137 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/577782.pem /etc/ssl/certs/51391683.0"
	I0907 00:07:14.051686  747137 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5777822.pem && ln -fs /usr/share/ca-certificates/5777822.pem /etc/ssl/certs/5777822.pem"
	I0907 00:07:14.064393  747137 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5777822.pem
	I0907 00:07:14.068088  747137 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Sep  6 23:43 /usr/share/ca-certificates/5777822.pem
	I0907 00:07:14.068132  747137 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5777822.pem
	I0907 00:07:14.074493  747137 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5777822.pem /etc/ssl/certs/3ec20f2e.0"
	I0907 00:07:14.082891  747137 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0907 00:07:14.091241  747137 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0907 00:07:14.094497  747137 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Sep  6 23:38 /usr/share/ca-certificates/minikubeCA.pem
	I0907 00:07:14.094547  747137 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0907 00:07:14.100741  747137 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0907 00:07:14.108962  747137 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0907 00:07:14.111993  747137 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0907 00:07:14.112049  747137 kubeadm.go:404] StartCluster: {Name:force-systemd-flag-448041 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:force-systemd-flag-448041 Namespace:default APIServerName:minikubeCA
APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVM
netClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0907 00:07:14.112189  747137 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0907 00:07:14.112238  747137 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0907 00:07:14.160213  747137 cri.go:89] found id: ""
	I0907 00:07:14.160284  747137 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0907 00:07:14.170191  747137 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0907 00:07:14.178686  747137 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0907 00:07:14.178739  747137 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0907 00:07:14.186724  747137 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0907 00:07:14.186771  747137 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0907 00:07:14.235214  747137 kubeadm.go:322] [init] Using Kubernetes version: v1.28.1
	I0907 00:07:14.235295  747137 kubeadm.go:322] [preflight] Running pre-flight checks
	I0907 00:07:14.277929  747137 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0907 00:07:14.278043  747137 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1040-gcp
	I0907 00:07:14.278096  747137 kubeadm.go:322] OS: Linux
	I0907 00:07:14.278163  747137 kubeadm.go:322] CGROUPS_CPU: enabled
	I0907 00:07:14.278218  747137 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0907 00:07:14.278311  747137 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0907 00:07:14.278400  747137 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0907 00:07:14.278466  747137 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0907 00:07:14.278523  747137 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0907 00:07:14.278561  747137 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0907 00:07:14.278605  747137 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0907 00:07:14.278645  747137 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0907 00:07:14.345267  747137 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0907 00:07:14.345415  747137 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0907 00:07:14.345582  747137 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0907 00:07:14.573916  747137 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0907 00:07:11.556222  745693 out.go:204]   - Booting up control plane ...
	I0907 00:07:11.556392  745693 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0907 00:07:11.556481  745693 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0907 00:07:11.556578  745693 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0907 00:07:11.570585  745693 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0907 00:07:11.571484  745693 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0907 00:07:11.571571  745693 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0907 00:07:11.647957  745693 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0907 00:07:14.577400  747137 out.go:204]   - Generating certificates and keys ...
	I0907 00:07:14.577564  747137 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0907 00:07:14.577647  747137 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0907 00:07:14.846881  747137 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0907 00:07:14.963629  747137 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0907 00:07:15.316622  747137 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0907 00:07:15.571585  747137 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0907 00:07:16.161273  747137 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0907 00:07:16.161432  747137 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [force-systemd-flag-448041 localhost] and IPs [192.168.103.2 127.0.0.1 ::1]
	I0907 00:07:16.251028  747137 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0907 00:07:16.251271  747137 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [force-systemd-flag-448041 localhost] and IPs [192.168.103.2 127.0.0.1 ::1]
	I0907 00:07:16.333178  747137 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0907 00:07:16.411781  747137 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0907 00:07:16.572168  747137 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0907 00:07:16.572375  747137 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0907 00:07:16.670343  747137 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0907 00:07:16.974871  747137 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0907 00:07:17.128645  747137 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0907 00:07:17.272075  747137 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0907 00:07:17.272585  747137 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0907 00:07:17.274839  747137 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0907 00:07:17.150559  745693 kubeadm.go:322] [apiclient] All control plane components are healthy after 5.502635 seconds
	I0907 00:07:17.150702  745693 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0907 00:07:17.166241  745693 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0907 00:07:17.689526  745693 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0907 00:07:17.690222  745693 kubeadm.go:322] [mark-control-plane] Marking the node cert-expiration-754141 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0907 00:07:18.199482  745693 kubeadm.go:322] [bootstrap-token] Using token: y7gfxj.3qzd6tkxihs49bjt
	I0907 00:07:16.331405  731563 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0907 00:07:16.331480  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0907 00:07:16.331573  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0907 00:07:16.376751  731563 cri.go:89] found id: "ec21eff2a1c21a2b7e22f36a658833613c474fbe77e962aae8a1cfd85a9392ba"
	I0907 00:07:16.376783  731563 cri.go:89] found id: "3a9150038c8d1e7f5f2f679d7f40db47bab9fa30b65d2fbd965e47e1635c9988"
	I0907 00:07:16.376790  731563 cri.go:89] found id: ""
	I0907 00:07:16.376799  731563 logs.go:284] 2 containers: [ec21eff2a1c21a2b7e22f36a658833613c474fbe77e962aae8a1cfd85a9392ba 3a9150038c8d1e7f5f2f679d7f40db47bab9fa30b65d2fbd965e47e1635c9988]
	I0907 00:07:16.376856  731563 ssh_runner.go:195] Run: which crictl
	I0907 00:07:16.381369  731563 ssh_runner.go:195] Run: which crictl
	I0907 00:07:16.385115  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0907 00:07:16.385179  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0907 00:07:16.427263  731563 cri.go:89] found id: ""
	I0907 00:07:16.427294  731563 logs.go:284] 0 containers: []
	W0907 00:07:16.427304  731563 logs.go:286] No container was found matching "etcd"
	I0907 00:07:16.427312  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0907 00:07:16.427381  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0907 00:07:16.468386  731563 cri.go:89] found id: ""
	I0907 00:07:16.468416  731563 logs.go:284] 0 containers: []
	W0907 00:07:16.468426  731563 logs.go:286] No container was found matching "coredns"
	I0907 00:07:16.468435  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0907 00:07:16.468486  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0907 00:07:16.507761  731563 cri.go:89] found id: "bd5fda7fa109e7bdb2d7a49f0765c6457ce3aee9146f62d813e15770436e5400"
	I0907 00:07:16.507787  731563 cri.go:89] found id: ""
	I0907 00:07:16.507796  731563 logs.go:284] 1 containers: [bd5fda7fa109e7bdb2d7a49f0765c6457ce3aee9146f62d813e15770436e5400]
	I0907 00:07:16.507847  731563 ssh_runner.go:195] Run: which crictl
	I0907 00:07:16.511809  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0907 00:07:16.511878  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0907 00:07:16.552873  731563 cri.go:89] found id: ""
	I0907 00:07:16.552900  731563 logs.go:284] 0 containers: []
	W0907 00:07:16.552914  731563 logs.go:286] No container was found matching "kube-proxy"
	I0907 00:07:16.552923  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0907 00:07:16.552981  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0907 00:07:16.596879  731563 cri.go:89] found id: "e7f9f4ac3c125814317ff56cfe36350d487e40cde63093a820917dea6d70ad14"
	I0907 00:07:16.596908  731563 cri.go:89] found id: ""
	I0907 00:07:16.596919  731563 logs.go:284] 1 containers: [e7f9f4ac3c125814317ff56cfe36350d487e40cde63093a820917dea6d70ad14]
	I0907 00:07:16.596979  731563 ssh_runner.go:195] Run: which crictl
	I0907 00:07:16.600987  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0907 00:07:16.601055  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0907 00:07:16.641010  731563 cri.go:89] found id: ""
	I0907 00:07:16.641032  731563 logs.go:284] 0 containers: []
	W0907 00:07:16.641049  731563 logs.go:286] No container was found matching "kindnet"
	I0907 00:07:16.641055  731563 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0907 00:07:16.641102  731563 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0907 00:07:16.680474  731563 cri.go:89] found id: ""
	I0907 00:07:16.680498  731563 logs.go:284] 0 containers: []
	W0907 00:07:16.680508  731563 logs.go:286] No container was found matching "storage-provisioner"
	I0907 00:07:16.680534  731563 logs.go:123] Gathering logs for container status ...
	I0907 00:07:16.680552  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0907 00:07:16.724303  731563 logs.go:123] Gathering logs for kube-apiserver [3a9150038c8d1e7f5f2f679d7f40db47bab9fa30b65d2fbd965e47e1635c9988] ...
	I0907 00:07:16.724332  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a9150038c8d1e7f5f2f679d7f40db47bab9fa30b65d2fbd965e47e1635c9988"
	I0907 00:07:16.773191  731563 logs.go:123] Gathering logs for kube-scheduler [bd5fda7fa109e7bdb2d7a49f0765c6457ce3aee9146f62d813e15770436e5400] ...
	I0907 00:07:16.773228  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd5fda7fa109e7bdb2d7a49f0765c6457ce3aee9146f62d813e15770436e5400"
	I0907 00:07:16.859071  731563 logs.go:123] Gathering logs for kube-controller-manager [e7f9f4ac3c125814317ff56cfe36350d487e40cde63093a820917dea6d70ad14] ...
	I0907 00:07:16.859118  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7f9f4ac3c125814317ff56cfe36350d487e40cde63093a820917dea6d70ad14"
	I0907 00:07:16.894115  731563 logs.go:123] Gathering logs for containerd ...
	I0907 00:07:16.894156  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0907 00:07:16.938350  731563 logs.go:123] Gathering logs for kubelet ...
	I0907 00:07:16.938390  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I0907 00:07:17.025856  731563 logs.go:123] Gathering logs for dmesg ...
	I0907 00:07:17.025903  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0907 00:07:17.047042  731563 logs.go:123] Gathering logs for describe nodes ...
	I0907 00:07:17.047079  731563 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0907 00:07:18.201252  745693 out.go:204]   - Configuring RBAC rules ...
	I0907 00:07:18.201408  745693 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0907 00:07:18.204892  745693 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0907 00:07:18.210825  745693 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0907 00:07:18.213437  745693 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0907 00:07:18.215964  745693 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0907 00:07:18.219767  745693 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0907 00:07:18.228881  745693 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0907 00:07:18.443858  745693 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0907 00:07:18.622667  745693 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0907 00:07:18.624114  745693 kubeadm.go:322] 
	I0907 00:07:18.624187  745693 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0907 00:07:18.624193  745693 kubeadm.go:322] 
	I0907 00:07:18.624279  745693 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0907 00:07:18.624283  745693 kubeadm.go:322] 
	I0907 00:07:18.624312  745693 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0907 00:07:18.624383  745693 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0907 00:07:18.624456  745693 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0907 00:07:18.624463  745693 kubeadm.go:322] 
	I0907 00:07:18.624524  745693 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0907 00:07:18.624529  745693 kubeadm.go:322] 
	I0907 00:07:18.624583  745693 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0907 00:07:18.624588  745693 kubeadm.go:322] 
	I0907 00:07:18.624641  745693 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0907 00:07:18.624723  745693 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0907 00:07:18.624796  745693 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0907 00:07:18.624801  745693 kubeadm.go:322] 
	I0907 00:07:18.624891  745693 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0907 00:07:18.624975  745693 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0907 00:07:18.624981  745693 kubeadm.go:322] 
	I0907 00:07:18.625098  745693 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token y7gfxj.3qzd6tkxihs49bjt \
	I0907 00:07:18.625213  745693 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:a2ada76268d5d488ce28944d82faeb083cfa6d709381a798f3683d6c7ba77a82 \
	I0907 00:07:18.625235  745693 kubeadm.go:322] 	--control-plane 
	I0907 00:07:18.625240  745693 kubeadm.go:322] 
	I0907 00:07:18.625330  745693 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0907 00:07:18.625341  745693 kubeadm.go:322] 
	I0907 00:07:18.625430  745693 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token y7gfxj.3qzd6tkxihs49bjt \
	I0907 00:07:18.625543  745693 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:a2ada76268d5d488ce28944d82faeb083cfa6d709381a798f3683d6c7ba77a82 
	I0907 00:07:18.632178  745693 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1040-gcp\n", err: exit status 1
	I0907 00:07:18.632304  745693 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0907 00:07:18.632328  745693 cni.go:84] Creating CNI manager for ""
	I0907 00:07:18.632335  745693 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0907 00:07:18.634204  745693 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0907 00:07:18.636625  745693 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0907 00:07:18.644268  745693 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.1/kubectl ...
	I0907 00:07:18.644283  745693 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0907 00:07:18.669044  745693 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0907 00:07:19.543526  745693 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0907 00:07:19.543595  745693 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0907 00:07:19.543626  745693 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.1/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=cf47a38f14700a28a638c18f21764b75f0a296b2 minikube.k8s.io/name=cert-expiration-754141 minikube.k8s.io/updated_at=2023_09_07T00_07_19_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0907 00:07:19.718052  745693 kubeadm.go:1081] duration metric: took 174.52587ms to wait for elevateKubeSystemPrivileges.
	I0907 00:07:19.718088  745693 ops.go:34] apiserver oom_adj: -16
	I0907 00:07:19.718100  745693 kubeadm.go:406] StartCluster complete in 11.014668124s
	I0907 00:07:19.718126  745693 settings.go:142] acquiring lock: {Name:mk714b238c1478a3a25e7d657d1a550b0f350806 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:19.718198  745693 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0907 00:07:19.719869  745693 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/kubeconfig: {Name:mk612c776b3ecd195073ca96afaf72d304290efb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0907 00:07:19.720550  745693 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0907 00:07:19.722321  745693 config.go:182] Loaded profile config "cert-expiration-754141": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0907 00:07:19.720713  745693 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
	I0907 00:07:19.722446  745693 addons.go:69] Setting storage-provisioner=true in profile "cert-expiration-754141"
	I0907 00:07:19.722474  745693 addons.go:231] Setting addon storage-provisioner=true in "cert-expiration-754141"
	I0907 00:07:19.722539  745693 addons.go:69] Setting default-storageclass=true in profile "cert-expiration-754141"
	I0907 00:07:19.722547  745693 host.go:66] Checking if "cert-expiration-754141" exists ...
	I0907 00:07:19.722556  745693 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "cert-expiration-754141"
	I0907 00:07:19.723383  745693 cli_runner.go:164] Run: docker container inspect cert-expiration-754141 --format={{.State.Status}}
	I0907 00:07:19.723505  745693 cli_runner.go:164] Run: docker container inspect cert-expiration-754141 --format={{.State.Status}}
	I0907 00:07:19.751542  745693 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0907 00:07:19.749924  745693 kapi.go:248] "coredns" deployment in "kube-system" namespace and "cert-expiration-754141" context rescaled to 1 replicas
	I0907 00:07:19.753036  745693 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.112.2 Port:8443 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0907 00:07:19.754649  745693 out.go:177] * Verifying Kubernetes components...
	I0907 00:07:19.753262  745693 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0907 00:07:19.755906  745693 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0907 00:07:19.755990  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:19.756198  745693 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0907 00:07:19.775633  745693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32982 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa Username:docker}
	I0907 00:07:19.777341  745693 addons.go:231] Setting addon default-storageclass=true in "cert-expiration-754141"
	I0907 00:07:19.777381  745693 host.go:66] Checking if "cert-expiration-754141" exists ...
	I0907 00:07:19.777831  745693 cli_runner.go:164] Run: docker container inspect cert-expiration-754141 --format={{.State.Status}}
	I0907 00:07:19.798408  745693 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0907 00:07:19.798425  745693 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0907 00:07:19.798476  745693 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cert-expiration-754141
	I0907 00:07:19.816856  745693 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.112.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0907 00:07:19.817980  745693 api_server.go:52] waiting for apiserver process to appear ...
	I0907 00:07:19.818014  745693 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0907 00:07:19.821992  745693 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32982 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/cert-expiration-754141/id_rsa Username:docker}
	I0907 00:07:19.932203  745693 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0907 00:07:19.947313  745693 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0907 00:07:20.236587  745693 start.go:901] {"host.minikube.internal": 192.168.112.1} host record injected into CoreDNS's ConfigMap
	I0907 00:07:20.236643  745693 api_server.go:72] duration metric: took 483.571089ms to wait for apiserver process to appear ...
	I0907 00:07:20.236654  745693 api_server.go:88] waiting for apiserver healthz status ...
	I0907 00:07:20.236673  745693 api_server.go:253] Checking apiserver healthz at https://192.168.112.2:8443/healthz ...
	I0907 00:07:20.244529  745693 api_server.go:279] https://192.168.112.2:8443/healthz returned 200:
	ok
	I0907 00:07:20.245829  745693 api_server.go:141] control plane version: v1.28.1
	I0907 00:07:20.245847  745693 api_server.go:131] duration metric: took 9.18695ms to wait for apiserver health ...
	I0907 00:07:20.245854  745693 system_pods.go:43] waiting for kube-system pods to appear ...
	I0907 00:07:20.253837  745693 system_pods.go:59] 4 kube-system pods found
	I0907 00:07:20.253864  745693 system_pods.go:61] "etcd-cert-expiration-754141" [61c0ce61-e924-493c-b418-426e40dccf75] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0907 00:07:20.253875  745693 system_pods.go:61] "kube-apiserver-cert-expiration-754141" [d5fa7d49-ebc9-423c-90e9-30294ffc3205] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0907 00:07:20.253881  745693 system_pods.go:61] "kube-controller-manager-cert-expiration-754141" [84174640-cf8b-476f-b3b1-05bb80b6dbf9] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0907 00:07:20.253887  745693 system_pods.go:61] "kube-scheduler-cert-expiration-754141" [97c3a741-af8b-442e-9779-59a74617c782] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0907 00:07:20.253892  745693 system_pods.go:74] duration metric: took 8.033738ms to wait for pod list to return data ...
	I0907 00:07:20.253902  745693 kubeadm.go:581] duration metric: took 500.83106ms to wait for : map[apiserver:true system_pods:true] ...
	I0907 00:07:20.253915  745693 node_conditions.go:102] verifying NodePressure condition ...
	I0907 00:07:20.258028  745693 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0907 00:07:20.258043  745693 node_conditions.go:123] node cpu capacity is 8
	I0907 00:07:20.258052  745693 node_conditions.go:105] duration metric: took 4.131859ms to run NodePressure ...
	I0907 00:07:20.258062  745693 start.go:228] waiting for startup goroutines ...
	I0907 00:07:20.543565  745693 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0907 00:07:20.545162  745693 addons.go:502] enable addons completed in 824.445414ms: enabled=[storage-provisioner default-storageclass]
	I0907 00:07:20.545194  745693 start.go:233] waiting for cluster config update ...
	I0907 00:07:20.545204  745693 start.go:242] writing updated cluster config ...
	I0907 00:07:20.545456  745693 ssh_runner.go:195] Run: rm -f paused
	I0907 00:07:20.597354  745693 start.go:600] kubectl: 1.28.1, cluster: 1.28.1 (minor skew: 0)
	I0907 00:07:20.604094  745693 out.go:177] * Done! kubectl is now configured to use "cert-expiration-754141" cluster and "default" namespace by default
	I0907 00:07:17.276804  747137 out.go:204]   - Booting up control plane ...
	I0907 00:07:17.276961  747137 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0907 00:07:17.277042  747137 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0907 00:07:17.277560  747137 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0907 00:07:17.289952  747137 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0907 00:07:17.290810  747137 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0907 00:07:17.290924  747137 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0907 00:07:17.397289  747137 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0907 00:07:23.179567  731404 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0907 00:07:23.208195  731404 out.go:177] 
	W0907 00:07:23.209628  731404 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	W0907 00:07:23.209663  731404 out.go:239] * 
	W0907 00:07:23.210777  731404 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0907 00:07:23.212304  731404 out.go:177] 
	
	* 
	* ==> container status <==
	* 
	* ==> containerd <==
	* -- Logs begin at Thu 2023-09-07 00:06:28 UTC, end at Thu 2023-09-07 00:07:24 UTC. --
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.815465048Z" level=info msg="loading plugin \"io.containerd.service.v1.leases-service\"..." type=io.containerd.service.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.815484743Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.815502741Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.815522571Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.815575890Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.815645360Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816107287Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816161427Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816230090Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816252801Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816269996Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816286956Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816304165Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816323755Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816339857Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816357995Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816374086Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816424849Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816450246Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816467119Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816483130Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816752207Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816813625Z" level=info msg=serving... address=/run/containerd/containerd.sock
	Sep 07 00:06:31 missing-upgrade-599530 containerd[643]: time="2023-09-07T00:06:31.816876589Z" level=info msg="containerd successfully booted in 0.030294s"
	Sep 07 00:06:31 missing-upgrade-599530 systemd[1]: Started containerd container runtime.
	
	* 
	* ==> describe nodes <==
	* 
	* ==> dmesg <==
	* [  +0.006757] FS-Cache: O-cookie d=00000000b188f2df{9p.inode} n=000000009740d9c3
	[  +0.007454] FS-Cache: O-key=[8] '67a50f0200000000'
	[  +0.004922] FS-Cache: N-cookie c=00000022 [p=00000015 fl=2 nc=0 na=1]
	[  +0.006607] FS-Cache: N-cookie d=00000000b188f2df{9p.inode} n=00000000a7956fb9
	[  +0.008760] FS-Cache: N-key=[8] '67a50f0200000000'
	[Sep 6 23:55] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000009] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[  +1.010111] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000009] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[  +2.015794] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000024] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[  +4.095591] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000007] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[  +8.191158] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000005] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[Sep 6 23:57] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000009] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[  +1.034826] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000006] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[  +2.011817] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000007] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[  +4.223551] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000015] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	[  +8.195162] IPv4: martian source 10.154.0.2 from 10.244.0.3, on dev br-205627a57fc4
	[  +0.000011] ll header: 00000000: 02 42 78 9e 51 86 02 42 c0 a8 3a 02 08 00
	
	* 
	* ==> kernel <==
	*  00:07:24 up  5:45,  0 users,  load average: 5.22, 3.30, 2.20
	Linux missing-upgrade-599530 5.15.0-1040-gcp #48~20.04.1-Ubuntu SMP Fri Aug 25 04:03:42 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.2 LTS"
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Thu 2023-09-07 00:06:28 UTC, end at Thu 2023-09-07 00:07:24 UTC. --
	-- No entries --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	E0907 00:07:23.808291  751720 logs.go:281] Failed to list containers for "kube-apiserver": crictl list: sudo crictl ps -a --quiet --name=kube-apiserver: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0907 00:07:23.832658  751720 logs.go:281] Failed to list containers for "etcd": crictl list: sudo crictl ps -a --quiet --name=etcd: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0907 00:07:23.857324  751720 logs.go:281] Failed to list containers for "coredns": crictl list: sudo crictl ps -a --quiet --name=coredns: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0907 00:07:23.881334  751720 logs.go:281] Failed to list containers for "kube-scheduler": crictl list: sudo crictl ps -a --quiet --name=kube-scheduler: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0907 00:07:23.905150  751720 logs.go:281] Failed to list containers for "kube-proxy": crictl list: sudo crictl ps -a --quiet --name=kube-proxy: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0907 00:07:23.929712  751720 logs.go:281] Failed to list containers for "kube-controller-manager": crictl list: sudo crictl ps -a --quiet --name=kube-controller-manager: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0907 00:07:23.957139  751720 logs.go:281] Failed to list containers for "kindnet": crictl list: sudo crictl ps -a --quiet --name=kindnet: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0907 00:07:23.984204  751720 logs.go:281] Failed to list containers for "storage-provisioner": crictl list: sudo crictl ps -a --quiet --name=storage-provisioner: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:23Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0907 00:07:24.067008  751720 logs.go:195] command /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" failed with error: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": Process exited with status 1
	stdout:
	
	stderr:
	time="2023-09-07T00:07:24Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	 output: "\n** stderr ** \ntime=\"2023-09-07T00:07:24Z\" level=fatal msg=\"listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService\"\nCannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?\n\n** /stderr **"
	E0907 00:07:24.151917  751720 logs.go:195] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: "\n** stderr ** \nThe connection to the server localhost:8443 was refused - did you specify the right host or port?\n\n** /stderr **"
	! unable to fetch logs for: container status, describe nodes

                                                
                                                
** /stderr **
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p missing-upgrade-599530 -n missing-upgrade-599530
helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p missing-upgrade-599530 -n missing-upgrade-599530: exit status 2 (303.696319ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "missing-upgrade-599530" apiserver is not running, skipping kubectl commands (state="Stopped")
helpers_test.go:175: Cleaning up "missing-upgrade-599530" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p missing-upgrade-599530
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-599530: (2.361419716s)
--- FAIL: TestMissingContainerUpgrade (218.40s)

                                                
                                    

Test pass (279/304)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 22.87
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.06
10 TestDownloadOnly/v1.28.1/json-events 15.71
11 TestDownloadOnly/v1.28.1/preload-exists 0
15 TestDownloadOnly/v1.28.1/LogsDuration 0.06
16 TestDownloadOnly/DeleteAll 0.19
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.12
18 TestDownloadOnlyKic 1.22
19 TestBinaryMirror 0.71
20 TestOffline 59.09
22 TestAddons/Setup 108.04
24 TestAddons/parallel/Registry 16.83
25 TestAddons/parallel/Ingress 22.04
26 TestAddons/parallel/InspektorGadget 10.86
27 TestAddons/parallel/MetricsServer 5.78
28 TestAddons/parallel/HelmTiller 11.74
30 TestAddons/parallel/CSI 50.22
31 TestAddons/parallel/Headlamp 13.31
32 TestAddons/parallel/CloudSpanner 5.93
35 TestAddons/serial/GCPAuth/Namespaces 0.13
36 TestAddons/StoppedEnableDisable 12.16
37 TestCertOptions 25.08
38 TestCertExpiration 212.27
40 TestForceSystemdFlag 27.57
41 TestForceSystemdEnv 25.81
43 TestKVMDriverInstallOrUpdate 4.77
47 TestErrorSpam/setup 24.33
48 TestErrorSpam/start 0.58
49 TestErrorSpam/status 0.83
50 TestErrorSpam/pause 1.47
51 TestErrorSpam/unpause 1.43
52 TestErrorSpam/stop 1.35
55 TestFunctional/serial/CopySyncFile 0
56 TestFunctional/serial/StartWithProxy 48.12
57 TestFunctional/serial/AuditLog 0
58 TestFunctional/serial/SoftStart 4.78
59 TestFunctional/serial/KubeContext 0.05
60 TestFunctional/serial/KubectlGetPods 0.07
63 TestFunctional/serial/CacheCmd/cache/add_remote 3.48
64 TestFunctional/serial/CacheCmd/cache/add_local 2.08
65 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.05
66 TestFunctional/serial/CacheCmd/cache/list 0.04
67 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.27
68 TestFunctional/serial/CacheCmd/cache/cache_reload 1.92
69 TestFunctional/serial/CacheCmd/cache/delete 0.09
70 TestFunctional/serial/MinikubeKubectlCmd 0.11
71 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.1
72 TestFunctional/serial/ExtraConfig 39.85
73 TestFunctional/serial/ComponentHealth 0.07
74 TestFunctional/serial/LogsCmd 1.33
75 TestFunctional/serial/LogsFileCmd 1.36
76 TestFunctional/serial/InvalidService 4.38
78 TestFunctional/parallel/ConfigCmd 0.37
79 TestFunctional/parallel/DashboardCmd 26.5
80 TestFunctional/parallel/DryRun 0.67
81 TestFunctional/parallel/InternationalLanguage 0.19
82 TestFunctional/parallel/StatusCmd 0.86
86 TestFunctional/parallel/ServiceCmdConnect 9.73
87 TestFunctional/parallel/AddonsCmd 0.15
88 TestFunctional/parallel/PersistentVolumeClaim 36.94
90 TestFunctional/parallel/SSHCmd 0.61
91 TestFunctional/parallel/CpCmd 1.11
92 TestFunctional/parallel/MySQL 27.85
93 TestFunctional/parallel/FileSync 0.27
94 TestFunctional/parallel/CertSync 1.62
98 TestFunctional/parallel/NodeLabels 0.08
100 TestFunctional/parallel/NonActiveRuntimeDisabled 0.62
102 TestFunctional/parallel/License 0.77
103 TestFunctional/parallel/ProfileCmd/profile_not_create 0.44
105 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.47
106 TestFunctional/parallel/ProfileCmd/profile_list 0.41
107 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
109 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 10.33
110 TestFunctional/parallel/Version/short 0.05
111 TestFunctional/parallel/Version/components 1.25
112 TestFunctional/parallel/ProfileCmd/profile_json_output 0.32
113 TestFunctional/parallel/MountCmd/any-port 11.18
114 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.07
115 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
119 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
120 TestFunctional/parallel/ServiceCmd/DeployApp 7.23
121 TestFunctional/parallel/MountCmd/specific-port 1.65
122 TestFunctional/parallel/MountCmd/VerifyCleanup 1.8
123 TestFunctional/parallel/ImageCommands/ImageListShort 0.22
124 TestFunctional/parallel/ImageCommands/ImageListTable 0.22
125 TestFunctional/parallel/ImageCommands/ImageListJson 0.22
126 TestFunctional/parallel/ImageCommands/ImageListYaml 0.22
127 TestFunctional/parallel/ImageCommands/ImageBuild 4.05
128 TestFunctional/parallel/ImageCommands/Setup 1.99
129 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 5.7
130 TestFunctional/parallel/ServiceCmd/List 0.89
131 TestFunctional/parallel/ServiceCmd/JSONOutput 0.93
132 TestFunctional/parallel/ServiceCmd/HTTPS 0.79
133 TestFunctional/parallel/ServiceCmd/Format 0.62
134 TestFunctional/parallel/ServiceCmd/URL 0.77
135 TestFunctional/parallel/UpdateContextCmd/no_changes 0.21
136 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.14
137 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.14
138 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 5.73
139 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 7.41
140 TestFunctional/parallel/ImageCommands/ImageSaveToFile 1.72
141 TestFunctional/parallel/ImageCommands/ImageRemove 0.73
142 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 2.41
143 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 1.2
144 TestFunctional/delete_addon-resizer_images 0.07
145 TestFunctional/delete_my-image_image 0.02
146 TestFunctional/delete_minikube_cached_images 0.02
150 TestIngressAddonLegacy/StartLegacyK8sCluster 80.85
152 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 9.31
153 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.59
154 TestIngressAddonLegacy/serial/ValidateIngressAddons 41.15
157 TestJSONOutput/start/Command 54.79
158 TestJSONOutput/start/Audit 0
160 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
161 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
163 TestJSONOutput/pause/Command 0.65
164 TestJSONOutput/pause/Audit 0
166 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
167 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
169 TestJSONOutput/unpause/Command 0.58
170 TestJSONOutput/unpause/Audit 0
172 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
173 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
175 TestJSONOutput/stop/Command 5.76
176 TestJSONOutput/stop/Audit 0
178 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
179 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
180 TestErrorJSONOutput 0.19
182 TestKicCustomNetwork/create_custom_network 40.91
183 TestKicCustomNetwork/use_default_bridge_network 24.45
184 TestKicExistingNetwork 23.47
185 TestKicCustomSubnet 26.48
186 TestKicStaticIP 25.3
187 TestMainNoArgs 0.04
188 TestMinikubeProfile 49.8
191 TestMountStart/serial/StartWithMountFirst 5.18
192 TestMountStart/serial/VerifyMountFirst 0.24
193 TestMountStart/serial/StartWithMountSecond 8.76
194 TestMountStart/serial/VerifyMountSecond 0.23
195 TestMountStart/serial/DeleteFirst 1.6
196 TestMountStart/serial/VerifyMountPostDelete 0.24
197 TestMountStart/serial/Stop 1.19
198 TestMountStart/serial/RestartStopped 7.12
199 TestMountStart/serial/VerifyMountPostStop 0.24
202 TestMultiNode/serial/FreshStart2Nodes 84.02
203 TestMultiNode/serial/DeployApp2Nodes 5.22
204 TestMultiNode/serial/PingHostFrom2Pods 0.8
205 TestMultiNode/serial/AddNode 17.62
206 TestMultiNode/serial/ProfileList 0.26
207 TestMultiNode/serial/CopyFile 8.94
208 TestMultiNode/serial/StopNode 2.1
209 TestMultiNode/serial/StartAfterStop 10.22
210 TestMultiNode/serial/RestartKeepsNodes 108.94
211 TestMultiNode/serial/DeleteNode 4.67
212 TestMultiNode/serial/StopMultiNode 23.79
213 TestMultiNode/serial/RestartMultiNode 74.49
214 TestMultiNode/serial/ValidateNameConflict 26.56
219 TestPreload 186.46
221 TestScheduledStopUnix 99.72
224 TestInsufficientStorage 10.13
225 TestRunningBinaryUpgrade 99.32
227 TestKubernetesUpgrade 360.48
230 TestStoppedBinaryUpgrade/Setup 2.57
231 TestNoKubernetes/serial/StartNoK8sWithVersion 0.07
232 TestNoKubernetes/serial/StartWithK8s 28.27
233 TestStoppedBinaryUpgrade/Upgrade 164.16
234 TestNoKubernetes/serial/StartWithStopK8s 20.36
235 TestNoKubernetes/serial/Start 5.22
236 TestNoKubernetes/serial/VerifyK8sNotRunning 0.33
237 TestNoKubernetes/serial/ProfileList 1.32
238 TestNoKubernetes/serial/Stop 2.46
239 TestNoKubernetes/serial/StartNoArgs 7.97
240 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.28
248 TestStoppedBinaryUpgrade/MinikubeLogs 0.94
256 TestNetworkPlugins/group/false 3.09
261 TestPause/serial/Start 52.57
263 TestStartStop/group/old-k8s-version/serial/FirstStart 138.96
264 TestPause/serial/SecondStartNoReconfiguration 5.61
265 TestPause/serial/Pause 0.69
266 TestPause/serial/VerifyStatus 0.28
267 TestPause/serial/Unpause 0.63
268 TestPause/serial/PauseAgain 0.74
269 TestPause/serial/DeletePaused 2.53
270 TestPause/serial/VerifyDeletedResources 0.62
272 TestStartStop/group/no-preload/serial/FirstStart 107.32
273 TestStartStop/group/old-k8s-version/serial/DeployApp 9.4
274 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.91
275 TestStartStop/group/no-preload/serial/DeployApp 9.51
276 TestStartStop/group/old-k8s-version/serial/Stop 12.67
278 TestStartStop/group/embed-certs/serial/FirstStart 54.47
279 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.93
280 TestStartStop/group/no-preload/serial/Stop 16.2
281 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.2
282 TestStartStop/group/old-k8s-version/serial/SecondStart 67.89
283 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.24
284 TestStartStop/group/no-preload/serial/SecondStart 335.15
286 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 52.9
287 TestStartStop/group/embed-certs/serial/DeployApp 10.38
288 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.95
289 TestStartStop/group/embed-certs/serial/Stop 11.98
290 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 10.34
291 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.02
292 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.16
293 TestStartStop/group/embed-certs/serial/SecondStart 332.79
294 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.09
295 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.99
296 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.31
297 TestStartStop/group/old-k8s-version/serial/Pause 2.8
298 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.01
300 TestStartStop/group/newest-cni/serial/FirstStart 34.38
301 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.23
302 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 331.95
303 TestStartStop/group/newest-cni/serial/DeployApp 0
304 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.99
305 TestStartStop/group/newest-cni/serial/Stop 1.2
306 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.16
307 TestStartStop/group/newest-cni/serial/SecondStart 24.96
308 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
309 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
310 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.29
311 TestStartStop/group/newest-cni/serial/Pause 2.58
312 TestNetworkPlugins/group/auto/Start 51.86
313 TestNetworkPlugins/group/auto/KubeletFlags 0.26
314 TestNetworkPlugins/group/auto/NetCatPod 8.29
315 TestNetworkPlugins/group/auto/DNS 0.16
316 TestNetworkPlugins/group/auto/Localhost 0.13
317 TestNetworkPlugins/group/auto/HairPin 0.14
318 TestNetworkPlugins/group/kindnet/Start 52.53
319 TestNetworkPlugins/group/kindnet/ControllerPod 5.02
320 TestNetworkPlugins/group/kindnet/KubeletFlags 0.26
321 TestNetworkPlugins/group/kindnet/NetCatPod 8.24
322 TestNetworkPlugins/group/kindnet/DNS 0.15
323 TestNetworkPlugins/group/kindnet/Localhost 0.13
324 TestNetworkPlugins/group/kindnet/HairPin 0.12
325 TestNetworkPlugins/group/calico/Start 67.4
326 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 11.02
327 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.09
328 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.31
329 TestStartStop/group/no-preload/serial/Pause 2.75
330 TestNetworkPlugins/group/custom-flannel/Start 53.46
331 TestNetworkPlugins/group/calico/ControllerPod 5.02
332 TestNetworkPlugins/group/calico/KubeletFlags 0.28
333 TestNetworkPlugins/group/calico/NetCatPod 9.39
334 TestNetworkPlugins/group/calico/DNS 0.17
335 TestNetworkPlugins/group/calico/Localhost 0.14
336 TestNetworkPlugins/group/calico/HairPin 0.14
337 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 11.03
338 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.1
339 TestNetworkPlugins/group/enable-default-cni/Start 45.47
340 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.34
341 TestStartStop/group/embed-certs/serial/Pause 3.01
342 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 10.02
343 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.39
344 TestNetworkPlugins/group/custom-flannel/NetCatPod 10.79
345 TestNetworkPlugins/group/flannel/Start 52.62
346 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.08
347 TestNetworkPlugins/group/custom-flannel/DNS 0.18
348 TestNetworkPlugins/group/custom-flannel/Localhost 0.14
349 TestNetworkPlugins/group/custom-flannel/HairPin 0.14
350 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.31
351 TestStartStop/group/default-k8s-diff-port/serial/Pause 2.85
352 TestNetworkPlugins/group/bridge/Start 38.09
353 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.3
354 TestNetworkPlugins/group/enable-default-cni/NetCatPod 10.36
355 TestNetworkPlugins/group/enable-default-cni/DNS 0.14
356 TestNetworkPlugins/group/enable-default-cni/Localhost 0.14
357 TestNetworkPlugins/group/enable-default-cni/HairPin 0.13
358 TestNetworkPlugins/group/flannel/ControllerPod 5.02
359 TestNetworkPlugins/group/bridge/KubeletFlags 0.28
360 TestNetworkPlugins/group/bridge/NetCatPod 8.28
361 TestNetworkPlugins/group/flannel/KubeletFlags 0.27
362 TestNetworkPlugins/group/flannel/NetCatPod 9.26
363 TestNetworkPlugins/group/bridge/DNS 0.17
364 TestNetworkPlugins/group/bridge/Localhost 0.14
365 TestNetworkPlugins/group/bridge/HairPin 0.13
366 TestNetworkPlugins/group/flannel/DNS 0.15
367 TestNetworkPlugins/group/flannel/Localhost 0.12
368 TestNetworkPlugins/group/flannel/HairPin 0.13
x
+
TestDownloadOnly/v1.16.0/json-events (22.87s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-495637 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-495637 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (22.874183106s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (22.87s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.06s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-495637
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-495637: exit status 85 (58.65153ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-495637 | jenkins | v1.31.2 | 06 Sep 23 23:37 UTC |          |
	|         | -p download-only-495637        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/09/06 23:37:35
	Running on machine: ubuntu-20-agent-6
	Binary: Built with gc go1.20.7 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0906 23:37:35.846431  577793 out.go:296] Setting OutFile to fd 1 ...
	I0906 23:37:35.846647  577793 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:37:35.846659  577793 out.go:309] Setting ErrFile to fd 2...
	I0906 23:37:35.846666  577793 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:37:35.846954  577793 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	W0906 23:37:35.847105  577793 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17174-571027/.minikube/config/config.json: open /home/jenkins/minikube-integration/17174-571027/.minikube/config/config.json: no such file or directory
	I0906 23:37:35.847795  577793 out.go:303] Setting JSON to true
	I0906 23:37:35.848832  577793 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":18929,"bootTime":1694024527,"procs":179,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0906 23:37:35.848928  577793 start.go:138] virtualization: kvm guest
	I0906 23:37:35.851655  577793 out.go:97] [download-only-495637] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	I0906 23:37:35.853379  577793 out.go:169] MINIKUBE_LOCATION=17174
	W0906 23:37:35.851761  577793 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball: no such file or directory
	I0906 23:37:35.851845  577793 notify.go:220] Checking for updates...
	I0906 23:37:35.856477  577793 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0906 23:37:35.857931  577793 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0906 23:37:35.859376  577793 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	I0906 23:37:35.860912  577793 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
	W0906 23:37:35.864140  577793 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0906 23:37:35.864388  577793 driver.go:373] Setting default libvirt URI to qemu:///system
	I0906 23:37:35.887416  577793 docker.go:121] docker version: linux-24.0.6:Docker Engine - Community
	I0906 23:37:35.887556  577793 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:37:35.939473  577793 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:44 SystemTime:2023-09-06 23:37:35.930573052 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:37:35.939608  577793 docker.go:294] overlay module found
	I0906 23:37:35.941433  577793 out.go:97] Using the docker driver based on user configuration
	I0906 23:37:35.941469  577793 start.go:298] selected driver: docker
	I0906 23:37:35.941478  577793 start.go:902] validating driver "docker" against <nil>
	I0906 23:37:35.941604  577793 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:37:35.991715  577793 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:44 SystemTime:2023-09-06 23:37:35.983569183 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:37:35.991856  577793 start_flags.go:307] no existing cluster config was found, will generate one from the flags 
	I0906 23:37:35.992365  577793 start_flags.go:384] Using suggested 8000MB memory alloc based on sys=32089MB, container=32089MB
	I0906 23:37:35.992512  577793 start_flags.go:904] Wait components to verify : map[apiserver:true system_pods:true]
	I0906 23:37:35.994512  577793 out.go:169] Using Docker driver with root privileges
	I0906 23:37:35.996047  577793 cni.go:84] Creating CNI manager for ""
	I0906 23:37:35.996066  577793 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0906 23:37:35.996081  577793 start_flags.go:316] Found "CNI" CNI - setting NetworkPlugin=cni
	I0906 23:37:35.996093  577793 start_flags.go:321] config:
	{Name:download-only-495637 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-495637 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0906 23:37:35.997684  577793 out.go:97] Starting control plane node download-only-495637 in cluster download-only-495637
	I0906 23:37:35.997702  577793 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0906 23:37:35.999156  577793 out.go:97] Pulling base image ...
	I0906 23:37:35.999189  577793 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0906 23:37:35.999297  577793 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local docker daemon
	I0906 23:37:36.015328  577793 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b to local cache
	I0906 23:37:36.015511  577793 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local cache directory
	I0906 23:37:36.015606  577793 image.go:118] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b to local cache
	I0906 23:37:36.096970  577793 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
	I0906 23:37:36.097008  577793 cache.go:57] Caching tarball of preloaded images
	I0906 23:37:36.097141  577793 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0906 23:37:36.099538  577793 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0906 23:37:36.099572  577793 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
	I0906 23:37:36.203475  577793 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4?checksum=md5:d96a2b2afa188e17db7ddabb58d563fd -> /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
	I0906 23:37:51.006300  577793 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
	I0906 23:37:51.006388  577793 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...
	I0906 23:37:51.847354  577793 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on containerd
	I0906 23:37:51.847698  577793 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/download-only-495637/config.json ...
	I0906 23:37:51.847727  577793 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/download-only-495637/config.json: {Name:mk414821703e780291769c5ba06ea28375b5f10b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0906 23:37:51.847915  577793 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0906 23:37:51.848131  577793 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/linux/amd64/kubectl.sha1 -> /home/jenkins/minikube-integration/17174-571027/.minikube/cache/linux/amd64/v1.16.0/kubectl
	I0906 23:37:55.197445  577793 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b as a tarball
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-495637"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.06s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.1/json-events (15.71s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.1/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-495637 --force --alsologtostderr --kubernetes-version=v1.28.1 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-495637 --force --alsologtostderr --kubernetes-version=v1.28.1 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (15.713236117s)
--- PASS: TestDownloadOnly/v1.28.1/json-events (15.71s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.1/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.1/preload-exists
--- PASS: TestDownloadOnly/v1.28.1/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.1/LogsDuration (0.06s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.1/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-495637
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-495637: exit status 85 (58.421718ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-495637 | jenkins | v1.31.2 | 06 Sep 23 23:37 UTC |          |
	|         | -p download-only-495637        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-495637 | jenkins | v1.31.2 | 06 Sep 23 23:37 UTC |          |
	|         | -p download-only-495637        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.28.1   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/09/06 23:37:58
	Running on machine: ubuntu-20-agent-6
	Binary: Built with gc go1.20.7 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0906 23:37:58.782249  577984 out.go:296] Setting OutFile to fd 1 ...
	I0906 23:37:58.782440  577984 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:37:58.782450  577984 out.go:309] Setting ErrFile to fd 2...
	I0906 23:37:58.782454  577984 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:37:58.782670  577984 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	W0906 23:37:58.782780  577984 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17174-571027/.minikube/config/config.json: open /home/jenkins/minikube-integration/17174-571027/.minikube/config/config.json: no such file or directory
	I0906 23:37:58.783208  577984 out.go:303] Setting JSON to true
	I0906 23:37:58.784153  577984 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":18952,"bootTime":1694024527,"procs":169,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0906 23:37:58.784216  577984 start.go:138] virtualization: kvm guest
	I0906 23:37:58.786540  577984 out.go:97] [download-only-495637] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	I0906 23:37:58.788201  577984 out.go:169] MINIKUBE_LOCATION=17174
	I0906 23:37:58.786727  577984 notify.go:220] Checking for updates...
	I0906 23:37:58.791225  577984 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0906 23:37:58.792890  577984 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0906 23:37:58.794402  577984 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	I0906 23:37:58.795791  577984 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
	W0906 23:37:58.798631  577984 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0906 23:37:58.799062  577984 config.go:182] Loaded profile config "download-only-495637": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	W0906 23:37:58.799109  577984 start.go:810] api.Load failed for download-only-495637: filestore "download-only-495637": Docker machine "download-only-495637" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0906 23:37:58.799197  577984 driver.go:373] Setting default libvirt URI to qemu:///system
	W0906 23:37:58.799225  577984 start.go:810] api.Load failed for download-only-495637: filestore "download-only-495637": Docker machine "download-only-495637" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0906 23:37:58.821888  577984 docker.go:121] docker version: linux-24.0.6:Docker Engine - Community
	I0906 23:37:58.821968  577984 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:37:58.875599  577984 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:40 SystemTime:2023-09-06 23:37:58.866817421 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:37:58.875692  577984 docker.go:294] overlay module found
	I0906 23:37:58.877558  577984 out.go:97] Using the docker driver based on existing profile
	I0906 23:37:58.877584  577984 start.go:298] selected driver: docker
	I0906 23:37:58.877589  577984 start.go:902] validating driver "docker" against &{Name:download-only-495637 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-495637 Namespace:default APIServerName:
minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnet
ClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0906 23:37:58.877738  577984 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:37:58.929430  577984 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:40 SystemTime:2023-09-06 23:37:58.9208383 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archite
cture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:37:58.930358  577984 cni.go:84] Creating CNI manager for ""
	I0906 23:37:58.930384  577984 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0906 23:37:58.930399  577984 start_flags.go:321] config:
	{Name:download-only-495637 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:download-only-495637 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInter
val:1m0s}
	I0906 23:37:58.932401  577984 out.go:97] Starting control plane node download-only-495637 in cluster download-only-495637
	I0906 23:37:58.932425  577984 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0906 23:37:58.934021  577984 out.go:97] Pulling base image ...
	I0906 23:37:58.934051  577984 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0906 23:37:58.934161  577984 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local docker daemon
	I0906 23:37:58.949474  577984 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b to local cache
	I0906 23:37:58.949640  577984 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local cache directory
	I0906 23:37:58.949681  577984 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b in local cache directory, skipping pull
	I0906 23:37:58.949690  577984 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b exists in cache, skipping pull
	I0906 23:37:58.949699  577984 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b as a tarball
	I0906 23:37:59.038697  577984 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.1/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4
	I0906 23:37:59.038754  577984 cache.go:57] Caching tarball of preloaded images
	I0906 23:37:59.038932  577984 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0906 23:37:59.041034  577984 out.go:97] Downloading Kubernetes v1.28.1 preload ...
	I0906 23:37:59.041056  577984 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4 ...
	I0906 23:37:59.530867  577984 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.1/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4?checksum=md5:923ead224190762fa2aa551036672b63 -> /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4
	I0906 23:38:12.730581  577984 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4 ...
	I0906 23:38:12.730692  577984 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17174-571027/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-containerd-overlay2-amd64.tar.lz4 ...
	I0906 23:38:13.592799  577984 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.1 on containerd
	I0906 23:38:13.592980  577984 profile.go:148] Saving config to /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/download-only-495637/config.json ...
	I0906 23:38:13.593304  577984 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime containerd
	I0906 23:38:13.593543  577984 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.1/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.1/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/17174-571027/.minikube/cache/linux/amd64/v1.28.1/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-495637"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.1/LogsDuration (0.06s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.19s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:187: (dbg) Run:  out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.19s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.12s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:199: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-495637
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.12s)

                                                
                                    
x
+
TestDownloadOnlyKic (1.22s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:222: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p download-docker-757255 --alsologtostderr --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "download-docker-757255" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p download-docker-757255
--- PASS: TestDownloadOnlyKic (1.22s)

                                                
                                    
x
+
TestBinaryMirror (0.71s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:304: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p binary-mirror-252087 --alsologtostderr --binary-mirror http://127.0.0.1:46029 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-252087" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p binary-mirror-252087
--- PASS: TestBinaryMirror (0.71s)

                                                
                                    
x
+
TestOffline (59.09s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-amd64 start -p offline-containerd-288128 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=containerd
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-amd64 start -p offline-containerd-288128 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=containerd: (55.369038556s)
helpers_test.go:175: Cleaning up "offline-containerd-288128" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p offline-containerd-288128
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p offline-containerd-288128: (3.718859239s)
--- PASS: TestOffline (59.09s)

                                                
                                    
x
+
TestAddons/Setup (108.04s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:88: (dbg) Run:  out/minikube-linux-amd64 start -p addons-626363 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:88: (dbg) Done: out/minikube-linux-amd64 start -p addons-626363 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=helm-tiller: (1m48.039111303s)
--- PASS: TestAddons/Setup (108.04s)

                                                
                                    
x
+
TestAddons/parallel/Registry (16.83s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:306: registry stabilized in 14.51174ms
addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-crxnd" [79cef8ea-8e82-47bf-a98b-cd5962d396a4] Running
addons_test.go:308: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.015108815s
addons_test.go:311: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-228xp" [ce33c22d-7af8-4568-b5fe-20b02d9aa630] Running
addons_test.go:311: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.012906391s
addons_test.go:316: (dbg) Run:  kubectl --context addons-626363 delete po -l run=registry-test --now
addons_test.go:321: (dbg) Run:  kubectl --context addons-626363 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:321: (dbg) Done: kubectl --context addons-626363 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (5.989554886s)
addons_test.go:335: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 ip
2023/09/06 23:40:21 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:364: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (16.83s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (22.04s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:183: (dbg) Run:  kubectl --context addons-626363 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:208: (dbg) Run:  kubectl --context addons-626363 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context addons-626363 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [25c8e455-4d19-4290-869c-be3d12525ed7] Pending
helpers_test.go:344: "nginx" [25c8e455-4d19-4290-869c-be3d12525ed7] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [25c8e455-4d19-4290-869c-be3d12525ed7] Running
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 11.017690451s
addons_test.go:238: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context addons-626363 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:282: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:287: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-amd64 -p addons-626363 addons disable ingress --alsologtostderr -v=1: (7.621733804s)
--- PASS: TestAddons/parallel/Ingress (22.04s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.86s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-jb8cf" [df74a121-d528-4a11-b5d6-d5862bb0401c] Running
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.010328113s
addons_test.go:817: (dbg) Run:  out/minikube-linux-amd64 addons disable inspektor-gadget -p addons-626363
addons_test.go:817: (dbg) Done: out/minikube-linux-amd64 addons disable inspektor-gadget -p addons-626363: (5.845583601s)
--- PASS: TestAddons/parallel/InspektorGadget (10.86s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.78s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:383: metrics-server stabilized in 4.07969ms
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-7c66d45ddc-5vvp8" [19cd6c67-d5f7-41e3-b3a9-de4854501eeb] Running
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.055998523s
addons_test.go:391: (dbg) Run:  kubectl --context addons-626363 top pods -n kube-system
addons_test.go:408: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.78s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (11.74s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:432: tiller-deploy stabilized in 13.378165ms
addons_test.go:434: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...
helpers_test.go:344: "tiller-deploy-7b677967b9-74g6j" [93842e0e-812d-44d2-91b9-cd537f4977cd] Running
addons_test.go:434: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.014366371s
addons_test.go:449: (dbg) Run:  kubectl --context addons-626363 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version
addons_test.go:449: (dbg) Done: kubectl --context addons-626363 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (6.115743833s)
addons_test.go:466: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (11.74s)

                                                
                                    
x
+
TestAddons/parallel/CSI (50.22s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:537: csi-hostpath-driver pods stabilized in 6.168785ms
addons_test.go:540: (dbg) Run:  kubectl --context addons-626363 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:550: (dbg) Run:  kubectl --context addons-626363 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [edf2d558-76ac-47ef-b8fe-1025e60632e9] Pending
helpers_test.go:344: "task-pv-pod" [edf2d558-76ac-47ef-b8fe-1025e60632e9] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [edf2d558-76ac-47ef-b8fe-1025e60632e9] Running
addons_test.go:555: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 11.009235708s
addons_test.go:560: (dbg) Run:  kubectl --context addons-626363 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-626363 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-626363 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-626363 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:570: (dbg) Run:  kubectl --context addons-626363 delete pod task-pv-pod
addons_test.go:576: (dbg) Run:  kubectl --context addons-626363 delete pvc hpvc
addons_test.go:582: (dbg) Run:  kubectl --context addons-626363 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:587: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-626363 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:592: (dbg) Run:  kubectl --context addons-626363 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:597: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [4eeec182-f9dd-44f9-b5fa-2dcfab8dac94] Pending
helpers_test.go:344: "task-pv-pod-restore" [4eeec182-f9dd-44f9-b5fa-2dcfab8dac94] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [4eeec182-f9dd-44f9-b5fa-2dcfab8dac94] Running
addons_test.go:597: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.009968506s
addons_test.go:602: (dbg) Run:  kubectl --context addons-626363 delete pod task-pv-pod-restore
addons_test.go:606: (dbg) Run:  kubectl --context addons-626363 delete pvc hpvc-restore
addons_test.go:610: (dbg) Run:  kubectl --context addons-626363 delete volumesnapshot new-snapshot-demo
addons_test.go:614: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:614: (dbg) Done: out/minikube-linux-amd64 -p addons-626363 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.533897631s)
addons_test.go:618: (dbg) Run:  out/minikube-linux-amd64 -p addons-626363 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (50.22s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (13.31s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:800: (dbg) Run:  out/minikube-linux-amd64 addons enable headlamp -p addons-626363 --alsologtostderr -v=1
addons_test.go:800: (dbg) Done: out/minikube-linux-amd64 addons enable headlamp -p addons-626363 --alsologtostderr -v=1: (1.257454389s)
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-699c48fb74-2nmt6" [55449e57-61f7-422c-ad24-f025f47933f1] Pending
helpers_test.go:344: "headlamp-699c48fb74-2nmt6" [55449e57-61f7-422c-ad24-f025f47933f1] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-699c48fb74-2nmt6" [55449e57-61f7-422c-ad24-f025f47933f1] Running
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 12.050611753s
--- PASS: TestAddons/parallel/Headlamp (13.31s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.93s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-6dcc56475c-ccj8h" [02e6a6f0-db4a-4c2f-979f-aa403a4c1950] Running
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.011226645s
addons_test.go:836: (dbg) Run:  out/minikube-linux-amd64 addons disable cloud-spanner -p addons-626363
--- PASS: TestAddons/parallel/CloudSpanner (5.93s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.13s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:626: (dbg) Run:  kubectl --context addons-626363 create ns new-namespace
addons_test.go:640: (dbg) Run:  kubectl --context addons-626363 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.13s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.16s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:148: (dbg) Run:  out/minikube-linux-amd64 stop -p addons-626363
addons_test.go:148: (dbg) Done: out/minikube-linux-amd64 stop -p addons-626363: (11.934663073s)
addons_test.go:152: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-626363
addons_test.go:156: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-626363
addons_test.go:161: (dbg) Run:  out/minikube-linux-amd64 addons disable gvisor -p addons-626363
--- PASS: TestAddons/StoppedEnableDisable (12.16s)

                                                
                                    
x
+
TestCertOptions (25.08s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-amd64 start -p cert-options-061518 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-061518 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (22.346712087s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-amd64 -p cert-options-061518 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-061518 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-amd64 ssh -p cert-options-061518 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-061518" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-options-061518
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-061518: (2.113536341s)
--- PASS: TestCertOptions (25.08s)

                                                
                                    
x
+
TestCertExpiration (212.27s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-754141 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd
cert_options_test.go:123: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-754141 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (25.356626939s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-754141 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-754141 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (4.667863538s)
helpers_test.go:175: Cleaning up "cert-expiration-754141" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-expiration-754141
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-754141: (2.244569343s)
--- PASS: TestCertExpiration (212.27s)

                                                
                                    
x
+
TestForceSystemdFlag (27.57s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-flag-448041 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
E0907 00:07:13.637297  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
docker_test.go:91: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-448041 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (24.439342192s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-flag-448041 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-448041" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-flag-448041
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-448041: (2.865707246s)
--- PASS: TestForceSystemdFlag (27.57s)

                                                
                                    
x
+
TestForceSystemdEnv (25.81s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-env-717311 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:155: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-717311 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (21.593292021s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-env-717311 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-717311" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-env-717311
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-717311: (3.950500589s)
--- PASS: TestForceSystemdEnv (25.81s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (4.77s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
=== PAUSE TestKVMDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestKVMDriverInstallOrUpdate
--- PASS: TestKVMDriverInstallOrUpdate (4.77s)

                                                
                                    
x
+
TestErrorSpam/setup (24.33s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-amd64 start -p nospam-326840 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-326840 --driver=docker  --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -p nospam-326840 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-326840 --driver=docker  --container-runtime=containerd: (24.3251173s)
--- PASS: TestErrorSpam/setup (24.33s)

                                                
                                    
x
+
TestErrorSpam/start (0.58s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 start --dry-run
--- PASS: TestErrorSpam/start (0.58s)

                                                
                                    
x
+
TestErrorSpam/status (0.83s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 status
--- PASS: TestErrorSpam/status (0.83s)

                                                
                                    
x
+
TestErrorSpam/pause (1.47s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 pause
--- PASS: TestErrorSpam/pause (1.47s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.43s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 unpause
--- PASS: TestErrorSpam/unpause (1.43s)

                                                
                                    
x
+
TestErrorSpam/stop (1.35s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 stop: (1.184605507s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-326840 --log_dir /tmp/nospam-326840 stop
--- PASS: TestErrorSpam/stop (1.35s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/17174-571027/.minikube/files/etc/test/nested/copy/577782/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (48.12s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-amd64 start -p functional-073118 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
functional_test.go:2230: (dbg) Done: out/minikube-linux-amd64 start -p functional-073118 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (48.117476899s)
--- PASS: TestFunctional/serial/StartWithProxy (48.12s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (4.78s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-amd64 start -p functional-073118 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-amd64 start -p functional-073118 --alsologtostderr -v=8: (4.781140821s)
functional_test.go:659: soft start took 4.781835028s for "functional-073118" cluster.
--- PASS: TestFunctional/serial/SoftStart (4.78s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.05s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-073118 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.07s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.48s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 cache add registry.k8s.io/pause:3.1: (1.140637171s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 cache add registry.k8s.io/pause:3.3: (1.243630691s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 cache add registry.k8s.io/pause:latest: (1.094512695s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.48s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (2.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-073118 /tmp/TestFunctionalserialCacheCmdcacheadd_local1975767034/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 cache add minikube-local-cache-test:functional-073118
functional_test.go:1085: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 cache add minikube-local-cache-test:functional-073118: (1.764116535s)
functional_test.go:1090: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 cache delete minikube-local-cache-test:functional-073118
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-073118
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (2.08s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.04s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.27s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.27s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.92s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (271.593715ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 cache reload
functional_test.go:1154: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 cache reload: (1.094382955s)
functional_test.go:1159: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.92s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.09s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 kubectl -- --context functional-073118 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-073118 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.10s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (39.85s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-amd64 start -p functional-073118 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Done: out/minikube-linux-amd64 start -p functional-073118 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (39.848795183s)
functional_test.go:757: restart took 39.848947803s for "functional-073118" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (39.85s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-073118 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.07s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.33s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 logs: (1.332373084s)
--- PASS: TestFunctional/serial/LogsCmd (1.33s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.36s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 logs --file /tmp/TestFunctionalserialLogsFileCmd2809525231/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 logs --file /tmp/TestFunctionalserialLogsFileCmd2809525231/001/logs.txt: (1.359122556s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.36s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.38s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-073118 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run:  out/minikube-linux-amd64 service invalid-svc -p functional-073118
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-amd64 service invalid-svc -p functional-073118: exit status 115 (319.589335ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:32722 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-073118 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.38s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 config get cpus: exit status 14 (68.039117ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 config get cpus: exit status 14 (54.4871ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (26.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-073118 --alsologtostderr -v=1]
E0906 23:45:15.163482  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
functional_test.go:906: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-073118 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 616878: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (26.50s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-amd64 start -p functional-073118 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-073118 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (415.964663ms)

                                                
                                                
-- stdout --
	* [functional-073118] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=17174
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0906 23:45:12.584874  616473 out.go:296] Setting OutFile to fd 1 ...
	I0906 23:45:12.585023  616473 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:45:12.585036  616473 out.go:309] Setting ErrFile to fd 2...
	I0906 23:45:12.585044  616473 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:45:12.585263  616473 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	I0906 23:45:12.585820  616473 out.go:303] Setting JSON to false
	I0906 23:45:12.587055  616473 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":19386,"bootTime":1694024527,"procs":538,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0906 23:45:12.587125  616473 start.go:138] virtualization: kvm guest
	I0906 23:45:12.655433  616473 out.go:177] * [functional-073118] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	I0906 23:45:12.697503  616473 notify.go:220] Checking for updates...
	I0906 23:45:12.697536  616473 out.go:177]   - MINIKUBE_LOCATION=17174
	I0906 23:45:12.732513  616473 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0906 23:45:12.745997  616473 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0906 23:45:12.764366  616473 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	I0906 23:45:12.766709  616473 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0906 23:45:12.768537  616473 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0906 23:45:12.776719  616473 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0906 23:45:12.777375  616473 driver.go:373] Setting default libvirt URI to qemu:///system
	I0906 23:45:12.799415  616473 docker.go:121] docker version: linux-24.0.6:Docker Engine - Community
	I0906 23:45:12.799536  616473 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:45:12.854424  616473 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:37 OomKillDisable:true NGoroutines:51 SystemTime:2023-09-06 23:45:12.843724011 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:45:12.854585  616473 docker.go:294] overlay module found
	I0906 23:45:12.897700  616473 out.go:177] * Using the docker driver based on existing profile
	I0906 23:45:12.926534  616473 start.go:298] selected driver: docker
	I0906 23:45:12.926560  616473 start.go:902] validating driver "docker" against &{Name:functional-073118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:functional-073118 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersi
on:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0906 23:45:12.926755  616473 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0906 23:45:12.929815  616473 out.go:177] 
	W0906 23:45:12.947822  616473 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0906 23:45:12.956349  616473 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-amd64 start -p functional-073118 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-amd64 start -p functional-073118 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-073118 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (189.431884ms)

                                                
                                                
-- stdout --
	* [functional-073118] minikube v1.31.2 sur Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=17174
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0906 23:44:50.922549  611511 out.go:296] Setting OutFile to fd 1 ...
	I0906 23:44:50.922775  611511 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:44:50.922787  611511 out.go:309] Setting ErrFile to fd 2...
	I0906 23:44:50.922793  611511 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:44:50.923215  611511 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	I0906 23:44:50.924112  611511 out.go:303] Setting JSON to false
	I0906 23:44:50.925984  611511 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":19364,"bootTime":1694024527,"procs":519,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0906 23:44:50.926079  611511 start.go:138] virtualization: kvm guest
	I0906 23:44:50.928860  611511 out.go:177] * [functional-073118] minikube v1.31.2 sur Ubuntu 20.04 (kvm/amd64)
	I0906 23:44:50.932933  611511 out.go:177]   - MINIKUBE_LOCATION=17174
	I0906 23:44:50.933107  611511 notify.go:220] Checking for updates...
	I0906 23:44:50.934825  611511 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0906 23:44:50.936814  611511 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0906 23:44:50.938385  611511 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	I0906 23:44:50.940081  611511 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0906 23:44:50.942090  611511 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0906 23:44:50.944285  611511 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0906 23:44:50.944792  611511 driver.go:373] Setting default libvirt URI to qemu:///system
	I0906 23:44:50.972163  611511 docker.go:121] docker version: linux-24.0.6:Docker Engine - Community
	I0906 23:44:50.972242  611511 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:44:51.049129  611511 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:48 SystemTime:2023-09-06 23:44:51.037275662 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:44:51.049229  611511 docker.go:294] overlay module found
	I0906 23:44:51.051165  611511 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0906 23:44:51.052738  611511 start.go:298] selected driver: docker
	I0906 23:44:51.052759  611511 start.go:902] validating driver "docker" against &{Name:functional-073118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:functional-073118 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersi
on:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
	I0906 23:44:51.052898  611511 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0906 23:44:51.055002  611511 out.go:177] 
	W0906 23:44:51.056253  611511 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0906 23:44:51.057636  611511 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.86s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (0.86s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (9.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1628: (dbg) Run:  kubectl --context functional-073118 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-073118 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-55497b8b78-v8gbd" [6eded519-28d2-48db-bac3-59b64e6fd339] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])
helpers_test.go:344: "hello-node-connect-55497b8b78-v8gbd" [6eded519-28d2-48db-bac3-59b64e6fd339] Running
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 9.009463861s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:31835
functional_test.go:1674: http://192.168.49.2:31835: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-55497b8b78-v8gbd

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31835
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (9.73s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (36.94s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [8fda01e5-083b-40b8-a8c8-edeac2918300] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.024894429s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-073118 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-073118 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-073118 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-073118 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [9b5e335e-96a7-4e27-a038-f7efa7d1eae7] Pending
helpers_test.go:344: "sp-pod" [9b5e335e-96a7-4e27-a038-f7efa7d1eae7] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [9b5e335e-96a7-4e27-a038-f7efa7d1eae7] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 13.009674565s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-073118 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-073118 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-073118 delete -f testdata/storage-provisioner/pod.yaml: (1.692618564s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-073118 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [228dcc1b-ac4d-4e68-bf43-14dd465f46c4] Pending
helpers_test.go:344: "sp-pod" [228dcc1b-ac4d-4e68-bf43-14dd465f46c4] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [228dcc1b-ac4d-4e68-bf43-14dd465f46c4] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 16.018201929s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-073118 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (36.94s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.61s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh -n functional-073118 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 cp functional-073118:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd1225850520/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh -n functional-073118 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.11s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (27.85s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1789: (dbg) Run:  kubectl --context functional-073118 replace --force -f testdata/mysql.yaml
functional_test.go:1795: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...
helpers_test.go:344: "mysql-859648c796-hqdf2" [172cf4b5-ddad-4927-a53d-41205f51aa68] Pending
E0906 23:45:06.201696  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
helpers_test.go:344: "mysql-859648c796-hqdf2" [172cf4b5-ddad-4927-a53d-41205f51aa68] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])
E0906 23:45:07.481887  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
helpers_test.go:344: "mysql-859648c796-hqdf2" [172cf4b5-ddad-4927-a53d-41205f51aa68] Running
functional_test.go:1795: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 19.011348288s
functional_test.go:1803: (dbg) Run:  kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;"
functional_test.go:1803: (dbg) Non-zero exit: kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;": exit status 1 (134.533396ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
	command terminated with exit code 1

                                                
                                                
** /stderr **
E0906 23:45:25.404545  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
functional_test.go:1803: (dbg) Run:  kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;"
functional_test.go:1803: (dbg) Non-zero exit: kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;": exit status 1 (360.909104ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
	command terminated with exit code 1

                                                
                                                
** /stderr **
functional_test.go:1803: (dbg) Run:  kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;"
functional_test.go:1803: (dbg) Non-zero exit: kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;": exit status 1 (292.071442ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
	command terminated with exit code 1

                                                
                                                
** /stderr **
functional_test.go:1803: (dbg) Run:  kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;"
functional_test.go:1803: (dbg) Non-zero exit: kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;": exit status 1 (243.17605ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
	command terminated with exit code 1

                                                
                                                
** /stderr **
functional_test.go:1803: (dbg) Run:  kubectl --context functional-073118 exec mysql-859648c796-hqdf2 -- mysql -ppassword -e "show databases;"
--- PASS: TestFunctional/parallel/MySQL (27.85s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/577782/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo cat /etc/test/nested/copy/577782/hosts"
E0906 23:45:05.561125  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.62s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/577782.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo cat /etc/ssl/certs/577782.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/577782.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo cat /usr/share/ca-certificates/577782.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/5777822.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo cat /etc/ssl/certs/5777822.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/5777822.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo cat /usr/share/ca-certificates/5777822.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.62s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-073118 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.62s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo systemctl is-active docker"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 ssh "sudo systemctl is-active docker": exit status 1 (345.92074ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2023: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 ssh "sudo systemctl is-active crio": exit status 1 (278.554889ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.62s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-amd64 license
--- PASS: TestFunctional/parallel/License (0.77s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-amd64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.44s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-073118 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-073118 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-073118 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-073118 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 611041: os: process already finished
helpers_test.go:502: unable to terminate pid 610649: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-amd64 profile list
functional_test.go:1314: Took "368.167073ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-amd64 profile list -l
functional_test.go:1328: Took "46.22534ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-amd64 -p functional-073118 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-073118 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [2ede84c1-abb2-4600-baee-cba311d3b49f] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [2ede84c1-abb2-4600-baee-cba311d3b49f] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 10.033934592s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.33s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 version --short
--- PASS: TestFunctional/parallel/Version/short (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 version -o=json --components
functional_test.go:2266: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 version -o=json --components: (1.248877156s)
--- PASS: TestFunctional/parallel/Version/components (1.25s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-amd64 profile list -o json
functional_test.go:1365: Took "266.920307ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-amd64 profile list -o json --light
functional_test.go:1378: Took "48.769077ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.32s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (11.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdany-port2488708730/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1694043890913771473" to /tmp/TestFunctionalparallelMountCmdany-port2488708730/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1694043890913771473" to /tmp/TestFunctionalparallelMountCmdany-port2488708730/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1694043890913771473" to /tmp/TestFunctionalparallelMountCmdany-port2488708730/001/test-1694043890913771473
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (295.1809ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Sep  6 23:44 created-by-test
-rw-r--r-- 1 docker docker 24 Sep  6 23:44 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Sep  6 23:44 test-1694043890913771473
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh cat /mount-9p/test-1694043890913771473
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-073118 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [b8c2fa79-74bb-4fc6-9a35-1cec81488db8] Pending
helpers_test.go:344: "busybox-mount" [b8c2fa79-74bb-4fc6-9a35-1cec81488db8] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [b8c2fa79-74bb-4fc6-9a35-1cec81488db8] Running
helpers_test.go:344: "busybox-mount" [b8c2fa79-74bb-4fc6-9a35-1cec81488db8] Running: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [b8c2fa79-74bb-4fc6-9a35-1cec81488db8] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 8.01502643s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-073118 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdany-port2488708730/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (11.18s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-073118 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.107.6.107 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-amd64 -p functional-073118 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (7.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1438: (dbg) Run:  kubectl --context functional-073118 create deployment hello-node --image=registry.k8s.io/echoserver:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-073118 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-d7447cc7f-cklb7" [d9269da3-3b85-4801-877e-612742d516e8] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])
helpers_test.go:344: "hello-node-d7447cc7f-cklb7" [d9269da3-3b85-4801-877e-612742d516e8] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 7.012872272s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (7.23s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (1.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdspecific-port3737991362/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (264.862891ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdspecific-port3737991362/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 ssh "sudo umount -f /mount-9p": exit status 1 (256.048225ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-amd64 -p functional-073118 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdspecific-port3737991362/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.65s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.8s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdVerifyCleanup891131601/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdVerifyCleanup891131601/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdVerifyCleanup891131601/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T" /mount1: exit status 1 (326.506252ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T" /mount1
E0906 23:45:04.922598  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
E0906 23:45:04.928353  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
E0906 23:45:04.938497  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
E0906 23:45:04.959394  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
E0906 23:45:04.999710  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T" /mount2
E0906 23:45:05.080133  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
E0906 23:45:05.240554  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-amd64 mount -p functional-073118 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdVerifyCleanup891131601/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdVerifyCleanup891131601/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-073118 /tmp/TestFunctionalparallelMountCmdVerifyCleanup891131601/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.80s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-073118 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.28.1
registry.k8s.io/kube-proxy:v1.28.1
registry.k8s.io/kube-controller-manager:v1.28.1
registry.k8s.io/kube-apiserver:v1.28.1
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/echoserver:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-073118
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/mysql:5.7
docker.io/library/minikube-local-cache-test:functional-073118
docker.io/kindest/kindnetd:v20230511-dc714da8
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-073118 image ls --format short --alsologtostderr:
I0906 23:45:31.316368  618568 out.go:296] Setting OutFile to fd 1 ...
I0906 23:45:31.316593  618568 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.316606  618568 out.go:309] Setting ErrFile to fd 2...
I0906 23:45:31.316613  618568 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.316992  618568 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
I0906 23:45:31.317913  618568 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.318036  618568 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.318697  618568 cli_runner.go:164] Run: docker container inspect functional-073118 --format={{.State.Status}}
I0906 23:45:31.335974  618568 ssh_runner.go:195] Run: systemctl --version
I0906 23:45:31.336026  618568 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-073118
I0906 23:45:31.353247  618568 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/functional-073118/id_rsa Username:docker}
I0906 23:45:31.440689  618568 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-073118 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/kube-proxy                  | v1.28.1            | sha256:6cdbab | 24.6MB |
| registry.k8s.io/pause                       | latest             | sha256:350b16 | 72.3kB |
| registry.k8s.io/coredns/coredns             | v1.10.1            | sha256:ead0a4 | 16.2MB |
| registry.k8s.io/kube-controller-manager     | v1.28.1            | sha256:821b3d | 33.4MB |
| registry.k8s.io/etcd                        | 3.5.9-0            | sha256:73deb9 | 103MB  |
| registry.k8s.io/pause                       | 3.9                | sha256:e6f181 | 322kB  |
| docker.io/library/nginx                     | alpine             | sha256:433dbc | 17.9MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | sha256:6e38f4 | 9.06MB |
| docker.io/library/mysql                     | 5.7                | sha256:92034f | 170MB  |
| gcr.io/google-containers/addon-resizer      | functional-073118  | sha256:ffd4cf | 10.8MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | sha256:56cc51 | 2.4MB  |
| registry.k8s.io/kube-scheduler              | v1.28.1            | sha256:b462ce | 18.8MB |
| registry.k8s.io/pause                       | 3.3                | sha256:0184c1 | 298kB  |
| docker.io/library/minikube-local-cache-test | functional-073118  | sha256:932f9f | 1kB    |
| docker.io/library/nginx                     | latest             | sha256:eea7b3 | 70.5MB |
| registry.k8s.io/echoserver                  | 1.8                | sha256:82e4c8 | 46.2MB |
| registry.k8s.io/kube-apiserver              | v1.28.1            | sha256:5c8012 | 34.6MB |
| registry.k8s.io/pause                       | 3.1                | sha256:da86e6 | 315kB  |
| docker.io/kindest/kindnetd                  | v20230511-dc714da8 | sha256:b0b1fa | 27.7MB |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-073118 image ls --format table --alsologtostderr:
I0906 23:45:31.536961  618658 out.go:296] Setting OutFile to fd 1 ...
I0906 23:45:31.537163  618658 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.537176  618658 out.go:309] Setting ErrFile to fd 2...
I0906 23:45:31.537183  618658 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.537515  618658 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
I0906 23:45:31.538392  618658 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.538553  618658 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.539138  618658 cli_runner.go:164] Run: docker container inspect functional-073118 --format={{.State.Status}}
I0906 23:45:31.557508  618658 ssh_runner.go:195] Run: systemctl --version
I0906 23:45:31.557579  618658 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-073118
I0906 23:45:31.578221  618658 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/functional-073118/id_rsa Username:docker}
I0906 23:45:31.668444  618658 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-073118 image ls --format json --alsologtostderr:
[{"id":"sha256:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"2395207"},{"id":"sha256:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc","repoDigests":["registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e"],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"16190758"},{"id":"sha256:5c801295c21d0de2947ad600b9388f090f0f7ff22add9d9d95be82fa12288f77","repoDigests":["registry.k8s.io/kube-apiserver@sha256:f517207d13adeb50c63f9bdac2824e0e7512817eca47ac0540685771243742b2"],"repoTags":["registry.k8s.io/kube-apiserver:v1.28.1"],"size":"34617463"},{"id":"sha256:0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"297686"},{"id":"sha256:b0b1fa0f58c6e932b7f20bf2
08b2841317a1e8c88cc51b18358310bbd8ec95da","repoDigests":["docker.io/kindest/kindnetd@sha256:6c00e28db008c2afa67d9ee085c86184ec9ae5281d5ae1bd15006746fb9a1974"],"repoTags":["docker.io/kindest/kindnetd:v20230511-dc714da8"],"size":"27731571"},{"id":"sha256:ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-073118"],"size":"10823156"},{"id":"sha256:6cdbabde3874e1eca92441870b0ddeaef0edb514c3b3e2a3d5ade845b500bba5","repoDigests":["registry.k8s.io/kube-proxy@sha256:30096ad233e7bfe72662180c5ac4497f732346d6d25b7c1f1c0c7cb1a1e7e41c"],"repoTags":["registry.k8s.io/kube-proxy:v1.28.1"],"size":"24555014"},{"id":"sha256:350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"72306"},{"id":"sha256:eea7b3dcba7ee47c0d16a60cc85d2b977d166be3960541991f3e6294d795ed24","repoDigests":["docker.io/library/nginx@sha256:104c7c5c54f2685f0f46f3be607ce60da7085da3eaa5ad2
2d3d9f01594295e9c"],"repoTags":["docker.io/library/nginx:latest"],"size":"70479485"},{"id":"sha256:82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410","repoDigests":["registry.k8s.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969"],"repoTags":["registry.k8s.io/echoserver:1.8"],"size":"46237695"},{"id":"sha256:b462ce0c8b1ff16d466c6e8c9fcae54ec740fdeb73af6e637b77eea36246054a","repoDigests":["registry.k8s.io/kube-scheduler@sha256:3c9249a1f7623007a8db3522eac203f94cbb3910501879b792d95ea8470cc3d4"],"repoTags":["registry.k8s.io/kube-scheduler:v1.28.1"],"size":"18802390"},{"id":"sha256:e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c","repoDigests":["registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"321520"},{"id":"sha256:115053965e86b2df4d78af78d7951b8644839d20a03820c6df59a261103315f7","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07
a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"19746404"},{"id":"sha256:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9","repoDigests":["registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"],"repoTags":["registry.k8s.io/etcd:3.5.9-0"],"size":"102894559"},{"id":"sha256:92034fe9a41f4344b97f3fc88a8796248e2cfa9b934be58379f3dbc150d07d9d","repoDigests":["docker.io/library/mysql@sha256:2c23f254c6b9444ecda9ba36051a9800e8934a2f5828ecc8730531db8142af83"],"repoTags":["docker.io/library/mysql:5.7"],"size":"170252563"},{"id":"sha256:433dbc17191a7830a9db6454bcc23414ad36caecedab39d1e51d41083ab1d629","repoDigests":["docker.io/library/nginx@sha256:16164a43b5faec40adb521e98272edc528e74f31c1352719132b8f7e53418d70"],"repoTags":["docker.io/library/nginx:alpine"],"size":"17945924"},{"id":"sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19
e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"9058936"},{"id":"sha256:821b3dfea27be94a3834878bec6f36d332c83250be3e3c2a2e2233575ebc9bac","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:dda6dba8a55203ed1595efcda865a526b9282c2d9b959e9ed0a88f54a7a91195"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.28.1"],"size":"33396106"},{"id":"sha256:da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"315399"},{"id":"sha256:07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"75788960"},{"id":"sha256:932f9f7ed151f47578924390ab1cc3eb9912ddd6d8b16346d41df684a55c9dcf","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-073118"],"size":"1005"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-073118 image ls --format json --alsologtostderr:
I0906 23:45:31.535820  618657 out.go:296] Setting OutFile to fd 1 ...
I0906 23:45:31.535934  618657 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.535973  618657 out.go:309] Setting ErrFile to fd 2...
I0906 23:45:31.535980  618657 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.536176  618657 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
I0906 23:45:31.536764  618657 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.536859  618657 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.537251  618657 cli_runner.go:164] Run: docker container inspect functional-073118 --format={{.State.Status}}
I0906 23:45:31.556933  618657 ssh_runner.go:195] Run: systemctl --version
I0906 23:45:31.556978  618657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-073118
I0906 23:45:31.575302  618657 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/functional-073118/id_rsa Username:docker}
I0906 23:45:31.668735  618657 ssh_runner.go:195] Run: sudo crictl images --output json
W0906 23:45:31.709915  618657 root.go:91] failed to log command end to audit: failed to find a log row with id equals to 28df2414-6c62-4090-8944-7632766e9463
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-073118 image ls --format yaml --alsologtostderr:
- id: sha256:b0b1fa0f58c6e932b7f20bf208b2841317a1e8c88cc51b18358310bbd8ec95da
repoDigests:
- docker.io/kindest/kindnetd@sha256:6c00e28db008c2afa67d9ee085c86184ec9ae5281d5ae1bd15006746fb9a1974
repoTags:
- docker.io/kindest/kindnetd:v20230511-dc714da8
size: "27731571"
- id: sha256:92034fe9a41f4344b97f3fc88a8796248e2cfa9b934be58379f3dbc150d07d9d
repoDigests:
- docker.io/library/mysql@sha256:2c23f254c6b9444ecda9ba36051a9800e8934a2f5828ecc8730531db8142af83
repoTags:
- docker.io/library/mysql:5.7
size: "170252563"
- id: sha256:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "2395207"
- id: sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "9058936"
- id: sha256:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9
repoDigests:
- registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3
repoTags:
- registry.k8s.io/etcd:3.5.9-0
size: "102894559"
- id: sha256:5c801295c21d0de2947ad600b9388f090f0f7ff22add9d9d95be82fa12288f77
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:f517207d13adeb50c63f9bdac2824e0e7512817eca47ac0540685771243742b2
repoTags:
- registry.k8s.io/kube-apiserver:v1.28.1
size: "34617463"
- id: sha256:115053965e86b2df4d78af78d7951b8644839d20a03820c6df59a261103315f7
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "19746404"
- id: sha256:ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-073118
size: "10823156"
- id: sha256:e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c
repoDigests:
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
repoTags:
- registry.k8s.io/pause:3.9
size: "321520"
- id: sha256:350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "72306"
- id: sha256:0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "297686"
- id: sha256:433dbc17191a7830a9db6454bcc23414ad36caecedab39d1e51d41083ab1d629
repoDigests:
- docker.io/library/nginx@sha256:16164a43b5faec40adb521e98272edc528e74f31c1352719132b8f7e53418d70
repoTags:
- docker.io/library/nginx:alpine
size: "17945924"
- id: sha256:6cdbabde3874e1eca92441870b0ddeaef0edb514c3b3e2a3d5ade845b500bba5
repoDigests:
- registry.k8s.io/kube-proxy@sha256:30096ad233e7bfe72662180c5ac4497f732346d6d25b7c1f1c0c7cb1a1e7e41c
repoTags:
- registry.k8s.io/kube-proxy:v1.28.1
size: "24555014"
- id: sha256:b462ce0c8b1ff16d466c6e8c9fcae54ec740fdeb73af6e637b77eea36246054a
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:3c9249a1f7623007a8db3522eac203f94cbb3910501879b792d95ea8470cc3d4
repoTags:
- registry.k8s.io/kube-scheduler:v1.28.1
size: "18802390"
- id: sha256:da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "315399"
- id: sha256:07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "75788960"
- id: sha256:932f9f7ed151f47578924390ab1cc3eb9912ddd6d8b16346d41df684a55c9dcf
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-073118
size: "1005"
- id: sha256:eea7b3dcba7ee47c0d16a60cc85d2b977d166be3960541991f3e6294d795ed24
repoDigests:
- docker.io/library/nginx@sha256:104c7c5c54f2685f0f46f3be607ce60da7085da3eaa5ad22d3d9f01594295e9c
repoTags:
- docker.io/library/nginx:latest
size: "70479485"
- id: sha256:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "16190758"
- id: sha256:82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410
repoDigests:
- registry.k8s.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969
repoTags:
- registry.k8s.io/echoserver:1.8
size: "46237695"
- id: sha256:821b3dfea27be94a3834878bec6f36d332c83250be3e3c2a2e2233575ebc9bac
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:dda6dba8a55203ed1595efcda865a526b9282c2d9b959e9ed0a88f54a7a91195
repoTags:
- registry.k8s.io/kube-controller-manager:v1.28.1
size: "33396106"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-073118 image ls --format yaml --alsologtostderr:
I0906 23:45:31.315851  618569 out.go:296] Setting OutFile to fd 1 ...
I0906 23:45:31.316037  618569 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.316051  618569 out.go:309] Setting ErrFile to fd 2...
I0906 23:45:31.316057  618569 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.316329  618569 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
I0906 23:45:31.317120  618569 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.317248  618569 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.317680  618569 cli_runner.go:164] Run: docker container inspect functional-073118 --format={{.State.Status}}
I0906 23:45:31.334865  618569 ssh_runner.go:195] Run: systemctl --version
I0906 23:45:31.334929  618569 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-073118
I0906 23:45:31.351904  618569 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/functional-073118/id_rsa Username:docker}
I0906 23:45:31.440468  618569 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (4.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-073118 ssh pgrep buildkitd: exit status 1 (235.404679ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image build -t localhost/my-image:functional-073118 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 image build -t localhost/my-image:functional-073118 testdata/build --alsologtostderr: (3.619500086s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-amd64 -p functional-073118 image build -t localhost/my-image:functional-073118 testdata/build --alsologtostderr:
I0906 23:45:31.988941  618851 out.go:296] Setting OutFile to fd 1 ...
I0906 23:45:31.989273  618851 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.989290  618851 out.go:309] Setting ErrFile to fd 2...
I0906 23:45:31.989296  618851 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0906 23:45:31.989668  618851 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
I0906 23:45:31.990271  618851 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.990779  618851 config.go:182] Loaded profile config "functional-073118": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
I0906 23:45:31.991131  618851 cli_runner.go:164] Run: docker container inspect functional-073118 --format={{.State.Status}}
I0906 23:45:32.008516  618851 ssh_runner.go:195] Run: systemctl --version
I0906 23:45:32.008571  618851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-073118
I0906 23:45:32.024027  618851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/functional-073118/id_rsa Username:docker}
I0906 23:45:32.112292  618851 build_images.go:151] Building image from path: /tmp/build.2284699526.tar
I0906 23:45:32.112350  618851 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0906 23:45:32.120849  618851 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.2284699526.tar
I0906 23:45:32.124003  618851 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.2284699526.tar: stat -c "%s %y" /var/lib/minikube/build/build.2284699526.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.2284699526.tar': No such file or directory
I0906 23:45:32.124043  618851 ssh_runner.go:362] scp /tmp/build.2284699526.tar --> /var/lib/minikube/build/build.2284699526.tar (3072 bytes)
I0906 23:45:32.145995  618851 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.2284699526
I0906 23:45:32.154482  618851 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.2284699526 -xf /var/lib/minikube/build/build.2284699526.tar
I0906 23:45:32.162702  618851 containerd.go:378] Building image: /var/lib/minikube/build/build.2284699526
I0906 23:45:32.162779  618851 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.2284699526 --local dockerfile=/var/lib/minikube/build/build.2284699526 --output type=image,name=localhost/my-image:functional-073118
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 1.2s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 0B / 772.79kB 0.2s
#5 sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 772.79kB / 772.79kB 0.7s done
#5 extracting sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 0.0s done
#5 DONE 0.8s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 1.0s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:cc5fac6c29e2da0f9eb0c8bc145d7191c14c26e5e09e6aef9e2dde2d39abae3a done
#8 exporting config sha256:57d6c373732fd31ef6882430327a3a9a4ac9bf426ac4b5b77610379e13179809 done
#8 naming to localhost/my-image:functional-073118 done
#8 DONE 0.1s
I0906 23:45:35.544302  618851 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.2284699526 --local dockerfile=/var/lib/minikube/build/build.2284699526 --output type=image,name=localhost/my-image:functional-073118: (3.381491054s)
I0906 23:45:35.544393  618851 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.2284699526
I0906 23:45:35.553623  618851 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.2284699526.tar
I0906 23:45:35.562420  618851 build_images.go:207] Built localhost/my-image:functional-073118 from /tmp/build.2284699526.tar
I0906 23:45:35.562457  618851 build_images.go:123] succeeded building to: functional-073118
I0906 23:45:35.562461  618851 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls
2023/09/06 23:45:39 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (4.05s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (1.963754018s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-073118
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.99s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (5.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image load --daemon gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 image load --daemon gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr: (5.472918411s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (5.70s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.89s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.89s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.93s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 service list -o json
functional_test.go:1493: Took "925.812085ms" to run "out/minikube-linux-amd64 -p functional-073118 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.93s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.79s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 service --namespace=default --https --url hello-node
E0906 23:45:10.042954  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
functional_test.go:1521: found endpoint: https://192.168.49.2:30560
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.79s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.62s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.62s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:30560
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.77s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (5.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image load --daemon gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 image load --daemon gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr: (5.504409202s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (5.73s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (7.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (2.131386782s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-073118
functional_test.go:244: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image load --daemon gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 image load --daemon gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr: (5.051978688s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (7.41s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image save gcr.io/google-containers/addon-resizer:functional-073118 /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar --alsologtostderr
functional_test.go:379: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 image save gcr.io/google-containers/addon-resizer:functional-073118 /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar --alsologtostderr: (1.722132061s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.72s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image rm gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.73s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (2.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image load /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar --alsologtostderr
functional_test.go:408: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 image load /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar --alsologtostderr: (2.173932209s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (2.41s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-073118
functional_test.go:423: (dbg) Run:  out/minikube-linux-amd64 -p functional-073118 image save --daemon gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr
functional_test.go:423: (dbg) Done: out/minikube-linux-amd64 -p functional-073118 image save --daemon gcr.io/google-containers/addon-resizer:functional-073118 --alsologtostderr: (1.1633793s)
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-073118
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1.20s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.07s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-073118
--- PASS: TestFunctional/delete_addon-resizer_images (0.07s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-073118
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-073118
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (80.85s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-amd64 start -p ingress-addon-legacy-311581 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
E0906 23:45:45.885465  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
E0906 23:46:26.846336  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-amd64 start -p ingress-addon-legacy-311581 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (1m20.853504616s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (80.85s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (9.31s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-311581 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-311581 addons enable ingress --alsologtostderr -v=5: (9.3148278s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (9.31s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.59s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-311581 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.59s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (41.15s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-311581 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:183: (dbg) Done: kubectl --context ingress-addon-legacy-311581 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (11.467778767s)
addons_test.go:208: (dbg) Run:  kubectl --context ingress-addon-legacy-311581 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context ingress-addon-legacy-311581 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [f02cfd63-f704-4fc0-94ea-b3b2c8daed92] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [f02cfd63-f704-4fc0-94ea-b3b2c8daed92] Running
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 11.010022064s
addons_test.go:238: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-311581 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context ingress-addon-legacy-311581 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-311581 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:282: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-311581 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-311581 addons disable ingress-dns --alsologtostderr -v=1: (10.194032925s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-311581 addons disable ingress --alsologtostderr -v=1
E0906 23:47:48.767261  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
addons_test.go:287: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-311581 addons disable ingress --alsologtostderr -v=1: (7.391737468s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddons (41.15s)

                                                
                                    
x
+
TestJSONOutput/start/Command (54.79s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-952840 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-952840 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (54.793348634s)
--- PASS: TestJSONOutput/start/Command (54.79s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.65s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 pause -p json-output-952840 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.65s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.58s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 unpause -p json-output-952840 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.58s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.76s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 stop -p json-output-952840 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-952840 --output=json --user=testUser: (5.761803562s)
--- PASS: TestJSONOutput/stop/Command (5.76s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.19s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-error-565290 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-565290 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (65.298309ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"560c7f8e-fb33-41e1-8afe-8742e5140686","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-565290] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"f5026e40-ffd4-4c31-95e2-56a6eddea590","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17174"}}
	{"specversion":"1.0","id":"8214a30f-75f3-417d-b67f-cab4f9ea781c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"621be5f5-830b-46be-a6c1-3ba8ddb0edc0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig"}}
	{"specversion":"1.0","id":"8a398981-9dda-433d-ada0-501e37f36387","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube"}}
	{"specversion":"1.0","id":"d6624a9d-d193-4163-853c-0ff796a6d365","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"c79c1ecc-5503-4188-82c0-5a9837a72593","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"151e0e27-61fe-4a5d-a564-c0dd0ac14182","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-565290" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p json-output-error-565290
--- PASS: TestErrorJSONOutput (0.19s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (40.91s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-911857 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-911857 --network=: (38.931817731s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-911857" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-911857
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-911857: (1.963440788s)
--- PASS: TestKicCustomNetwork/create_custom_network (40.91s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (24.45s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-288049 --network=bridge
E0906 23:49:50.207790  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:50.213049  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:50.223347  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:50.243628  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:50.283990  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:50.364346  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:50.524775  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:50.845136  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:51.486062  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:52.766557  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:49:55.327392  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:50:00.447630  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:50:04.922591  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-288049 --network=bridge: (22.562656917s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-288049" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-288049
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-288049: (1.867546425s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (24.45s)

                                                
                                    
x
+
TestKicExistingNetwork (23.47s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-amd64 start -p existing-network-398225 --network=existing-network
E0906 23:50:10.687992  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-398225 --network=existing-network: (21.433277772s)
helpers_test.go:175: Cleaning up "existing-network-398225" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p existing-network-398225
E0906 23:50:31.169078  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-398225: (1.912732686s)
--- PASS: TestKicExistingNetwork (23.47s)

                                                
                                    
x
+
TestKicCustomSubnet (26.48s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p custom-subnet-947770 --subnet=192.168.60.0/24
E0906 23:50:32.608360  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-subnet-947770 --subnet=192.168.60.0/24: (24.433476106s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-947770 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-947770" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p custom-subnet-947770
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p custom-subnet-947770: (2.031074474s)
--- PASS: TestKicCustomSubnet (26.48s)

                                                
                                    
x
+
TestKicStaticIP (25.3s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-amd64 start -p static-ip-260145 --static-ip=192.168.200.200
E0906 23:51:12.129372  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-amd64 start -p static-ip-260145 --static-ip=192.168.200.200: (23.134882182s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-amd64 -p static-ip-260145 ip
helpers_test.go:175: Cleaning up "static-ip-260145" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p static-ip-260145
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p static-ip-260145: (2.041116027s)
--- PASS: TestKicStaticIP (25.30s)

                                                
                                    
x
+
TestMainNoArgs (0.04s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.04s)

                                                
                                    
x
+
TestMinikubeProfile (49.8s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p first-798974 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p first-798974 --driver=docker  --container-runtime=containerd: (23.801116153s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p second-802048 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p second-802048 --driver=docker  --container-runtime=containerd: (21.098133451s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-amd64 profile first-798974
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-amd64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-amd64 profile second-802048
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-amd64 profile list -ojson
helpers_test.go:175: Cleaning up "second-802048" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p second-802048
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p second-802048: (1.827528494s)
helpers_test.go:175: Cleaning up "first-798974" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p first-798974
E0906 23:52:13.637643  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:52:13.642910  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:52:13.653092  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:52:13.673373  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:52:13.713755  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:52:13.794085  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:52:13.954458  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p first-798974: (2.101690658s)
--- PASS: TestMinikubeProfile (49.80s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (5.18s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-1-526471 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
E0906 23:52:14.275393  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:52:14.915767  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:52:16.196091  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-526471 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (4.176901977s)
E0906 23:52:18.757247  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
--- PASS: TestMountStart/serial/StartWithMountFirst (5.18s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.24s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-1-526471 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.24s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (8.76s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-552661 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
E0906 23:52:23.877966  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-552661 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (7.762487186s)
--- PASS: TestMountStart/serial/StartWithMountSecond (8.76s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.23s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-552661 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.23s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.6s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-amd64 delete -p mount-start-1-526471 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p mount-start-1-526471 --alsologtostderr -v=5: (1.596999092s)
--- PASS: TestMountStart/serial/DeleteFirst (1.60s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.24s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-552661 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.24s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.19s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-amd64 stop -p mount-start-2-552661
mount_start_test.go:155: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-552661: (1.186286301s)
--- PASS: TestMountStart/serial/Stop (1.19s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.12s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-552661
E0906 23:52:34.049781  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:52:34.119016  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
mount_start_test.go:166: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-552661: (6.122258484s)
--- PASS: TestMountStart/serial/RestartStopped (7.12s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.24s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-552661 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.24s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (84.02s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-591938 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0906 23:52:54.599651  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:53:35.560294  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-amd64 start -p multinode-591938 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m23.580833987s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (84.02s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (5.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-591938 -- rollout status deployment/busybox: (3.737173768s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-42pdn -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-l2cfm -- nslookup kubernetes.io
multinode_test.go:534: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-42pdn -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-l2cfm -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-42pdn -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-l2cfm -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (5.22s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.8s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-42pdn -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-42pdn -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-l2cfm -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-591938 -- exec busybox-5bc68d56bd-l2cfm -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.80s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (17.62s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-591938 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-591938 -v 3 --alsologtostderr: (17.037299247s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (17.62s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.26s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.26s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (8.94s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp testdata/cp-test.txt multinode-591938:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3668369067/001/cp-test_multinode-591938.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938:/home/docker/cp-test.txt multinode-591938-m02:/home/docker/cp-test_multinode-591938_multinode-591938-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m02 "sudo cat /home/docker/cp-test_multinode-591938_multinode-591938-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938:/home/docker/cp-test.txt multinode-591938-m03:/home/docker/cp-test_multinode-591938_multinode-591938-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m03 "sudo cat /home/docker/cp-test_multinode-591938_multinode-591938-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp testdata/cp-test.txt multinode-591938-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3668369067/001/cp-test_multinode-591938-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938-m02:/home/docker/cp-test.txt multinode-591938:/home/docker/cp-test_multinode-591938-m02_multinode-591938.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938 "sudo cat /home/docker/cp-test_multinode-591938-m02_multinode-591938.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938-m02:/home/docker/cp-test.txt multinode-591938-m03:/home/docker/cp-test_multinode-591938-m02_multinode-591938-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m03 "sudo cat /home/docker/cp-test_multinode-591938-m02_multinode-591938-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp testdata/cp-test.txt multinode-591938-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3668369067/001/cp-test_multinode-591938-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938-m03:/home/docker/cp-test.txt multinode-591938:/home/docker/cp-test_multinode-591938-m03_multinode-591938.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938 "sudo cat /home/docker/cp-test_multinode-591938-m03_multinode-591938.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 cp multinode-591938-m03:/home/docker/cp-test.txt multinode-591938-m02:/home/docker/cp-test_multinode-591938-m03_multinode-591938-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 ssh -n multinode-591938-m02 "sudo cat /home/docker/cp-test_multinode-591938-m03_multinode-591938-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (8.94s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-amd64 -p multinode-591938 node stop m03: (1.197603835s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-591938 status: exit status 7 (446.972322ms)

                                                
                                                
-- stdout --
	multinode-591938
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-591938-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-591938-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-591938 status --alsologtostderr: exit status 7 (451.50167ms)

                                                
                                                
-- stdout --
	multinode-591938
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-591938-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-591938-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0906 23:54:39.294216  676750 out.go:296] Setting OutFile to fd 1 ...
	I0906 23:54:39.294349  676750 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:54:39.294357  676750 out.go:309] Setting ErrFile to fd 2...
	I0906 23:54:39.294362  676750 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:54:39.294635  676750 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	I0906 23:54:39.294857  676750 out.go:303] Setting JSON to false
	I0906 23:54:39.294895  676750 mustload.go:65] Loading cluster: multinode-591938
	I0906 23:54:39.295041  676750 notify.go:220] Checking for updates...
	I0906 23:54:39.295339  676750 config.go:182] Loaded profile config "multinode-591938": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0906 23:54:39.295358  676750 status.go:255] checking status of multinode-591938 ...
	I0906 23:54:39.295792  676750 cli_runner.go:164] Run: docker container inspect multinode-591938 --format={{.State.Status}}
	I0906 23:54:39.313826  676750 status.go:330] multinode-591938 host status = "Running" (err=<nil>)
	I0906 23:54:39.313852  676750 host.go:66] Checking if "multinode-591938" exists ...
	I0906 23:54:39.314101  676750 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-591938
	I0906 23:54:39.330778  676750 host.go:66] Checking if "multinode-591938" exists ...
	I0906 23:54:39.331049  676750 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0906 23:54:39.331115  676750 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-591938
	I0906 23:54:39.346971  676750 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32852 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/multinode-591938/id_rsa Username:docker}
	I0906 23:54:39.437235  676750 ssh_runner.go:195] Run: systemctl --version
	I0906 23:54:39.441352  676750 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0906 23:54:39.451868  676750 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0906 23:54:39.506699  676750 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:57 SystemTime:2023-09-06 23:54:39.497130417 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0906 23:54:39.507400  676750 kubeconfig.go:92] found "multinode-591938" server: "https://192.168.58.2:8443"
	I0906 23:54:39.507429  676750 api_server.go:166] Checking apiserver status ...
	I0906 23:54:39.507474  676750 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0906 23:54:39.517927  676750 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1449/cgroup
	I0906 23:54:39.526301  676750 api_server.go:182] apiserver freezer: "4:freezer:/docker/eded27977fb59bd7a0e10c7985bbef46be4f73f57ac11f73c4ac4ea71df16e21/kubepods/burstable/podd24309a79c7d7c2f73547795c7cdd2bc/b4e0c9f29c7ffee11765b5c2c9598edec06735e8b92358c6dac0ff77880d5be0"
	I0906 23:54:39.526369  676750 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/eded27977fb59bd7a0e10c7985bbef46be4f73f57ac11f73c4ac4ea71df16e21/kubepods/burstable/podd24309a79c7d7c2f73547795c7cdd2bc/b4e0c9f29c7ffee11765b5c2c9598edec06735e8b92358c6dac0ff77880d5be0/freezer.state
	I0906 23:54:39.533792  676750 api_server.go:204] freezer state: "THAWED"
	I0906 23:54:39.533815  676750 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0906 23:54:39.539358  676750 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0906 23:54:39.539380  676750 status.go:421] multinode-591938 apiserver status = Running (err=<nil>)
	I0906 23:54:39.539390  676750 status.go:257] multinode-591938 status: &{Name:multinode-591938 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0906 23:54:39.539408  676750 status.go:255] checking status of multinode-591938-m02 ...
	I0906 23:54:39.539636  676750 cli_runner.go:164] Run: docker container inspect multinode-591938-m02 --format={{.State.Status}}
	I0906 23:54:39.556068  676750 status.go:330] multinode-591938-m02 host status = "Running" (err=<nil>)
	I0906 23:54:39.556098  676750 host.go:66] Checking if "multinode-591938-m02" exists ...
	I0906 23:54:39.556324  676750 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-591938-m02
	I0906 23:54:39.572364  676750 host.go:66] Checking if "multinode-591938-m02" exists ...
	I0906 23:54:39.572618  676750 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0906 23:54:39.572654  676750 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-591938-m02
	I0906 23:54:39.588807  676750 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32857 SSHKeyPath:/home/jenkins/minikube-integration/17174-571027/.minikube/machines/multinode-591938-m02/id_rsa Username:docker}
	I0906 23:54:39.676891  676750 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0906 23:54:39.686877  676750 status.go:257] multinode-591938-m02 status: &{Name:multinode-591938-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0906 23:54:39.686908  676750 status.go:255] checking status of multinode-591938-m03 ...
	I0906 23:54:39.687190  676750 cli_runner.go:164] Run: docker container inspect multinode-591938-m03 --format={{.State.Status}}
	I0906 23:54:39.703988  676750 status.go:330] multinode-591938-m03 host status = "Stopped" (err=<nil>)
	I0906 23:54:39.704010  676750 status.go:343] host is not running, skipping remaining checks
	I0906 23:54:39.704019  676750 status.go:257] multinode-591938-m03 status: &{Name:multinode-591938-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.10s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (10.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Done: out/minikube-linux-amd64 -p multinode-591938 node start m03 --alsologtostderr: (9.54585026s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (10.22s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (108.94s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-591938
multinode_test.go:290: (dbg) Run:  out/minikube-linux-amd64 stop -p multinode-591938
E0906 23:54:50.207585  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0906 23:54:57.481391  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:55:04.923189  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
multinode_test.go:290: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-591938: (24.932224685s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-591938 --wait=true -v=8 --alsologtostderr
E0906 23:55:17.891505  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-amd64 start -p multinode-591938 --wait=true -v=8 --alsologtostderr: (1m23.919806302s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-591938
--- PASS: TestMultiNode/serial/RestartKeepsNodes (108.94s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (4.67s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 node delete m03
multinode_test.go:394: (dbg) Done: out/minikube-linux-amd64 -p multinode-591938 node delete m03: (4.102022073s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (4.67s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (23.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 stop
multinode_test.go:314: (dbg) Done: out/minikube-linux-amd64 -p multinode-591938 stop: (23.632321632s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-591938 status: exit status 7 (79.861121ms)

                                                
                                                
-- stdout --
	multinode-591938
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-591938-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-591938 status --alsologtostderr: exit status 7 (77.854871ms)

                                                
                                                
-- stdout --
	multinode-591938
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-591938-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0906 23:57:07.284970  687404 out.go:296] Setting OutFile to fd 1 ...
	I0906 23:57:07.285116  687404 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:57:07.285125  687404 out.go:309] Setting ErrFile to fd 2...
	I0906 23:57:07.285129  687404 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0906 23:57:07.285324  687404 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	I0906 23:57:07.285476  687404 out.go:303] Setting JSON to false
	I0906 23:57:07.285511  687404 mustload.go:65] Loading cluster: multinode-591938
	I0906 23:57:07.285563  687404 notify.go:220] Checking for updates...
	I0906 23:57:07.285882  687404 config.go:182] Loaded profile config "multinode-591938": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0906 23:57:07.285897  687404 status.go:255] checking status of multinode-591938 ...
	I0906 23:57:07.286250  687404 cli_runner.go:164] Run: docker container inspect multinode-591938 --format={{.State.Status}}
	I0906 23:57:07.303506  687404 status.go:330] multinode-591938 host status = "Stopped" (err=<nil>)
	I0906 23:57:07.303528  687404 status.go:343] host is not running, skipping remaining checks
	I0906 23:57:07.303537  687404 status.go:257] multinode-591938 status: &{Name:multinode-591938 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0906 23:57:07.303572  687404 status.go:255] checking status of multinode-591938-m02 ...
	I0906 23:57:07.303843  687404 cli_runner.go:164] Run: docker container inspect multinode-591938-m02 --format={{.State.Status}}
	I0906 23:57:07.319668  687404 status.go:330] multinode-591938-m02 host status = "Stopped" (err=<nil>)
	I0906 23:57:07.319692  687404 status.go:343] host is not running, skipping remaining checks
	I0906 23:57:07.319702  687404 status.go:257] multinode-591938-m02 status: &{Name:multinode-591938-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (23.79s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (74.49s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-591938 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0906 23:57:13.637339  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0906 23:57:41.322086  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
multinode_test.go:354: (dbg) Done: out/minikube-linux-amd64 start -p multinode-591938 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m13.901406209s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-amd64 -p multinode-591938 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (74.49s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (26.56s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-591938
multinode_test.go:452: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-591938-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-591938-m02 --driver=docker  --container-runtime=containerd: exit status 14 (62.624388ms)

                                                
                                                
-- stdout --
	* [multinode-591938-m02] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=17174
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-591938-m02' is duplicated with machine name 'multinode-591938-m02' in profile 'multinode-591938'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-591938-m03 --driver=docker  --container-runtime=containerd
multinode_test.go:460: (dbg) Done: out/minikube-linux-amd64 start -p multinode-591938-m03 --driver=docker  --container-runtime=containerd: (24.34908531s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-591938
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-591938: exit status 80 (261.912444ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-591938
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-591938-m03 already exists in multinode-591938-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-amd64 delete -p multinode-591938-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-591938-m03: (1.844612792s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (26.56s)

                                                
                                    
x
+
TestPreload (186.46s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-149414 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4
E0906 23:59:50.208303  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0907 00:00:04.922274  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-149414 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4: (1m56.968226982s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-amd64 -p test-preload-149414 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-amd64 -p test-preload-149414 image pull gcr.io/k8s-minikube/busybox: (1.828292326s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-amd64 stop -p test-preload-149414
preload_test.go:58: (dbg) Done: out/minikube-linux-amd64 stop -p test-preload-149414: (11.845624037s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-149414 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd
E0907 00:01:27.969557  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-149414 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd: (53.382680342s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-amd64 -p test-preload-149414 image list
helpers_test.go:175: Cleaning up "test-preload-149414" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p test-preload-149414
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-149414: (2.224549001s)
--- PASS: TestPreload (186.46s)

                                                
                                    
x
+
TestScheduledStopUnix (99.72s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-amd64 start -p scheduled-stop-232596 --memory=2048 --driver=docker  --container-runtime=containerd
E0907 00:02:13.640484  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-232596 --memory=2048 --driver=docker  --container-runtime=containerd: (23.7040098s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-232596 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-232596 -n scheduled-stop-232596
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-232596 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-232596 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-232596 -n scheduled-stop-232596
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-232596
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-232596 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-232596
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-232596: exit status 7 (63.682136ms)

                                                
                                                
-- stdout --
	scheduled-stop-232596
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-232596 -n scheduled-stop-232596
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-232596 -n scheduled-stop-232596: exit status 7 (62.481516ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-232596" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p scheduled-stop-232596
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-232596: (4.727495321s)
--- PASS: TestScheduledStopUnix (99.72s)

                                                
                                    
x
+
TestInsufficientStorage (10.13s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-amd64 start -p insufficient-storage-106138 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-106138 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (7.763516751s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"72ed7388-7c1f-4de0-b4da-45d936ef3b2d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-106138] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"b72cc08b-e47f-440d-b6be-ca85800d24dc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17174"}}
	{"specversion":"1.0","id":"47017ff6-1056-447c-a461-0a13a8bdf820","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"ee95be4f-5831-4d37-8753-2a95fe76d83f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig"}}
	{"specversion":"1.0","id":"52fe4046-5cd3-4770-8d04-0705a8b90701","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube"}}
	{"specversion":"1.0","id":"8ed37135-ca45-4d6a-8a5b-047b0f8c6f61","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"07eb2fb8-8fd4-4dbd-9705-975ec79678d7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"e0a25135-9314-47a5-b3a3-813fce707b58","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"6a99d928-8d9f-4bac-9de4-33c67323fe21","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"2d601dab-0f9c-4796-b219-f0e638a99c9e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"acd9ba37-3a6f-46dd-8baf-8a9157967e8c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"a37d205c-d9b7-4dcf-b7cd-60991895edc3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-106138 in cluster insufficient-storage-106138","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"93c070e4-d941-4395-afa4-d67eeb440652","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"1968c093-aa93-451a-8022-a7182739c2e9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"fe3c8189-8b55-43bf-a288-f4f574b07cfc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-106138 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-106138 --output=json --layout=cluster: exit status 7 (259.928904ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-106138","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.31.2","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-106138","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0907 00:03:46.434508  709388 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-106138" does not appear in /home/jenkins/minikube-integration/17174-571027/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-106138 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-106138 --output=json --layout=cluster: exit status 7 (265.491256ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-106138","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.31.2","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-106138","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0907 00:03:46.701065  709478 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-106138" does not appear in /home/jenkins/minikube-integration/17174-571027/kubeconfig
	E0907 00:03:46.711591  709478 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/insufficient-storage-106138/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-106138" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p insufficient-storage-106138
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-106138: (1.836008048s)
--- PASS: TestInsufficientStorage (10.13s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (99.32s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.22.0.3552016145.exe start -p running-upgrade-792285 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E0907 00:05:04.922655  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
version_upgrade_test.go:132: (dbg) Done: /tmp/minikube-v1.22.0.3552016145.exe start -p running-upgrade-792285 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m11.840395321s)
version_upgrade_test.go:142: (dbg) Run:  out/minikube-linux-amd64 start -p running-upgrade-792285 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0907 00:06:13.252271  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
version_upgrade_test.go:142: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-792285 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (22.894795461s)
helpers_test.go:175: Cleaning up "running-upgrade-792285" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p running-upgrade-792285
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-792285: (2.375661009s)
--- PASS: TestRunningBinaryUpgrade (99.32s)

                                                
                                    
x
+
TestKubernetesUpgrade (360.48s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-500801 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0907 00:04:50.206843  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-500801 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (54.167139183s)
version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-amd64 stop -p kubernetes-upgrade-500801
version_upgrade_test.go:239: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-500801: (1.316710651s)
version_upgrade_test.go:244: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-500801 status --format={{.Host}}
version_upgrade_test.go:244: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-500801 status --format={{.Host}}: exit status 7 (63.475266ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:246: status error: exit status 7 (may be ok)
version_upgrade_test.go:255: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-500801 --memory=2200 --kubernetes-version=v1.28.1 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:255: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-500801 --memory=2200 --kubernetes-version=v1.28.1 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (4m39.332415579s)
version_upgrade_test.go:260: (dbg) Run:  kubectl --context kubernetes-upgrade-500801 version --output=json
version_upgrade_test.go:279: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:281: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-500801 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:281: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-500801 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=containerd: exit status 106 (91.981141ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-500801] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=17174
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.28.1 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-500801
	    minikube start -p kubernetes-upgrade-500801 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-5008012 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.28.1, by running:
	    
	    minikube start -p kubernetes-upgrade-500801 --kubernetes-version=v1.28.1
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:285: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:287: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-500801 --memory=2200 --kubernetes-version=v1.28.1 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:287: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-500801 --memory=2200 --kubernetes-version=v1.28.1 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (21.400504487s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-500801" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubernetes-upgrade-500801
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-500801: (4.035082318s)
--- PASS: TestKubernetesUpgrade (360.48s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (2.57s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (2.57s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.07s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-312585 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-312585 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (72.793786ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-312585] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=17174
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.07s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (28.27s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-312585 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-312585 --driver=docker  --container-runtime=containerd: (27.890550551s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-amd64 -p NoKubernetes-312585 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (28.27s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (164.16s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:195: (dbg) Run:  /tmp/minikube-v1.22.0.80742109.exe start -p stopped-upgrade-320564 --memory=2200 --vm-driver=docker  --container-runtime=containerd
version_upgrade_test.go:195: (dbg) Done: /tmp/minikube-v1.22.0.80742109.exe start -p stopped-upgrade-320564 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m46.617607417s)
version_upgrade_test.go:204: (dbg) Run:  /tmp/minikube-v1.22.0.80742109.exe -p stopped-upgrade-320564 stop
version_upgrade_test.go:204: (dbg) Done: /tmp/minikube-v1.22.0.80742109.exe -p stopped-upgrade-320564 stop: (23.85120017s)
version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-amd64 start -p stopped-upgrade-320564 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:210: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-320564 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (33.687883065s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (164.16s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (20.36s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-312585 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-312585 --no-kubernetes --driver=docker  --container-runtime=containerd: (18.100572936s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-amd64 -p NoKubernetes-312585 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-amd64 -p NoKubernetes-312585 status -o json: exit status 2 (319.842197ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-312585","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-amd64 delete -p NoKubernetes-312585
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-amd64 delete -p NoKubernetes-312585: (1.93743956s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (20.36s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.22s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-312585 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-312585 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.224561883s)
--- PASS: TestNoKubernetes/serial/Start (5.22s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-312585 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-312585 "sudo systemctl is-active --quiet service kubelet": exit status 1 (332.73289ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.32s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-amd64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-amd64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.32s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (2.46s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-amd64 stop -p NoKubernetes-312585
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-312585: (2.461055757s)
--- PASS: TestNoKubernetes/serial/Stop (2.46s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.97s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-312585 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-312585 --driver=docker  --container-runtime=containerd: (7.974573699s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.97s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.28s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-312585 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-312585 "sudo systemctl is-active --quiet service kubelet": exit status 1 (275.342033ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.28s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.94s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:218: (dbg) Run:  out/minikube-linux-amd64 logs -p stopped-upgrade-320564
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (0.94s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (3.09s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-amd64 start -p false-972540 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-972540 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (159.772587ms)

                                                
                                                
-- stdout --
	* [false-972540] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=17174
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0907 00:06:44.142036  743335 out.go:296] Setting OutFile to fd 1 ...
	I0907 00:06:44.142180  743335 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0907 00:06:44.142191  743335 out.go:309] Setting ErrFile to fd 2...
	I0907 00:06:44.142197  743335 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0907 00:06:44.142528  743335 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17174-571027/.minikube/bin
	I0907 00:06:44.143350  743335 out.go:303] Setting JSON to false
	I0907 00:06:44.145973  743335 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":20677,"bootTime":1694024527,"procs":971,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0907 00:06:44.146067  743335 start.go:138] virtualization: kvm guest
	I0907 00:06:44.148868  743335 out.go:177] * [false-972540] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
	I0907 00:06:44.150572  743335 notify.go:220] Checking for updates...
	I0907 00:06:44.150583  743335 out.go:177]   - MINIKUBE_LOCATION=17174
	I0907 00:06:44.152182  743335 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0907 00:06:44.153554  743335 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17174-571027/kubeconfig
	I0907 00:06:44.155193  743335 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17174-571027/.minikube
	I0907 00:06:44.156714  743335 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0907 00:06:44.158071  743335 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0907 00:06:44.160100  743335 config.go:182] Loaded profile config "force-systemd-env-717311": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0907 00:06:44.160241  743335 config.go:182] Loaded profile config "kubernetes-upgrade-500801": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.1
	I0907 00:06:44.160383  743335 config.go:182] Loaded profile config "missing-upgrade-599530": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0907 00:06:44.160515  743335 driver.go:373] Setting default libvirt URI to qemu:///system
	I0907 00:06:44.185208  743335 docker.go:121] docker version: linux-24.0.6:Docker Engine - Community
	I0907 00:06:44.185285  743335 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0907 00:06:44.245871  743335 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:53 OomKillDisable:true NGoroutines:67 SystemTime:2023-09-07 00:06:44.235759634 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33648066560 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-6 Labels:[] ExperimentalBuild:false ServerVersion:24.0.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8165feabfdfe38c65b599c4993d227328c231fca Expected:8165feabfdfe38c65b599c4993d227328c231fca} RuncCommit:{ID:v1.1.8-0-g82f18fe Expected:v1.1.8-0-g82f18fe} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>
ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0907 00:06:44.245980  743335 docker.go:294] overlay module found
	I0907 00:06:44.248055  743335 out.go:177] * Using the docker driver based on user configuration
	I0907 00:06:44.249512  743335 start.go:298] selected driver: docker
	I0907 00:06:44.249527  743335 start.go:902] validating driver "docker" against <nil>
	I0907 00:06:44.249543  743335 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0907 00:06:44.251865  743335 out.go:177] 
	W0907 00:06:44.253448  743335 out.go:239] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0907 00:06:44.255018  743335 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-972540 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-972540" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:52 UTC
provider: minikube.sigs.k8s.io
version: v1.31.2
name: cluster_info
server: https://192.168.67.2:8443
name: kubernetes-upgrade-500801
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:31 UTC
provider: minikube.sigs.k8s.io
version: v1.22.0
name: cluster_info
server: https://192.168.85.2:8443
name: missing-upgrade-599530
contexts:
- context:
cluster: kubernetes-upgrade-500801
user: kubernetes-upgrade-500801
name: kubernetes-upgrade-500801
- context:
cluster: missing-upgrade-599530
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:31 UTC
provider: minikube.sigs.k8s.io
version: v1.22.0
name: context_info
namespace: default
user: missing-upgrade-599530
name: missing-upgrade-599530
current-context: ""
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-500801
user:
client-certificate: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/kubernetes-upgrade-500801/client.crt
client-key: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/kubernetes-upgrade-500801/client.key
- name: missing-upgrade-599530
user:
client-certificate: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/missing-upgrade-599530/client.crt
client-key: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/missing-upgrade-599530/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-972540

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-972540"

                                                
                                                
----------------------- debugLogs end: false-972540 [took: 2.783075929s] --------------------------------
helpers_test.go:175: Cleaning up "false-972540" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p false-972540
--- PASS: TestNetworkPlugins/group/false (3.09s)

                                                
                                    
x
+
TestPause/serial/Start (52.57s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-amd64 start -p pause-503877 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd
pause_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p pause-503877 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (52.572449812s)
--- PASS: TestPause/serial/Start (52.57s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (138.96s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-505314 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-505314 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: (2m18.956795178s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (138.96s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (5.61s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-amd64 start -p pause-503877 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-amd64 start -p pause-503877 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (5.603848738s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (5.61s)

                                                
                                    
x
+
TestPause/serial/Pause (0.69s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-503877 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.69s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.28s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p pause-503877 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-503877 --output=json --layout=cluster: exit status 2 (284.265574ms)

                                                
                                                
-- stdout --
	{"Name":"pause-503877","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.31.2","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-503877","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.28s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.63s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-amd64 unpause -p pause-503877 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.63s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (0.74s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-503877 --alsologtostderr -v=5
--- PASS: TestPause/serial/PauseAgain (0.74s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.53s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-amd64 delete -p pause-503877 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p pause-503877 --alsologtostderr -v=5: (2.533157676s)
--- PASS: TestPause/serial/DeletePaused (2.53s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.62s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-503877
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-503877: exit status 1 (16.721272ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-503877: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.62s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (107.32s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-535301 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1
E0907 00:08:36.682758  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
E0907 00:09:50.206975  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0907 00:10:04.922244  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-535301 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1: (1m47.315380377s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (107.32s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.4s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-505314 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [6cc169ca-33ce-473a-9e0d-0b48d86f6b64] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [6cc169ca-33ce-473a-9e0d-0b48d86f6b64] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.016769622s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-505314 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.40s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.91s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-505314 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-505314 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.91s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (9.51s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-535301 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [d6eca586-5dcf-47d7-82cb-e0033dc28b48] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [d6eca586-5dcf-47d7-82cb-e0033dc28b48] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.019844026s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-535301 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.51s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12.67s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p old-k8s-version-505314 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-505314 --alsologtostderr -v=3: (12.665771185s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.67s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (54.47s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-693991 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-693991 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1: (54.467566415s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (54.47s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.93s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p no-preload-535301 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-535301 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.93s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (16.2s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p no-preload-535301 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-535301 --alsologtostderr -v=3: (16.199415361s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (16.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-505314 -n old-k8s-version-505314
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-505314 -n old-k8s-version-505314: exit status 7 (92.953897ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-505314 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (67.89s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-505314 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-505314 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: (1m7.585822783s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-505314 -n old-k8s-version-505314
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (67.89s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-535301 -n no-preload-535301
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-535301 -n no-preload-535301: exit status 7 (106.758645ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p no-preload-535301 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (335.15s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-535301 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-535301 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1: (5m34.832968628s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-535301 -n no-preload-535301
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (335.15s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (52.9s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-diff-port-444440 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-444440 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1: (52.902477634s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (52.90s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (10.38s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-693991 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [e6203411-3db9-411a-9c7e-cd21d080dbf2] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [e6203411-3db9-411a-9c7e-cd21d080dbf2] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 10.016252118s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-693991 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (10.38s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.95s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-693991 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-693991 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.95s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (11.98s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p embed-certs-693991 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-693991 --alsologtostderr -v=3: (11.97488829s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (11.98s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.34s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-444440 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [00ccb1a0-3519-46f0-9ed0-23315cf35bcf] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [00ccb1a0-3519-46f0-9ed0-23315cf35bcf] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 10.015509715s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-444440 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.34s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.02s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-nkhj6" [7d19fea1-b71b-44d3-af2c-dbffda45b90d] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.015627399s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.02s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.16s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-693991 -n embed-certs-693991
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-693991 -n embed-certs-693991: exit status 7 (63.119347ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p embed-certs-693991 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.16s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (332.79s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-693991 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-693991 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1: (5m32.443439397s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-693991 -n embed-certs-693991
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (332.79s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.09s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-nkhj6" [7d19fea1-b71b-44d3-af2c-dbffda45b90d] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.008756247s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-505314 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.09s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.99s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-444440 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-444440 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.99s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 ssh -p old-k8s-version-505314 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.31s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (2.8s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p old-k8s-version-505314 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-505314 -n old-k8s-version-505314
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-505314 -n old-k8s-version-505314: exit status 2 (281.336875ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-505314 -n old-k8s-version-505314
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-505314 -n old-k8s-version-505314: exit status 2 (315.929456ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p old-k8s-version-505314 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-505314 -n old-k8s-version-505314
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-505314 -n old-k8s-version-505314
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (2.80s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p default-k8s-diff-port-444440 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-diff-port-444440 --alsologtostderr -v=3: (12.014553917s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.01s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (34.38s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-206135 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-206135 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1: (34.383888749s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (34.38s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440: exit status 7 (79.17505ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-444440 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (331.95s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-diff-port-444440 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1
E0907 00:12:13.637705  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/ingress-addon-legacy-311581/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-444440 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1: (5m31.614561009s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (331.95s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.99s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-206135 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.99s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.2s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p newest-cni-206135 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-206135 --alsologtostderr -v=3: (1.201181013s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.20s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.16s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-206135 -n newest-cni-206135
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-206135 -n newest-cni-206135: exit status 7 (63.398276ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p newest-cni-206135 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.16s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (24.96s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-206135 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-206135 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.28.1: (24.666786765s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-206135 -n newest-cni-206135
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (24.96s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 ssh -p newest-cni-206135 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.29s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (2.58s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p newest-cni-206135 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-206135 -n newest-cni-206135
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-206135 -n newest-cni-206135: exit status 2 (294.886142ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-206135 -n newest-cni-206135
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-206135 -n newest-cni-206135: exit status 2 (283.347667ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p newest-cni-206135 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-206135 -n newest-cni-206135
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-206135 -n newest-cni-206135
--- PASS: TestStartStop/group/newest-cni/serial/Pause (2.58s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (51.86s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p auto-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p auto-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd: (51.862215864s)
--- PASS: TestNetworkPlugins/group/auto/Start (51.86s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p auto-972540 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (8.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-972540 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-zsl64" [8062ec9d-6c35-4f87-8e08-78dbd56fefc6] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-zsl64" [8062ec9d-6c35-4f87-8e08-78dbd56fefc6] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 8.009000053s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (8.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-972540 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (52.53s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p kindnet-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd
E0907 00:14:50.207833  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/functional-073118/client.crt: no such file or directory
E0907 00:15:04.922989  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
E0907 00:15:11.220168  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:11.225482  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:11.235765  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:11.256066  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:11.296400  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:11.376749  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:11.537231  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:11.858196  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:12.498643  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
E0907 00:15:13.778995  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd: (52.53030043s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (52.53s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-25jm9" [0d09e5fd-58a7-4dc3-838a-d62a56f68159] Running
E0907 00:15:16.340071  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.018059649s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p kindnet-972540 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (8.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-972540 replace --force -f testdata/netcat-deployment.yaml
E0907 00:15:21.460999  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-zwrz8" [674ef065-a5f9-4fd2-8403-32e15d476d38] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-zwrz8" [674ef065-a5f9-4fd2-8403-32e15d476d38] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 8.009398379s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (8.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-972540 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (67.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p calico-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd
E0907 00:15:52.182816  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p calico-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd: (1m7.396116354s)
--- PASS: TestNetworkPlugins/group/calico/Start (67.40s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (11.02s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-ps7nk" [f6476c07-55ca-46df-b202-42a59fee11d0] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-ps7nk" [f6476c07-55ca-46df-b202-42a59fee11d0] Running
E0907 00:16:33.143098  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/old-k8s-version-505314/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 11.018295706s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (11.02s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.09s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-ps7nk" [f6476c07-55ca-46df-b202-42a59fee11d0] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.010286445s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-535301 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.09s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 ssh -p no-preload-535301 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.31s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (2.75s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p no-preload-535301 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-535301 -n no-preload-535301
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-535301 -n no-preload-535301: exit status 2 (289.448631ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-535301 -n no-preload-535301
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-535301 -n no-preload-535301: exit status 2 (323.127617ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p no-preload-535301 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-535301 -n no-preload-535301
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-535301 -n no-preload-535301
--- PASS: TestStartStop/group/no-preload/serial/Pause (2.75s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (53.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p custom-flannel-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-flannel-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd: (53.461843826s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (53.46s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-rffv9" [da7463f4-1951-49d7-843a-30899b0d808d] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.020526575s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p calico-972540 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (9.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-972540 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-qq94c" [122188d6-ce60-4ace-a278-02f3c28fdd48] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-qq94c" [122188d6-ce60-4ace-a278-02f3c28fdd48] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 9.009323065s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (9.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-972540 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.14s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (11.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-5klmk" [ae18163b-00d4-4e62-b796-26ca4df9055d] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-5klmk" [ae18163b-00d4-4e62-b796-26ca4df9055d] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 11.02867918s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (11.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-5klmk" [ae18163b-00d4-4e62-b796-26ca4df9055d] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.010068045s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-693991 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (45.47s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p enable-default-cni-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (45.466566484s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (45.47s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.34s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 ssh -p embed-certs-693991 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.34s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p embed-certs-693991 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-693991 -n embed-certs-693991
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-693991 -n embed-certs-693991: exit status 2 (313.98102ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-693991 -n embed-certs-693991
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-693991 -n embed-certs-693991: exit status 2 (308.219337ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p embed-certs-693991 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-693991 -n embed-certs-693991
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-693991 -n embed-certs-693991
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (10.02s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-7tmqm" [ed0e9fe6-3d45-4473-8ec7-b5c8e57d8e4d] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-7tmqm" [ed0e9fe6-3d45-4473-8ec7-b5c8e57d8e4d] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 10.019250392s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (10.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p custom-flannel-972540 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (10.79s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-972540 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-n7h8x" [24e85b89-f6cd-4bbc-b49e-3b772adc3e23] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-n7h8x" [24e85b89-f6cd-4bbc-b49e-3b772adc3e23] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 10.010110392s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (10.79s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (52.62s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p flannel-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p flannel-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd: (52.618637315s)
--- PASS: TestNetworkPlugins/group/flannel/Start (52.62s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.08s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-7tmqm" [ed0e9fe6-3d45-4473-8ec7-b5c8e57d8e4d] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.009012652s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-444440 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.08s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-972540 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.14s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 ssh -p default-k8s-diff-port-444440 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.31s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (2.85s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p default-k8s-diff-port-444440 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440: exit status 2 (330.403262ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440: exit status 2 (299.18281ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p default-k8s-diff-port-444440 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-444440 -n default-k8s-diff-port-444440
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (2.85s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (38.09s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p bridge-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd
E0907 00:18:07.970244  577782 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/addons-626363/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p bridge-972540 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd: (38.085132424s)
--- PASS: TestNetworkPlugins/group/bridge/Start (38.09s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p enable-default-cni-972540 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-972540 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-dsxtv" [9cd1838f-27d8-4bfa-975e-fa5f2d134a67] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-dsxtv" [9cd1838f-27d8-4bfa-975e-fa5f2d134a67] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 10.013019881s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-972540 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-mpcql" [b134113f-4f5b-404b-b4da-bca68d04f42d] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.016966779s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.02s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p bridge-972540 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (8.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-972540 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-bgwvl" [06fd89c4-79e5-4d0f-aa64-fb853f4dc6a2] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-bgwvl" [06fd89c4-79e5-4d0f-aa64-fb853f4dc6a2] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 8.009704916s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (8.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p flannel-972540 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (9.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-972540 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-8xvxl" [7d716a5a-20b2-4aff-b141-8cd5ac42e38d] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-8xvxl" [7d716a5a-20b2-4aff-b141-8cd5ac42e38d] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.009461652s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-972540 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-972540 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-972540 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.13s)

                                                
                                    

Test skip (23/304)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.1/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.1/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.1/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.1/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.1/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.1/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.1/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.1/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.1/kubectl (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:474: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:459: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-145224" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p disable-driver-mounts-145224
--- SKIP: TestStartStop/group/disable-driver-mounts (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (2.99s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:522: 
----------------------- debugLogs start: kubenet-972540 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-972540" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:52 UTC
provider: minikube.sigs.k8s.io
version: v1.31.2
name: cluster_info
server: https://192.168.67.2:8443
name: kubernetes-upgrade-500801
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:31 UTC
provider: minikube.sigs.k8s.io
version: v1.22.0
name: cluster_info
server: https://192.168.85.2:8443
name: missing-upgrade-599530
contexts:
- context:
cluster: kubernetes-upgrade-500801
user: kubernetes-upgrade-500801
name: kubernetes-upgrade-500801
- context:
cluster: missing-upgrade-599530
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:31 UTC
provider: minikube.sigs.k8s.io
version: v1.22.0
name: context_info
namespace: default
user: missing-upgrade-599530
name: missing-upgrade-599530
current-context: ""
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-500801
user:
client-certificate: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/kubernetes-upgrade-500801/client.crt
client-key: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/kubernetes-upgrade-500801/client.key
- name: missing-upgrade-599530
user:
client-certificate: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/missing-upgrade-599530/client.crt
client-key: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/missing-upgrade-599530/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-972540

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-972540"

                                                
                                                
----------------------- debugLogs end: kubenet-972540 [took: 2.848797706s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-972540" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubenet-972540
--- SKIP: TestNetworkPlugins/group/kubenet (2.99s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (3.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:522: 
----------------------- debugLogs start: cilium-972540 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-972540" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:52 UTC
provider: minikube.sigs.k8s.io
version: v1.31.2
name: cluster_info
server: https://192.168.67.2:8443
name: kubernetes-upgrade-500801
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17174-571027/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:31 UTC
provider: minikube.sigs.k8s.io
version: v1.22.0
name: cluster_info
server: https://192.168.85.2:8443
name: missing-upgrade-599530
contexts:
- context:
cluster: kubernetes-upgrade-500801
user: kubernetes-upgrade-500801
name: kubernetes-upgrade-500801
- context:
cluster: missing-upgrade-599530
extensions:
- extension:
last-update: Thu, 07 Sep 2023 00:05:31 UTC
provider: minikube.sigs.k8s.io
version: v1.22.0
name: context_info
namespace: default
user: missing-upgrade-599530
name: missing-upgrade-599530
current-context: ""
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-500801
user:
client-certificate: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/kubernetes-upgrade-500801/client.crt
client-key: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/kubernetes-upgrade-500801/client.key
- name: missing-upgrade-599530
user:
client-certificate: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/missing-upgrade-599530/client.crt
client-key: /home/jenkins/minikube-integration/17174-571027/.minikube/profiles/missing-upgrade-599530/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-972540

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-972540" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-972540"

                                                
                                                
----------------------- debugLogs end: cilium-972540 [took: 3.131022508s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-972540" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cilium-972540
--- SKIP: TestNetworkPlugins/group/cilium (3.30s)

                                                
                                    
Copied to clipboard