Test Report: Docker_Linux_docker_arm64 15585

                    
                      431a2968588dcb34d31f7f4fc0380544d7f85afa:2023-07-20:30225
                    
                

Test fail (3/319)

Order failed test Duration
25 TestAddons/parallel/Ingress 37.87
162 TestIngressAddonLegacy/serial/ValidateIngressAddons 57.23
233 TestRunningBinaryUpgrade 296.61
x
+
TestAddons/parallel/Ingress (37.87s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:183: (dbg) Run:  kubectl --context addons-634197 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:208: (dbg) Run:  kubectl --context addons-634197 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context addons-634197 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [b5f00d44-0261-406c-a0e7-0f74a1fc197b] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [b5f00d44-0261-406c-a0e7-0f74a1fc197b] Running
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.007885941s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context addons-634197 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.052986465s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p addons-634197 addons disable ingress-dns --alsologtostderr -v=1: (1.269895399s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p addons-634197 addons disable ingress --alsologtostderr -v=1: (7.751388028s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-634197
helpers_test.go:235: (dbg) docker inspect addons-634197:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "7d9ee4b34f27f7ac13563edcac0c43b6f022c99998b1aa133ff0381800fc8fd5",
	        "Created": "2023-07-19T23:49:31.132467524Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 481465,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-19T23:49:31.45963422Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:f52519afe5f6d6f3ce84cbd7f651b1292638d32ca98ee43d88f2d69e113e44de",
	        "ResolvConfPath": "/var/lib/docker/containers/7d9ee4b34f27f7ac13563edcac0c43b6f022c99998b1aa133ff0381800fc8fd5/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/7d9ee4b34f27f7ac13563edcac0c43b6f022c99998b1aa133ff0381800fc8fd5/hostname",
	        "HostsPath": "/var/lib/docker/containers/7d9ee4b34f27f7ac13563edcac0c43b6f022c99998b1aa133ff0381800fc8fd5/hosts",
	        "LogPath": "/var/lib/docker/containers/7d9ee4b34f27f7ac13563edcac0c43b6f022c99998b1aa133ff0381800fc8fd5/7d9ee4b34f27f7ac13563edcac0c43b6f022c99998b1aa133ff0381800fc8fd5-json.log",
	        "Name": "/addons-634197",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-634197:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-634197",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/ccb7bb256d24fd210be9aba4976494cf59f04128482886412e97f785526768bd-init/diff:/var/lib/docker/overlay2/91062a1696abf51e43ba788b12e4bc3e8b35395a23d1306c55e792c6df8f8ca8/diff",
	                "MergedDir": "/var/lib/docker/overlay2/ccb7bb256d24fd210be9aba4976494cf59f04128482886412e97f785526768bd/merged",
	                "UpperDir": "/var/lib/docker/overlay2/ccb7bb256d24fd210be9aba4976494cf59f04128482886412e97f785526768bd/diff",
	                "WorkDir": "/var/lib/docker/overlay2/ccb7bb256d24fd210be9aba4976494cf59f04128482886412e97f785526768bd/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-634197",
	                "Source": "/var/lib/docker/volumes/addons-634197/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-634197",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-634197",
	                "name.minikube.sigs.k8s.io": "addons-634197",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "6bff507746aefd8e8c6fb1e7825f94c7a5847d5cb836bb27560d74a65ab4577e",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33376"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33375"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33372"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33374"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33373"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/6bff507746ae",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-634197": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "7d9ee4b34f27",
	                        "addons-634197"
	                    ],
	                    "NetworkID": "67e0e315d1c800c5cbd9aef20315a7fbf953f08beee935e6ddff039a0ff34ccc",
	                    "EndpointID": "f6a4916d6d3d8025ac700b1053b60f239110668e1114f8ccbb9a25a404cafccb",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-634197 -n addons-634197
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-634197 logs -n 25: (1.142062477s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-705089   | jenkins | v1.31.0 | 19 Jul 23 23:48 UTC |                     |
	|         | -p download-only-705089        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0   |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| start   | -o=json --download-only        | download-only-705089   | jenkins | v1.31.0 | 19 Jul 23 23:48 UTC |                     |
	|         | -p download-only-705089        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.27.3   |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | --all                          | minikube               | jenkins | v1.31.0 | 19 Jul 23 23:49 UTC | 19 Jul 23 23:49 UTC |
	| delete  | -p download-only-705089        | download-only-705089   | jenkins | v1.31.0 | 19 Jul 23 23:49 UTC | 19 Jul 23 23:49 UTC |
	| delete  | -p download-only-705089        | download-only-705089   | jenkins | v1.31.0 | 19 Jul 23 23:49 UTC | 19 Jul 23 23:49 UTC |
	| start   | --download-only -p             | download-docker-591100 | jenkins | v1.31.0 | 19 Jul 23 23:49 UTC |                     |
	|         | download-docker-591100         |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | -p download-docker-591100      | download-docker-591100 | jenkins | v1.31.0 | 19 Jul 23 23:49 UTC | 19 Jul 23 23:49 UTC |
	| start   | --download-only -p             | binary-mirror-800167   | jenkins | v1.31.0 | 19 Jul 23 23:49 UTC |                     |
	|         | binary-mirror-800167           |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --binary-mirror                |                        |         |         |                     |                     |
	|         | http://127.0.0.1:46523         |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-800167        | binary-mirror-800167   | jenkins | v1.31.0 | 19 Jul 23 23:49 UTC | 19 Jul 23 23:49 UTC |
	| start   | -p addons-634197               | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:49 UTC | 19 Jul 23 23:52 UTC |
	|         | --wait=true --memory=4000      |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --addons=registry              |                        |         |         |                     |                     |
	|         | --addons=metrics-server        |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots       |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver   |                        |         |         |                     |                     |
	|         | --addons=gcp-auth              |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner         |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget      |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --addons=ingress               |                        |         |         |                     |                     |
	|         | --addons=ingress-dns           |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p       | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:52 UTC |
	|         | addons-634197                  |                        |         |         |                     |                     |
	| addons  | enable headlamp                | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:52 UTC |
	|         | -p addons-634197               |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| ip      | addons-634197 ip               | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:52 UTC |
	| addons  | addons-634197 addons disable   | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:52 UTC |
	|         | registry --alsologtostderr     |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p    | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:52 UTC |
	|         | addons-634197                  |                        |         |         |                     |                     |
	| addons  | addons-634197 addons           | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:52 UTC |
	|         | disable metrics-server         |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| ssh     | addons-634197 ssh curl -s      | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:52 UTC |
	|         | http://127.0.0.1/ -H 'Host:    |                        |         |         |                     |                     |
	|         | nginx.example.com'             |                        |         |         |                     |                     |
	| ip      | addons-634197 ip               | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:52 UTC |
	| addons  | addons-634197 addons           | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:52 UTC | 19 Jul 23 23:53 UTC |
	|         | disable csi-hostpath-driver    |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| addons  | addons-634197 addons           | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:53 UTC | 19 Jul 23 23:53 UTC |
	|         | disable volumesnapshots        |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| addons  | addons-634197 addons disable   | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:53 UTC | 19 Jul 23 23:53 UTC |
	|         | ingress-dns --alsologtostderr  |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | addons-634197 addons disable   | addons-634197          | jenkins | v1.31.0 | 19 Jul 23 23:53 UTC | 19 Jul 23 23:53 UTC |
	|         | ingress --alsologtostderr -v=1 |                        |         |         |                     |                     |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/19 23:49:07
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0719 23:49:07.280228  480998 out.go:296] Setting OutFile to fd 1 ...
	I0719 23:49:07.280932  480998 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:49:07.280947  480998 out.go:309] Setting ErrFile to fd 2...
	I0719 23:49:07.280953  480998 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:49:07.281242  480998 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	I0719 23:49:07.281731  480998 out.go:303] Setting JSON to false
	I0719 23:49:07.282692  480998 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":12693,"bootTime":1689797855,"procs":245,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0719 23:49:07.282761  480998 start.go:138] virtualization:  
	I0719 23:49:07.286505  480998 out.go:177] * [addons-634197] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0719 23:49:07.288348  480998 out.go:177]   - MINIKUBE_LOCATION=15585
	I0719 23:49:07.289964  480998 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0719 23:49:07.288521  480998 notify.go:220] Checking for updates...
	I0719 23:49:07.291612  480998 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0719 23:49:07.293372  480998 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	I0719 23:49:07.294994  480998 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0719 23:49:07.297004  480998 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0719 23:49:07.299342  480998 driver.go:373] Setting default libvirt URI to qemu:///system
	I0719 23:49:07.323448  480998 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0719 23:49:07.323559  480998 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:49:07.409936  480998 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-19 23:49:07.399571396 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:49:07.410053  480998 docker.go:294] overlay module found
	I0719 23:49:07.412228  480998 out.go:177] * Using the docker driver based on user configuration
	I0719 23:49:07.413905  480998 start.go:298] selected driver: docker
	I0719 23:49:07.413934  480998 start.go:880] validating driver "docker" against <nil>
	I0719 23:49:07.413949  480998 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0719 23:49:07.414643  480998 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:49:07.483628  480998 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-19 23:49:07.474417575 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:49:07.483801  480998 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0719 23:49:07.484042  480998 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0719 23:49:07.485820  480998 out.go:177] * Using Docker driver with root privileges
	I0719 23:49:07.487437  480998 cni.go:84] Creating CNI manager for ""
	I0719 23:49:07.487460  480998 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0719 23:49:07.487469  480998 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0719 23:49:07.487485  480998 start_flags.go:319] config:
	{Name:addons-634197 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-634197 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:
cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:49:07.489467  480998 out.go:177] * Starting control plane node addons-634197 in cluster addons-634197
	I0719 23:49:07.491234  480998 cache.go:122] Beginning downloading kic base image for docker with docker
	I0719 23:49:07.493000  480998 out.go:177] * Pulling base image ...
	I0719 23:49:07.494730  480998 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0719 23:49:07.494787  480998 preload.go:148] Found local preload: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	I0719 23:49:07.494827  480998 cache.go:57] Caching tarball of preloaded images
	I0719 23:49:07.494808  480998 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0719 23:49:07.494910  480998 preload.go:174] Found /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0719 23:49:07.494920  480998 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.3 on docker
	I0719 23:49:07.495255  480998 profile.go:148] Saving config to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/config.json ...
	I0719 23:49:07.495287  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/config.json: {Name:mk1b4b32e51ac004cc4ebd596ee4481486ce95aa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:07.511849  480998 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0719 23:49:07.511945  480998 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0719 23:49:07.511968  480998 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory, skipping pull
	I0719 23:49:07.511977  480998 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in cache, skipping pull
	I0719 23:49:07.511985  480998 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0719 23:49:07.511994  480998 cache.go:163] Loading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 from local cache
	I0719 23:49:23.249237  480998 cache.go:165] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 from cached tarball
	I0719 23:49:23.249278  480998 cache.go:195] Successfully downloaded all kic artifacts
	I0719 23:49:23.249346  480998 start.go:365] acquiring machines lock for addons-634197: {Name:mkb1a2ab4e4d97b51ad00183913f9050afd1c5b7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0719 23:49:23.249882  480998 start.go:369] acquired machines lock for "addons-634197" in 511.183µs
	I0719 23:49:23.249917  480998 start.go:93] Provisioning new machine with config: &{Name:addons-634197 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-634197 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServ
erIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custo
mQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0719 23:49:23.250019  480998 start.go:125] createHost starting for "" (driver="docker")
	I0719 23:49:23.252235  480998 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0719 23:49:23.252485  480998 start.go:159] libmachine.API.Create for "addons-634197" (driver="docker")
	I0719 23:49:23.252521  480998 client.go:168] LocalClient.Create starting
	I0719 23:49:23.252655  480998 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem
	I0719 23:49:23.579960  480998 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem
	I0719 23:49:25.200370  480998 cli_runner.go:164] Run: docker network inspect addons-634197 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0719 23:49:25.219908  480998 cli_runner.go:211] docker network inspect addons-634197 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0719 23:49:25.220000  480998 network_create.go:281] running [docker network inspect addons-634197] to gather additional debugging logs...
	I0719 23:49:25.220021  480998 cli_runner.go:164] Run: docker network inspect addons-634197
	W0719 23:49:25.237248  480998 cli_runner.go:211] docker network inspect addons-634197 returned with exit code 1
	I0719 23:49:25.237290  480998 network_create.go:284] error running [docker network inspect addons-634197]: docker network inspect addons-634197: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-634197 not found
	I0719 23:49:25.237304  480998 network_create.go:286] output of [docker network inspect addons-634197]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-634197 not found
	
	** /stderr **
	I0719 23:49:25.237371  480998 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0719 23:49:25.257099  480998 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400129e910}
	I0719 23:49:25.257142  480998 network_create.go:123] attempt to create docker network addons-634197 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0719 23:49:25.257201  480998 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-634197 addons-634197
	I0719 23:49:25.325569  480998 network_create.go:107] docker network addons-634197 192.168.49.0/24 created
	I0719 23:49:25.325595  480998 kic.go:117] calculated static IP "192.168.49.2" for the "addons-634197" container
	I0719 23:49:25.325672  480998 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0719 23:49:25.344582  480998 cli_runner.go:164] Run: docker volume create addons-634197 --label name.minikube.sigs.k8s.io=addons-634197 --label created_by.minikube.sigs.k8s.io=true
	I0719 23:49:25.364646  480998 oci.go:103] Successfully created a docker volume addons-634197
	I0719 23:49:25.364736  480998 cli_runner.go:164] Run: docker run --rm --name addons-634197-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-634197 --entrypoint /usr/bin/test -v addons-634197:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib
	I0719 23:49:27.174013  480998 cli_runner.go:217] Completed: docker run --rm --name addons-634197-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-634197 --entrypoint /usr/bin/test -v addons-634197:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib: (1.809239255s)
	I0719 23:49:27.174045  480998 oci.go:107] Successfully prepared a docker volume addons-634197
	I0719 23:49:27.174063  480998 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0719 23:49:27.174082  480998 kic.go:190] Starting extracting preloaded images to volume ...
	I0719 23:49:27.174171  480998 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-634197:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir
	I0719 23:49:31.032276  480998 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-634197:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir: (3.858059054s)
	I0719 23:49:31.032314  480998 kic.go:199] duration metric: took 3.858228 seconds to extract preloaded images to volume
	W0719 23:49:31.032462  480998 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0719 23:49:31.032576  480998 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0719 23:49:31.112153  480998 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-634197 --name addons-634197 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-634197 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-634197 --network addons-634197 --ip 192.168.49.2 --volume addons-634197:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631
	I0719 23:49:31.467433  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Running}}
	I0719 23:49:31.493209  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:49:31.528731  480998 cli_runner.go:164] Run: docker exec addons-634197 stat /var/lib/dpkg/alternatives/iptables
	I0719 23:49:31.598182  480998 oci.go:144] the created container "addons-634197" has a running status.
	I0719 23:49:31.598207  480998 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa...
	I0719 23:49:31.835178  480998 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0719 23:49:31.870731  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:49:31.893435  480998 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0719 23:49:31.893459  480998 kic_runner.go:114] Args: [docker exec --privileged addons-634197 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0719 23:49:31.990769  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:49:32.023537  480998 machine.go:88] provisioning docker machine ...
	I0719 23:49:32.023565  480998 ubuntu.go:169] provisioning hostname "addons-634197"
	I0719 23:49:32.023626  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:32.049794  480998 main.go:141] libmachine: Using SSH client type: native
	I0719 23:49:32.050265  480998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33376 <nil> <nil>}
	I0719 23:49:32.050286  480998 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-634197 && echo "addons-634197" | sudo tee /etc/hostname
	I0719 23:49:32.050907  480998 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:39130->127.0.0.1:33376: read: connection reset by peer
	I0719 23:49:35.198377  480998 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-634197
	
	I0719 23:49:35.198473  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:35.217798  480998 main.go:141] libmachine: Using SSH client type: native
	I0719 23:49:35.218234  480998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33376 <nil> <nil>}
	I0719 23:49:35.218257  480998 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-634197' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-634197/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-634197' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0719 23:49:35.347623  480998 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0719 23:49:35.347652  480998 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/15585-475114/.minikube CaCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/15585-475114/.minikube}
	I0719 23:49:35.347736  480998 ubuntu.go:177] setting up certificates
	I0719 23:49:35.347745  480998 provision.go:83] configureAuth start
	I0719 23:49:35.347819  480998 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-634197
	I0719 23:49:35.372520  480998 provision.go:138] copyHostCerts
	I0719 23:49:35.372607  480998 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/cert.pem (1123 bytes)
	I0719 23:49:35.372730  480998 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/key.pem (1679 bytes)
	I0719 23:49:35.372793  480998 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/ca.pem (1082 bytes)
	I0719 23:49:35.372843  480998 provision.go:112] generating server cert: /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca-key.pem org=jenkins.addons-634197 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-634197]
	I0719 23:49:35.680584  480998 provision.go:172] copyRemoteCerts
	I0719 23:49:35.680677  480998 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0719 23:49:35.680726  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:35.701221  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:49:35.797794  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0719 23:49:35.827875  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I0719 23:49:35.856779  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0719 23:49:35.885060  480998 provision.go:86] duration metric: configureAuth took 537.302058ms
	I0719 23:49:35.885092  480998 ubuntu.go:193] setting minikube options for container-runtime
	I0719 23:49:35.885279  480998 config.go:182] Loaded profile config "addons-634197": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0719 23:49:35.885337  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:35.903009  480998 main.go:141] libmachine: Using SSH client type: native
	I0719 23:49:35.903476  480998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33376 <nil> <nil>}
	I0719 23:49:35.903492  480998 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0719 23:49:36.032965  480998 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0719 23:49:36.032988  480998 ubuntu.go:71] root file system type: overlay
	I0719 23:49:36.033114  480998 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0719 23:49:36.033193  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:36.053161  480998 main.go:141] libmachine: Using SSH client type: native
	I0719 23:49:36.053602  480998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33376 <nil> <nil>}
	I0719 23:49:36.053682  480998 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0719 23:49:36.198231  480998 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0719 23:49:36.198318  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:36.222103  480998 main.go:141] libmachine: Using SSH client type: native
	I0719 23:49:36.222560  480998 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33376 <nil> <nil>}
	I0719 23:49:36.222587  480998 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0719 23:49:37.026408  480998 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-07-07 14:51:01.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-07-19 23:49:36.194098169 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0719 23:49:37.026441  480998 machine.go:91] provisioned docker machine in 5.002884667s
	I0719 23:49:37.026453  480998 client.go:171] LocalClient.Create took 13.773926009s
	I0719 23:49:37.026465  480998 start.go:167] duration metric: libmachine.API.Create for "addons-634197" took 13.77398022s
	I0719 23:49:37.026473  480998 start.go:300] post-start starting for "addons-634197" (driver="docker")
	I0719 23:49:37.026487  480998 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0719 23:49:37.026589  480998 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0719 23:49:37.026636  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:37.047166  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:49:37.141217  480998 ssh_runner.go:195] Run: cat /etc/os-release
	I0719 23:49:37.145308  480998 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0719 23:49:37.145343  480998 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0719 23:49:37.145355  480998 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0719 23:49:37.145364  480998 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0719 23:49:37.145373  480998 filesync.go:126] Scanning /home/jenkins/minikube-integration/15585-475114/.minikube/addons for local assets ...
	I0719 23:49:37.145444  480998 filesync.go:126] Scanning /home/jenkins/minikube-integration/15585-475114/.minikube/files for local assets ...
	I0719 23:49:37.145471  480998 start.go:303] post-start completed in 118.987711ms
	I0719 23:49:37.145780  480998 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-634197
	I0719 23:49:37.163185  480998 profile.go:148] Saving config to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/config.json ...
	I0719 23:49:37.163474  480998 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0719 23:49:37.163522  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:37.183892  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:49:37.272839  480998 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0719 23:49:37.278641  480998 start.go:128] duration metric: createHost completed in 14.028606083s
	I0719 23:49:37.278664  480998 start.go:83] releasing machines lock for "addons-634197", held for 14.028766443s
	I0719 23:49:37.278736  480998 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-634197
	I0719 23:49:37.296969  480998 ssh_runner.go:195] Run: cat /version.json
	I0719 23:49:37.297028  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:37.297260  480998 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0719 23:49:37.297317  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:49:37.321648  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:49:37.334504  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:49:37.419062  480998 ssh_runner.go:195] Run: systemctl --version
	I0719 23:49:37.570657  480998 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0719 23:49:37.576641  480998 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0719 23:49:37.607113  480998 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0719 23:49:37.607301  480998 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0719 23:49:37.642354  480998 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0719 23:49:37.642383  480998 start.go:466] detecting cgroup driver to use...
	I0719 23:49:37.642416  480998 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0719 23:49:37.642602  480998 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0719 23:49:37.663228  480998 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0719 23:49:37.675618  480998 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0719 23:49:37.687768  480998 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0719 23:49:37.687888  480998 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0719 23:49:37.700686  480998 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0719 23:49:37.713470  480998 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0719 23:49:37.726030  480998 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0719 23:49:37.738124  480998 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0719 23:49:37.749440  480998 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0719 23:49:37.761336  480998 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0719 23:49:37.772120  480998 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0719 23:49:37.782856  480998 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0719 23:49:37.877994  480998 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0719 23:49:37.986974  480998 start.go:466] detecting cgroup driver to use...
	I0719 23:49:37.987022  480998 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0719 23:49:37.987072  480998 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0719 23:49:38.003874  480998 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0719 23:49:38.003952  480998 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0719 23:49:38.021037  480998 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0719 23:49:38.042862  480998 ssh_runner.go:195] Run: which cri-dockerd
	I0719 23:49:38.049202  480998 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0719 23:49:38.060471  480998 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0719 23:49:38.089888  480998 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0719 23:49:38.203187  480998 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0719 23:49:38.314355  480998 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0719 23:49:38.314429  480998 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0719 23:49:38.336898  480998 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0719 23:49:38.442955  480998 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0719 23:49:38.709710  480998 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0719 23:49:38.815819  480998 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I0719 23:49:38.916108  480998 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0719 23:49:39.009645  480998 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0719 23:49:39.111607  480998 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I0719 23:49:39.128840  480998 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0719 23:49:39.232416  480998 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
	I0719 23:49:39.320439  480998 start.go:513] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I0719 23:49:39.320583  480998 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I0719 23:49:39.325810  480998 start.go:534] Will wait 60s for crictl version
	I0719 23:49:39.325884  480998 ssh_runner.go:195] Run: which crictl
	I0719 23:49:39.331256  480998 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0719 23:49:39.388493  480998 start.go:550] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  24.0.4
	RuntimeApiVersion:  v1
	I0719 23:49:39.388563  480998 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0719 23:49:39.415370  480998 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0719 23:49:39.447135  480998 out.go:204] * Preparing Kubernetes v1.27.3 on Docker 24.0.4 ...
	I0719 23:49:39.447235  480998 cli_runner.go:164] Run: docker network inspect addons-634197 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0719 23:49:39.466574  480998 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0719 23:49:39.471205  480998 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0719 23:49:39.484823  480998 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0719 23:49:39.484898  480998 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0719 23:49:39.506233  480998 docker.go:636] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.27.3
	registry.k8s.io/kube-controller-manager:v1.27.3
	registry.k8s.io/kube-scheduler:v1.27.3
	registry.k8s.io/kube-proxy:v1.27.3
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/etcd:3.5.7-0
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0719 23:49:39.506255  480998 docker.go:566] Images already preloaded, skipping extraction
	I0719 23:49:39.506319  480998 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0719 23:49:39.528083  480998 docker.go:636] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.27.3
	registry.k8s.io/kube-controller-manager:v1.27.3
	registry.k8s.io/kube-scheduler:v1.27.3
	registry.k8s.io/kube-proxy:v1.27.3
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/etcd:3.5.7-0
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0719 23:49:39.528104  480998 cache_images.go:84] Images are preloaded, skipping loading
	I0719 23:49:39.528164  480998 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0719 23:49:39.589875  480998 cni.go:84] Creating CNI manager for ""
	I0719 23:49:39.589904  480998 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0719 23:49:39.589919  480998 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0719 23:49:39.589937  480998 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.27.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-634197 NodeName:addons-634197 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0719 23:49:39.590094  480998 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "addons-634197"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.27.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0719 23:49:39.590170  480998 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.27.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-634197 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.27.3 ClusterName:addons-634197 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0719 23:49:39.590240  480998 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.3
	I0719 23:49:39.601341  480998 binaries.go:44] Found k8s binaries, skipping transfer
	I0719 23:49:39.601465  480998 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0719 23:49:39.611905  480998 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
	I0719 23:49:39.632992  480998 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0719 23:49:39.654757  480998 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I0719 23:49:39.675640  480998 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0719 23:49:39.680241  480998 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0719 23:49:39.693455  480998 certs.go:56] Setting up /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197 for IP: 192.168.49.2
	I0719 23:49:39.693485  480998 certs.go:190] acquiring lock for shared ca certs: {Name:mk12f0b6d33973829acc3e8320bcb5c1c1ccc407 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:39.693610  480998 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/15585-475114/.minikube/ca.key
	I0719 23:49:40.068576  480998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt ...
	I0719 23:49:40.068608  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt: {Name:mkb0e907613dccc9aeb8fc724f5754ee9ab18b8e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:40.068795  480998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/15585-475114/.minikube/ca.key ...
	I0719 23:49:40.068809  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/ca.key: {Name:mkac21fd093c630b9da504747ce125c7be34b190 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:40.069299  480998 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.key
	I0719 23:49:40.829398  480998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.crt ...
	I0719 23:49:40.829432  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.crt: {Name:mke11bfd275e8f0217a138750c8bdf50c15fc61a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:40.829645  480998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.key ...
	I0719 23:49:40.829657  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.key: {Name:mkbaec70965ddaeca0635c788ea0613d0600342f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:40.829783  480998 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.key
	I0719 23:49:40.829802  480998 crypto.go:68] Generating cert /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt with IP's: []
	I0719 23:49:41.544699  480998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt ...
	I0719 23:49:41.544736  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: {Name:mk10a4e8a3766b43cc6fca53ffcf4644426830c1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:41.545619  480998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.key ...
	I0719 23:49:41.545638  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.key: {Name:mk6ea34158b7abc026c624973fdc8df430af9965 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:41.546248  480998 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.key.dd3b5fb2
	I0719 23:49:41.546273  480998 crypto.go:68] Generating cert /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0719 23:49:42.238038  480998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.crt.dd3b5fb2 ...
	I0719 23:49:42.238074  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.crt.dd3b5fb2: {Name:mk6301c266db04ea6de4c3bf201beaeab9adca9c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:42.238777  480998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.key.dd3b5fb2 ...
	I0719 23:49:42.238800  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.key.dd3b5fb2: {Name:mkf5313666926180237c30789c6c4bfd8d5b5e46 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:42.238930  480998 certs.go:337] copying /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.crt
	I0719 23:49:42.239010  480998 certs.go:341] copying /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.key
	I0719 23:49:42.239062  480998 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/proxy-client.key
	I0719 23:49:42.239081  480998 crypto.go:68] Generating cert /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/proxy-client.crt with IP's: []
	I0719 23:49:42.694799  480998 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/proxy-client.crt ...
	I0719 23:49:42.694831  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/proxy-client.crt: {Name:mk4403d8407674fa0f150eae2c5ca5a328b42520 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:42.695400  480998 crypto.go:164] Writing key to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/proxy-client.key ...
	I0719 23:49:42.695417  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/proxy-client.key: {Name:mk789162752cdfca0a6b6d51a647076137a2ccaa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:49:42.695615  480998 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca-key.pem (1679 bytes)
	I0719 23:49:42.695658  480998 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem (1082 bytes)
	I0719 23:49:42.695687  480998 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem (1123 bytes)
	I0719 23:49:42.695718  480998 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem (1679 bytes)
	I0719 23:49:42.696347  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0719 23:49:42.726408  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0719 23:49:42.756152  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0719 23:49:42.784575  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0719 23:49:42.812273  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0719 23:49:42.840234  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0719 23:49:42.868383  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0719 23:49:42.896346  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0719 23:49:42.924497  480998 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0719 23:49:42.952881  480998 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0719 23:49:42.973883  480998 ssh_runner.go:195] Run: openssl version
	I0719 23:49:42.980962  480998 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0719 23:49:42.992698  480998 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0719 23:49:42.997318  480998 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 19 23:49 /usr/share/ca-certificates/minikubeCA.pem
	I0719 23:49:42.997419  480998 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0719 23:49:43.006601  480998 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0719 23:49:43.018774  480998 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0719 23:49:43.023221  480998 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0719 23:49:43.023271  480998 kubeadm.go:404] StartCluster: {Name:addons-634197 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-634197 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clu
ster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:49:43.023406  480998 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0719 23:49:43.043388  480998 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0719 23:49:43.054448  480998 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0719 23:49:43.065674  480998 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0719 23:49:43.065739  480998 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0719 23:49:43.076543  480998 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0719 23:49:43.076638  480998 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0719 23:49:43.129610  480998 kubeadm.go:322] [init] Using Kubernetes version: v1.27.3
	I0719 23:49:43.130011  480998 kubeadm.go:322] [preflight] Running pre-flight checks
	I0719 23:49:43.196056  480998 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0719 23:49:43.196179  480998 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1039-aws
	I0719 23:49:43.196235  480998 kubeadm.go:322] OS: Linux
	I0719 23:49:43.196294  480998 kubeadm.go:322] CGROUPS_CPU: enabled
	I0719 23:49:43.196361  480998 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0719 23:49:43.196424  480998 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0719 23:49:43.196487  480998 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0719 23:49:43.196552  480998 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0719 23:49:43.196620  480998 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0719 23:49:43.196679  480998 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0719 23:49:43.196742  480998 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0719 23:49:43.196802  480998 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0719 23:49:43.275588  480998 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0719 23:49:43.275728  480998 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0719 23:49:43.275842  480998 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0719 23:49:43.623837  480998 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0719 23:49:43.626598  480998 out.go:204]   - Generating certificates and keys ...
	I0719 23:49:43.626751  480998 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0719 23:49:43.626847  480998 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0719 23:49:44.827423  480998 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0719 23:49:45.206861  480998 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0719 23:49:45.683699  480998 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0719 23:49:46.085388  480998 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0719 23:49:46.414400  480998 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0719 23:49:46.414830  480998 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-634197 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0719 23:49:46.553040  480998 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0719 23:49:46.553481  480998 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-634197 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0719 23:49:46.716498  480998 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0719 23:49:47.272822  480998 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0719 23:49:47.737230  480998 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0719 23:49:47.737571  480998 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0719 23:49:48.272868  480998 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0719 23:49:49.274649  480998 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0719 23:49:49.607211  480998 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0719 23:49:50.034250  480998 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0719 23:49:50.049068  480998 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0719 23:49:50.050303  480998 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0719 23:49:50.050584  480998 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0719 23:49:50.169161  480998 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0719 23:49:50.171145  480998 out.go:204]   - Booting up control plane ...
	I0719 23:49:50.171255  480998 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0719 23:49:50.180047  480998 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0719 23:49:50.181598  480998 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0719 23:49:50.182951  480998 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0719 23:49:50.185933  480998 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0719 23:49:58.188580  480998 kubeadm.go:322] [apiclient] All control plane components are healthy after 8.002084 seconds
	I0719 23:49:58.188703  480998 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0719 23:49:58.202884  480998 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0719 23:49:58.728551  480998 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0719 23:49:58.728736  480998 kubeadm.go:322] [mark-control-plane] Marking the node addons-634197 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0719 23:49:59.239986  480998 kubeadm.go:322] [bootstrap-token] Using token: vorako.f45oob7emoah8qpt
	I0719 23:49:59.241990  480998 out.go:204]   - Configuring RBAC rules ...
	I0719 23:49:59.242104  480998 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0719 23:49:59.247357  480998 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0719 23:49:59.262463  480998 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0719 23:49:59.266110  480998 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0719 23:49:59.269737  480998 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0719 23:49:59.275595  480998 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0719 23:49:59.288907  480998 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0719 23:49:59.512126  480998 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0719 23:49:59.655655  480998 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0719 23:49:59.656828  480998 kubeadm.go:322] 
	I0719 23:49:59.656896  480998 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0719 23:49:59.656901  480998 kubeadm.go:322] 
	I0719 23:49:59.656974  480998 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0719 23:49:59.656978  480998 kubeadm.go:322] 
	I0719 23:49:59.657002  480998 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0719 23:49:59.657057  480998 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0719 23:49:59.657104  480998 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0719 23:49:59.657108  480998 kubeadm.go:322] 
	I0719 23:49:59.657159  480998 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0719 23:49:59.657163  480998 kubeadm.go:322] 
	I0719 23:49:59.657207  480998 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0719 23:49:59.657212  480998 kubeadm.go:322] 
	I0719 23:49:59.657261  480998 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0719 23:49:59.657337  480998 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0719 23:49:59.657401  480998 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0719 23:49:59.657406  480998 kubeadm.go:322] 
	I0719 23:49:59.657485  480998 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0719 23:49:59.657557  480998 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0719 23:49:59.657562  480998 kubeadm.go:322] 
	I0719 23:49:59.657641  480998 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token vorako.f45oob7emoah8qpt \
	I0719 23:49:59.657738  480998 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:02308911837873b6bc537b1e28367e4f116caaff34a3a3a2b7529aa2ff1345f5 \
	I0719 23:49:59.657759  480998 kubeadm.go:322] 	--control-plane 
	I0719 23:49:59.657764  480998 kubeadm.go:322] 
	I0719 23:49:59.657843  480998 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0719 23:49:59.657848  480998 kubeadm.go:322] 
	I0719 23:49:59.657925  480998 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token vorako.f45oob7emoah8qpt \
	I0719 23:49:59.658021  480998 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:02308911837873b6bc537b1e28367e4f116caaff34a3a3a2b7529aa2ff1345f5 
	I0719 23:49:59.662848  480998 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1039-aws\n", err: exit status 1
	I0719 23:49:59.662965  480998 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0719 23:49:59.662982  480998 cni.go:84] Creating CNI manager for ""
	I0719 23:49:59.662997  480998 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0719 23:49:59.665331  480998 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I0719 23:49:59.667335  480998 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I0719 23:49:59.682162  480998 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
	I0719 23:49:59.719022  480998 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0719 23:49:59.719145  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:49:59.719214  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl label nodes minikube.k8s.io/version=v1.31.0 minikube.k8s.io/commit=fd270bde4b7e946c995f2329996587ae45fe53d4 minikube.k8s.io/name=addons-634197 minikube.k8s.io/updated_at=2023_07_19T23_49_59_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:49:59.967487  480998 ops.go:34] apiserver oom_adj: -16
	I0719 23:49:59.967574  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:00.644934  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:01.145109  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:01.645403  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:02.144987  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:02.645231  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:03.145204  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:03.645115  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:04.145157  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:04.645261  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:05.145082  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:05.645409  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:06.144952  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:06.644409  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:07.145314  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:07.645369  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:08.144662  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:08.645100  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:09.144955  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:09.645303  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:10.145383  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:10.644443  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:11.144855  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:11.644970  480998 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:50:11.777332  480998 kubeadm.go:1081] duration metric: took 12.058235994s to wait for elevateKubeSystemPrivileges.
	I0719 23:50:11.777364  480998 kubeadm.go:406] StartCluster complete in 28.754096634s
	I0719 23:50:11.777392  480998 settings.go:142] acquiring lock: {Name:mk41fff0c17add5da17be8845b4b2b979fdedd20 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:50:11.777955  480998 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0719 23:50:11.778424  480998 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/kubeconfig: {Name:mk1d564203301f80896734e3ac033e5a4f1a12de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:50:11.778654  480998 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0719 23:50:11.778958  480998 config.go:182] Loaded profile config "addons-634197": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0719 23:50:11.779064  480998 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]
	I0719 23:50:11.779155  480998 addons.go:69] Setting volumesnapshots=true in profile "addons-634197"
	I0719 23:50:11.779172  480998 addons.go:231] Setting addon volumesnapshots=true in "addons-634197"
	I0719 23:50:11.779211  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.779641  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.781035  480998 addons.go:69] Setting ingress=true in profile "addons-634197"
	I0719 23:50:11.781067  480998 addons.go:231] Setting addon ingress=true in "addons-634197"
	I0719 23:50:11.781113  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.781554  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.781639  480998 addons.go:69] Setting cloud-spanner=true in profile "addons-634197"
	I0719 23:50:11.781654  480998 addons.go:231] Setting addon cloud-spanner=true in "addons-634197"
	I0719 23:50:11.781681  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.782046  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.782112  480998 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-634197"
	I0719 23:50:11.782143  480998 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-634197"
	I0719 23:50:11.782173  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.782518  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.782740  480998 addons.go:69] Setting default-storageclass=true in profile "addons-634197"
	I0719 23:50:11.782762  480998 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-634197"
	I0719 23:50:11.783058  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.783134  480998 addons.go:69] Setting gcp-auth=true in profile "addons-634197"
	I0719 23:50:11.783153  480998 mustload.go:65] Loading cluster: addons-634197
	I0719 23:50:11.783324  480998 config.go:182] Loaded profile config "addons-634197": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0719 23:50:11.783681  480998 addons.go:69] Setting ingress-dns=true in profile "addons-634197"
	I0719 23:50:11.783705  480998 addons.go:231] Setting addon ingress-dns=true in "addons-634197"
	I0719 23:50:11.783751  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.784159  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.784311  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.784376  480998 addons.go:69] Setting storage-provisioner=true in profile "addons-634197"
	I0719 23:50:11.784389  480998 addons.go:231] Setting addon storage-provisioner=true in "addons-634197"
	I0719 23:50:11.784417  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.784771  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.784824  480998 addons.go:69] Setting inspektor-gadget=true in profile "addons-634197"
	I0719 23:50:11.784833  480998 addons.go:231] Setting addon inspektor-gadget=true in "addons-634197"
	I0719 23:50:11.784855  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.785183  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.785236  480998 addons.go:69] Setting metrics-server=true in profile "addons-634197"
	I0719 23:50:11.785246  480998 addons.go:231] Setting addon metrics-server=true in "addons-634197"
	I0719 23:50:11.785269  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.785618  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.804563  480998 addons.go:69] Setting registry=true in profile "addons-634197"
	I0719 23:50:11.804600  480998 addons.go:231] Setting addon registry=true in "addons-634197"
	I0719 23:50:11.804648  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.805105  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:11.911903  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0719 23:50:11.920383  480998 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0719 23:50:11.920401  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0719 23:50:11.920463  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:11.918768  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:11.946679  480998 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I0719 23:50:11.948699  480998 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.7
	I0719 23:50:11.950310  480998 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
	I0719 23:50:11.950327  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1003 bytes)
	I0719 23:50:11.950392  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:11.950559  480998 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0719 23:50:11.950566  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0719 23:50:11.950595  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:11.950751  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0719 23:50:11.961381  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0719 23:50:11.963072  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0719 23:50:11.950946  480998 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.8.1
	I0719 23:50:11.965992  480998 out.go:177]   - Using image docker.io/registry:2.8.1
	I0719 23:50:11.967930  480998 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0719 23:50:11.969443  480998 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0719 23:50:11.971056  480998 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0719 23:50:11.971072  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16083 bytes)
	I0719 23:50:11.971136  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:11.976534  480998 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I0719 23:50:11.971683  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0719 23:50:11.980420  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0719 23:50:11.978915  480998 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
	I0719 23:50:11.985251  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I0719 23:50:11.985320  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:11.987085  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0719 23:50:11.991611  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0719 23:50:11.995696  480998 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0719 23:50:12.006120  480998 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0719 23:50:12.006194  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0719 23:50:12.006301  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:12.039146  480998 addons.go:231] Setting addon default-storageclass=true in "addons-634197"
	I0719 23:50:12.039194  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:12.039634  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:12.096845  480998 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0719 23:50:12.111075  480998 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0719 23:50:12.117841  480998 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0719 23:50:12.117866  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0719 23:50:12.118747  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:12.149529  480998 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.3
	I0719 23:50:12.168737  480998 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0719 23:50:12.168881  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0719 23:50:12.168985  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:12.180174  480998 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.18.1
	I0719 23:50:12.186664  480998 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0719 23:50:12.186690  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0719 23:50:12.186758  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:12.188794  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.197699  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.207090  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.208925  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.245126  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.267760  480998 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0719 23:50:12.267788  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0719 23:50:12.267853  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:12.270610  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.328804  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.330282  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.336533  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.362690  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:12.545203  480998 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-634197" context rescaled to 1 replicas
	I0719 23:50:12.545298  480998 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0719 23:50:12.548442  480998 out.go:177] * Verifying Kubernetes components...
	I0719 23:50:12.550229  480998 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0719 23:50:12.938657  480998 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0719 23:50:12.938682  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0719 23:50:13.071528  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0719 23:50:13.213276  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0719 23:50:13.241377  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0719 23:50:13.326108  480998 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0719 23:50:13.326181  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0719 23:50:13.332656  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0719 23:50:13.337690  480998 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
	I0719 23:50:13.337758  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0719 23:50:13.421092  480998 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0719 23:50:13.421165  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0719 23:50:13.424152  480998 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0719 23:50:13.424219  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0719 23:50:13.565788  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0719 23:50:13.674212  480998 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0719 23:50:13.674280  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0719 23:50:13.785035  480998 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0719 23:50:13.785118  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0719 23:50:13.901954  480998 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0719 23:50:13.902054  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0719 23:50:13.935218  480998 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0719 23:50:13.935290  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0719 23:50:14.015228  480998 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
	I0719 23:50:14.015302  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0719 23:50:14.060801  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0719 23:50:14.065735  480998 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0719 23:50:14.065810  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0719 23:50:14.173386  480998 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0719 23:50:14.173463  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0719 23:50:14.213509  480998 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0719 23:50:14.213580  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0719 23:50:14.357639  480998 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0719 23:50:14.357715  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0719 23:50:14.388341  480998 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0719 23:50:14.388417  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0719 23:50:14.408181  480998 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0719 23:50:14.408250  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0719 23:50:14.449449  480998 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0719 23:50:14.449521  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0719 23:50:14.659557  480998 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0719 23:50:14.659629  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0719 23:50:14.683756  480998 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0719 23:50:14.683817  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0719 23:50:14.718885  480998 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0719 23:50:14.718952  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0719 23:50:14.824686  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0719 23:50:14.840277  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0719 23:50:14.968569  480998 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0719 23:50:14.968639  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0719 23:50:15.003995  480998 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0719 23:50:15.004081  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0719 23:50:15.225904  480998 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
	I0719 23:50:15.225973  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0719 23:50:15.231655  480998 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0719 23:50:15.231723  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0719 23:50:15.302746  480998 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (2.752445925s)
	I0719 23:50:15.302853  480998 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.205967553s)
	I0719 23:50:15.302999  480998 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0719 23:50:15.303916  480998 node_ready.go:35] waiting up to 6m0s for node "addons-634197" to be "Ready" ...
	I0719 23:50:15.308071  480998 node_ready.go:49] node "addons-634197" has status "Ready":"True"
	I0719 23:50:15.308092  480998 node_ready.go:38] duration metric: took 4.114363ms waiting for node "addons-634197" to be "Ready" ...
	I0719 23:50:15.308100  480998 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0719 23:50:15.318368  480998 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:15.380722  480998 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0719 23:50:15.380747  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I0719 23:50:15.395035  480998 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0719 23:50:15.395060  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0719 23:50:15.602341  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0719 23:50:15.626601  480998 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0719 23:50:15.626625  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0719 23:50:15.782949  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0719 23:50:17.333428  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:18.551238  480998 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0719 23:50:18.551312  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:18.581747  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:19.158077  480998 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0719 23:50:19.355312  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:19.380839  480998 addons.go:231] Setting addon gcp-auth=true in "addons-634197"
	I0719 23:50:19.380936  480998 host.go:66] Checking if "addons-634197" exists ...
	I0719 23:50:19.381497  480998 cli_runner.go:164] Run: docker container inspect addons-634197 --format={{.State.Status}}
	I0719 23:50:19.410452  480998 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0719 23:50:19.410509  480998 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-634197
	I0719 23:50:19.443473  480998 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33376 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/addons-634197/id_rsa Username:docker}
	I0719 23:50:20.646955  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (7.405501008s)
	I0719 23:50:20.647011  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.31428935s)
	I0719 23:50:20.647082  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.081196125s)
	I0719 23:50:20.647114  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (6.586245389s)
	I0719 23:50:20.647124  480998 addons.go:467] Verifying addon registry=true in "addons-634197"
	I0719 23:50:20.648981  480998 out.go:177] * Verifying registry addon...
	I0719 23:50:20.647324  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.575774278s)
	I0719 23:50:20.647395  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (7.433553104s)
	I0719 23:50:20.647489  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (5.822741317s)
	I0719 23:50:20.647589  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (5.807229705s)
	I0719 23:50:20.647650  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (5.045280629s)
	I0719 23:50:20.661831  480998 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0719 23:50:20.662003  480998 addons.go:467] Verifying addon ingress=true in "addons-634197"
	I0719 23:50:20.664100  480998 out.go:177] * Verifying ingress addon...
	I0719 23:50:20.662202  480998 addons.go:467] Verifying addon metrics-server=true in "addons-634197"
	W0719 23:50:20.662257  480998 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0719 23:50:20.666304  480998 retry.go:31] will retry after 335.546773ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0719 23:50:20.667277  480998 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0719 23:50:20.674153  480998 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0719 23:50:20.674176  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:20.676580  480998 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0719 23:50:20.676599  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:21.002726  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0719 23:50:21.185456  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:21.190584  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:21.683816  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:21.723135  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:21.866495  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:21.977954  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.194959772s)
	I0719 23:50:21.978055  480998 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-634197"
	I0719 23:50:21.978020  480998 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.567444124s)
	I0719 23:50:21.980935  480998 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I0719 23:50:21.982558  480998 out.go:177] * Verifying csi-hostpath-driver addon...
	I0719 23:50:21.985463  480998 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0719 23:50:21.991710  480998 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0719 23:50:21.993397  480998 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0719 23:50:21.993421  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0719 23:50:22.041069  480998 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0719 23:50:22.041093  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:22.050622  480998 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0719 23:50:22.050654  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0719 23:50:22.157717  480998 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0719 23:50:22.157749  480998 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)
	I0719 23:50:22.194167  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:22.194939  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:22.204528  480998 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0719 23:50:22.606318  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:22.679055  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:22.682870  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:23.049289  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:23.180028  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:23.185429  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:23.547878  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:23.673292  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.670516733s)
	I0719 23:50:23.679702  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:23.683532  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:24.062451  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:24.072773  480998 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.86820641s)
	I0719 23:50:24.074288  480998 addons.go:467] Verifying addon gcp-auth=true in "addons-634197"
	I0719 23:50:24.076589  480998 out.go:177] * Verifying gcp-auth addon...
	I0719 23:50:24.079510  480998 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0719 23:50:24.083533  480998 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0719 23:50:24.083554  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:24.185231  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:24.189611  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:24.332326  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:24.547172  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:24.588254  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:24.680873  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:24.684932  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:25.047679  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:25.087829  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:25.181293  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:25.183523  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:25.548356  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:25.589203  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:25.681655  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:25.684079  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:26.047341  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:26.088331  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:26.182669  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:26.183704  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:26.333908  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:26.548508  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:26.587312  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:26.679834  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:26.683740  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:27.047817  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:27.088274  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:27.178570  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:27.182324  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:27.546891  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:27.587279  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:27.679708  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:27.682924  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:28.048235  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:28.089431  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:28.180820  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:28.184225  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:28.334066  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:28.547040  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:28.587188  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:28.679443  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:28.682821  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:29.047638  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:29.087504  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:29.180153  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:29.184500  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:29.548070  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:29.587757  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:29.679487  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:29.682516  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:30.056484  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:30.087549  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:30.180575  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:30.182828  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:30.547158  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:30.587059  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:30.678627  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:30.681986  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:30.832485  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:31.047763  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:31.087457  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:31.180599  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:31.181950  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:31.547337  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:31.589173  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:31.681908  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:31.685661  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:32.047661  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:32.088585  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:32.179526  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:32.183369  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:32.547460  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:32.587599  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:32.678930  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:32.682477  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:32.836586  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:33.049101  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:33.088328  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:33.180615  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:33.182709  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:33.548314  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:33.589350  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:33.679761  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:33.684458  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:34.048250  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:34.087940  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:34.179929  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:34.182883  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:34.547330  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:34.588016  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:34.682631  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:34.683171  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:35.048545  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:35.089251  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:35.181507  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:35.190189  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:35.332889  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:35.547725  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:35.587791  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:35.681515  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:35.682202  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:36.048063  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:36.088128  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:36.178653  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:36.181984  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:36.548018  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:36.587792  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:36.682551  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:36.684107  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:37.047778  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:37.089200  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:37.182921  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:37.183196  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:37.333407  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:37.546505  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:37.588169  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:37.682841  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:37.687838  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0719 23:50:38.046891  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:38.091311  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:38.181657  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:38.186045  480998 kapi.go:107] duration metric: took 17.52421184s to wait for kubernetes.io/minikube-addons=registry ...
	I0719 23:50:38.548299  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:38.588043  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:38.680543  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:39.050128  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:39.088475  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:39.181539  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:39.334029  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:39.548151  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:39.588458  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:39.679780  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:40.056288  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:40.088265  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:40.180317  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:40.547158  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:40.587526  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:40.678876  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:41.052364  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:41.090927  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:41.181660  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:41.546722  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:41.587148  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:41.678686  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:41.833102  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:42.047550  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:42.089743  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:42.180434  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:42.546859  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:42.587684  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:42.678782  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:43.046988  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:43.087828  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:43.179332  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:43.547313  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:43.588295  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:43.679508  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:43.833284  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:44.047519  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:44.088658  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:44.179880  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:44.547515  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:44.587970  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:44.679656  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:45.048198  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:45.088951  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:45.180710  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:45.548241  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:45.588475  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:45.679036  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:46.047650  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:46.087922  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:46.179507  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:46.332724  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:46.548058  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:46.588218  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:46.678929  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:47.047174  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:47.087796  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:47.179655  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:47.547159  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:47.587551  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:47.679070  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:48.047843  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:48.088316  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:48.178769  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:48.547608  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:48.587905  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:48.679987  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:48.833257  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:49.050362  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:49.087202  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:49.179324  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:49.547992  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:49.587719  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:49.679746  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:50.053284  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:50.088778  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:50.180236  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:50.548618  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:50.588579  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:50.679230  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:51.048324  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:51.089309  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:51.179321  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:51.333266  480998 pod_ready.go:102] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"False"
	I0719 23:50:51.548273  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:51.588552  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:51.688121  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:52.048649  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:52.089124  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:52.181570  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:52.550188  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:52.590321  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:52.682288  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:53.047584  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:53.087672  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:53.179879  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:53.342952  480998 pod_ready.go:92] pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace has status "Ready":"True"
	I0719 23:50:53.343026  480998 pod_ready.go:81] duration metric: took 38.024444463s waiting for pod "coredns-5d78c9869d-7c5mt" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.343053  480998 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-rdsxz" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.345852  480998 pod_ready.go:97] error getting pod "coredns-5d78c9869d-rdsxz" in "kube-system" namespace (skipping!): pods "coredns-5d78c9869d-rdsxz" not found
	I0719 23:50:53.345917  480998 pod_ready.go:81] duration metric: took 2.844352ms waiting for pod "coredns-5d78c9869d-rdsxz" in "kube-system" namespace to be "Ready" ...
	E0719 23:50:53.345941  480998 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5d78c9869d-rdsxz" in "kube-system" namespace (skipping!): pods "coredns-5d78c9869d-rdsxz" not found
	I0719 23:50:53.345962  480998 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-634197" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.359825  480998 pod_ready.go:92] pod "etcd-addons-634197" in "kube-system" namespace has status "Ready":"True"
	I0719 23:50:53.359896  480998 pod_ready.go:81] duration metric: took 13.895621ms waiting for pod "etcd-addons-634197" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.359923  480998 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-634197" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.371621  480998 pod_ready.go:92] pod "kube-apiserver-addons-634197" in "kube-system" namespace has status "Ready":"True"
	I0719 23:50:53.371686  480998 pod_ready.go:81] duration metric: took 11.742412ms waiting for pod "kube-apiserver-addons-634197" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.371712  480998 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-634197" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.382673  480998 pod_ready.go:92] pod "kube-controller-manager-addons-634197" in "kube-system" namespace has status "Ready":"True"
	I0719 23:50:53.382737  480998 pod_ready.go:81] duration metric: took 10.99526ms waiting for pod "kube-controller-manager-addons-634197" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.382780  480998 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-mnfk5" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.540648  480998 pod_ready.go:92] pod "kube-proxy-mnfk5" in "kube-system" namespace has status "Ready":"True"
	I0719 23:50:53.540713  480998 pod_ready.go:81] duration metric: took 157.912378ms waiting for pod "kube-proxy-mnfk5" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.540738  480998 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-634197" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.550094  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:53.588650  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:53.680257  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:53.930380  480998 pod_ready.go:92] pod "kube-scheduler-addons-634197" in "kube-system" namespace has status "Ready":"True"
	I0719 23:50:53.930448  480998 pod_ready.go:81] duration metric: took 389.683853ms waiting for pod "kube-scheduler-addons-634197" in "kube-system" namespace to be "Ready" ...
	I0719 23:50:53.930471  480998 pod_ready.go:38] duration metric: took 38.622358845s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0719 23:50:53.930515  480998 api_server.go:52] waiting for apiserver process to appear ...
	I0719 23:50:53.930650  480998 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0719 23:50:53.969113  480998 api_server.go:72] duration metric: took 41.423763919s to wait for apiserver process to appear ...
	I0719 23:50:53.969184  480998 api_server.go:88] waiting for apiserver healthz status ...
	I0719 23:50:53.969217  480998 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0719 23:50:53.981592  480998 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0719 23:50:53.982991  480998 api_server.go:141] control plane version: v1.27.3
	I0719 23:50:53.983046  480998 api_server.go:131] duration metric: took 13.841394ms to wait for apiserver health ...
	I0719 23:50:53.983069  480998 system_pods.go:43] waiting for kube-system pods to appear ...
	I0719 23:50:54.048458  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:54.087677  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:54.139187  480998 system_pods.go:59] 16 kube-system pods found
	I0719 23:50:54.139262  480998 system_pods.go:61] "coredns-5d78c9869d-7c5mt" [c7ceab3b-051f-4f13-b68f-b3535ac713af] Running
	I0719 23:50:54.139289  480998 system_pods.go:61] "csi-hostpath-attacher-0" [f1a3000a-f924-4282-8d48-3a95779fbae0] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0719 23:50:54.139315  480998 system_pods.go:61] "csi-hostpath-resizer-0" [735398d5-2d46-4bb0-bbe4-79fd7f74fcb3] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0719 23:50:54.139339  480998 system_pods.go:61] "csi-hostpathplugin-sl7sb" [9a59b96a-97d0-4e4e-bb3e-dfb3d073ab58] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0719 23:50:54.139362  480998 system_pods.go:61] "etcd-addons-634197" [66c68a34-2412-4621-b5cf-7f2ea89300b7] Running
	I0719 23:50:54.139384  480998 system_pods.go:61] "kube-apiserver-addons-634197" [361cf4d1-267e-4cd7-896e-aade728143b4] Running
	I0719 23:50:54.139403  480998 system_pods.go:61] "kube-controller-manager-addons-634197" [58817b39-9554-4d37-a946-b42f05dd19df] Running
	I0719 23:50:54.139430  480998 system_pods.go:61] "kube-ingress-dns-minikube" [7d557699-0b8f-4412-80f4-ef9c9b4cda92] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0719 23:50:54.139451  480998 system_pods.go:61] "kube-proxy-mnfk5" [af58e61e-0a2a-4488-84b2-fd6dcbebb7fd] Running
	I0719 23:50:54.139470  480998 system_pods.go:61] "kube-scheduler-addons-634197" [c3921233-4a64-46d4-8876-abc4c8e4ed54] Running
	I0719 23:50:54.139492  480998 system_pods.go:61] "metrics-server-844d8db974-fbw76" [e435d8bd-667d-48eb-867e-b6d7e8615954] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0719 23:50:54.139512  480998 system_pods.go:61] "registry-fdb5g" [2f3cf29a-3316-4f44-bd79-b9d19b97deae] Running
	I0719 23:50:54.139532  480998 system_pods.go:61] "registry-proxy-zqrlw" [b7df39f3-7ae3-415b-a7a5-14dd17240780] Running
	I0719 23:50:54.139552  480998 system_pods.go:61] "snapshot-controller-75bbb956b9-6wlfr" [c998da6e-2efa-4025-abbd-97715faab9bc] Running
	I0719 23:50:54.139574  480998 system_pods.go:61] "snapshot-controller-75bbb956b9-bqj5c" [2baa1a88-72d9-4d49-810c-701c9b9d05a6] Running
	I0719 23:50:54.139605  480998 system_pods.go:61] "storage-provisioner" [3cd322b8-f1ea-4ab1-bde8-fdd709501b2d] Running
	I0719 23:50:54.139628  480998 system_pods.go:74] duration metric: took 156.54001ms to wait for pod list to return data ...
	I0719 23:50:54.139651  480998 default_sa.go:34] waiting for default service account to be created ...
	I0719 23:50:54.179727  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:54.329694  480998 default_sa.go:45] found service account: "default"
	I0719 23:50:54.329720  480998 default_sa.go:55] duration metric: took 190.048403ms for default service account to be created ...
	I0719 23:50:54.329730  480998 system_pods.go:116] waiting for k8s-apps to be running ...
	I0719 23:50:54.538033  480998 system_pods.go:86] 16 kube-system pods found
	I0719 23:50:54.538114  480998 system_pods.go:89] "coredns-5d78c9869d-7c5mt" [c7ceab3b-051f-4f13-b68f-b3535ac713af] Running
	I0719 23:50:54.538140  480998 system_pods.go:89] "csi-hostpath-attacher-0" [f1a3000a-f924-4282-8d48-3a95779fbae0] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0719 23:50:54.538165  480998 system_pods.go:89] "csi-hostpath-resizer-0" [735398d5-2d46-4bb0-bbe4-79fd7f74fcb3] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0719 23:50:54.538213  480998 system_pods.go:89] "csi-hostpathplugin-sl7sb" [9a59b96a-97d0-4e4e-bb3e-dfb3d073ab58] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0719 23:50:54.538236  480998 system_pods.go:89] "etcd-addons-634197" [66c68a34-2412-4621-b5cf-7f2ea89300b7] Running
	I0719 23:50:54.538258  480998 system_pods.go:89] "kube-apiserver-addons-634197" [361cf4d1-267e-4cd7-896e-aade728143b4] Running
	I0719 23:50:54.538295  480998 system_pods.go:89] "kube-controller-manager-addons-634197" [58817b39-9554-4d37-a946-b42f05dd19df] Running
	I0719 23:50:54.538319  480998 system_pods.go:89] "kube-ingress-dns-minikube" [7d557699-0b8f-4412-80f4-ef9c9b4cda92] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0719 23:50:54.538342  480998 system_pods.go:89] "kube-proxy-mnfk5" [af58e61e-0a2a-4488-84b2-fd6dcbebb7fd] Running
	I0719 23:50:54.538379  480998 system_pods.go:89] "kube-scheduler-addons-634197" [c3921233-4a64-46d4-8876-abc4c8e4ed54] Running
	I0719 23:50:54.538402  480998 system_pods.go:89] "metrics-server-844d8db974-fbw76" [e435d8bd-667d-48eb-867e-b6d7e8615954] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0719 23:50:54.538426  480998 system_pods.go:89] "registry-fdb5g" [2f3cf29a-3316-4f44-bd79-b9d19b97deae] Running
	I0719 23:50:54.538461  480998 system_pods.go:89] "registry-proxy-zqrlw" [b7df39f3-7ae3-415b-a7a5-14dd17240780] Running
	I0719 23:50:54.538482  480998 system_pods.go:89] "snapshot-controller-75bbb956b9-6wlfr" [c998da6e-2efa-4025-abbd-97715faab9bc] Running
	I0719 23:50:54.538503  480998 system_pods.go:89] "snapshot-controller-75bbb956b9-bqj5c" [2baa1a88-72d9-4d49-810c-701c9b9d05a6] Running
	I0719 23:50:54.538550  480998 system_pods.go:89] "storage-provisioner" [3cd322b8-f1ea-4ab1-bde8-fdd709501b2d] Running
	I0719 23:50:54.538576  480998 system_pods.go:126] duration metric: took 208.839811ms to wait for k8s-apps to be running ...
	I0719 23:50:54.538596  480998 system_svc.go:44] waiting for kubelet service to be running ....
	I0719 23:50:54.538676  480998 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0719 23:50:54.546765  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:54.579809  480998 system_svc.go:56] duration metric: took 41.201935ms WaitForService to wait for kubelet.
	I0719 23:50:54.579833  480998 kubeadm.go:581] duration metric: took 42.034490191s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0719 23:50:54.579890  480998 node_conditions.go:102] verifying NodePressure condition ...
	I0719 23:50:54.587179  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:54.679515  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:54.748777  480998 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0719 23:50:54.748853  480998 node_conditions.go:123] node cpu capacity is 2
	I0719 23:50:54.748880  480998 node_conditions.go:105] duration metric: took 168.98132ms to run NodePressure ...
	I0719 23:50:54.748912  480998 start.go:228] waiting for startup goroutines ...
	I0719 23:50:55.048855  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:55.088652  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:55.180167  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:55.546850  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:55.587594  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:55.680002  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:56.048390  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:56.087925  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:56.179874  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:56.548496  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:56.587123  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:56.679068  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:57.047542  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:57.087726  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:57.179830  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:57.547230  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:57.587771  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:57.679516  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:58.050907  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:58.092727  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:58.179403  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:58.547216  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:58.604108  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:58.690685  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:59.047541  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:59.087101  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:59.180390  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:50:59.547738  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:50:59.588025  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:50:59.680363  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:00.061051  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:00.091412  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:00.179346  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:00.549000  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:00.587627  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:00.679028  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:01.047611  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:01.087796  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:01.179852  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:01.548314  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:01.588167  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:01.681301  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:02.048470  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:02.088172  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:02.185765  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:02.547154  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:02.588902  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:02.679868  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:03.050911  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:03.092047  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:03.178680  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:03.548061  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:03.587608  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:03.679666  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:04.046396  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:04.088323  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:04.179234  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:04.549400  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:04.587325  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:04.679310  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:05.047079  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:05.088380  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:05.179354  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:05.548552  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:05.587247  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:05.679655  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:06.047899  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:06.088353  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:06.179445  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:06.548196  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:06.587890  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:06.680283  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:07.047898  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:07.088451  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:07.179864  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:07.550286  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:07.587576  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:07.678887  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:08.046629  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0719 23:51:08.088186  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:08.179909  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:08.546691  480998 kapi.go:107] duration metric: took 46.561228487s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0719 23:51:08.588081  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:08.679370  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:09.087286  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:09.179228  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:09.587187  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:09.679960  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:10.088194  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:10.179477  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:10.587134  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:10.678954  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:11.088260  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:11.179322  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:11.587105  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:11.679998  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:12.087590  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:12.178702  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:12.587814  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:12.679376  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:13.087210  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:13.179266  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:13.587151  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:13.688584  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:14.087550  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:14.179150  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:14.587140  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:14.679273  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:15.087737  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:15.179358  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:15.587825  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:15.679878  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:16.088135  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:16.178855  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:16.587836  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:16.679719  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:17.087225  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:17.179243  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:17.587879  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:17.679306  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:18.087579  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:18.179607  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:18.588997  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:18.679355  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:19.087331  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:19.180724  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:19.587730  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:19.679681  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:20.087972  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:20.179718  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:20.587397  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:20.679121  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:21.087367  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:21.179595  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:21.587704  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:21.678782  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:22.088127  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:22.179217  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:22.587215  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:22.679334  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:23.087161  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:23.179268  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:23.587277  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:23.678791  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:24.088493  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:24.179286  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:24.587411  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:24.679507  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:25.087474  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:25.178862  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:25.588066  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:25.679421  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:26.087605  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:26.183977  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:26.588039  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:26.681794  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:27.088214  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:27.178856  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:27.587846  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:27.679524  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:28.089334  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:28.180683  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:28.587867  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:28.680340  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:29.087050  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:29.178428  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:29.587710  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:29.679128  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:30.089691  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:30.179439  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:30.587244  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:30.682926  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:31.088075  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:31.179286  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:31.587036  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:31.679108  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:32.087297  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:32.178959  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:32.587930  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:32.679831  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:33.087775  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:33.179268  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:33.587326  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:33.679374  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:34.087247  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:34.178788  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:34.587821  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:34.679201  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:35.087348  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:35.179595  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:35.587922  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:35.678945  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:36.088296  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:36.179239  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:36.586950  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:36.679661  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:37.087578  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:37.179263  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:37.587502  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:37.679309  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:38.087755  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:38.179530  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:38.587396  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:38.679470  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:39.088368  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:39.178871  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:39.587913  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:39.679033  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:40.088142  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:40.180241  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:40.587459  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:40.679002  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:41.087855  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:41.179114  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:41.587053  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:41.681128  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:42.087668  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:42.179882  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:42.587213  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:42.679599  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:43.087695  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:43.179395  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:43.587257  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:43.683364  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:44.087056  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:44.179081  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:44.587888  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:44.679557  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:45.088811  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:45.179450  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:45.587568  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:45.679153  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:46.088309  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:46.179719  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:46.587539  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:46.679037  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:47.087903  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:47.179300  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:47.587219  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:47.678877  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:48.089156  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:48.179131  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:48.587204  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:48.678968  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:49.088181  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:49.178991  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:49.588050  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:49.678515  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:50.087645  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:50.184035  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:50.587932  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:50.679615  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:51.087719  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:51.179202  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:51.587655  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:51.679354  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:52.087257  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:52.179010  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:52.588110  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:52.679517  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:53.087654  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:53.178829  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:53.587329  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:53.678915  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:54.088007  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:54.179268  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:54.587590  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:54.679041  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:55.088348  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:55.179497  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:55.586941  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:55.679174  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:56.088336  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:56.179149  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:56.587888  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:56.681401  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:57.087481  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:57.179456  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:57.587454  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:57.678841  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:58.088789  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:58.179426  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:58.587354  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:58.681107  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:59.088776  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:59.180414  480998 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0719 23:51:59.587427  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:51:59.680085  480998 kapi.go:107] duration metric: took 1m39.012808723s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0719 23:52:00.088036  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:52:00.587939  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:52:01.088054  480998 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0719 23:52:01.587602  480998 kapi.go:107] duration metric: took 1m37.508091235s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0719 23:52:01.589785  480998 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-634197 cluster.
	I0719 23:52:01.591480  480998 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0719 23:52:01.593046  480998 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0719 23:52:01.594983  480998 out.go:177] * Enabled addons: cloud-spanner, default-storageclass, storage-provisioner, inspektor-gadget, ingress-dns, metrics-server, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I0719 23:52:01.597006  480998 addons.go:502] enable addons completed in 1m49.817934121s: enabled=[cloud-spanner default-storageclass storage-provisioner inspektor-gadget ingress-dns metrics-server volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I0719 23:52:01.597051  480998 start.go:233] waiting for cluster config update ...
	I0719 23:52:01.597074  480998 start.go:242] writing updated cluster config ...
	I0719 23:52:01.597385  480998 ssh_runner.go:195] Run: rm -f paused
	I0719 23:52:01.660209  480998 start.go:578] kubectl: 1.27.4, cluster: 1.27.3 (minor skew: 0)
	I0719 23:52:01.662326  480998 out.go:177] * Done! kubectl is now configured to use "addons-634197" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Jul 19 23:52:51 addons-634197 dockerd[1094]: time="2023-07-19T23:52:51.677726586Z" level=info msg="ignoring event" container=a1163c63ffecafc5c101a775719b29f6b683e9a83cbd13ca6753757df3f6edf7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:51 addons-634197 cri-dockerd[1304]: time="2023-07-19T23:52:51Z" level=info msg="Failed to read pod IP from plugin/docker: networkPlugin cni failed on the status hook for pod \"task-pv-pod-restore_default\": unexpected command output nsenter: cannot open /proc/12504/ns/net: No such file or directory\n with error: exit status 1"
	Jul 19 23:52:51 addons-634197 dockerd[1094]: time="2023-07-19T23:52:51.810106859Z" level=info msg="ignoring event" container=c57dbcd4d8c49fb8add0bbb989f26bf302bf9ea2e32c55b432d08dc35407cf1a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.165136550Z" level=info msg="ignoring event" container=ebbd13f2df31b9559b53038006395ff1e021bb6b53a36613efc4805ff45e53d3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.167312266Z" level=info msg="ignoring event" container=0a87e3ac5911139b8789559a94b4dede7eafaebbce46f8452a4a441be0b58aca module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.182735945Z" level=info msg="ignoring event" container=82e686748c3f3abb3628beacd02cc21c03d09097026e9c54abc67811fdf83faa module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.197395299Z" level=info msg="ignoring event" container=7fdc521b6143ac6e88ec5ad444ad44e38d643a51d326c0785cefd649b6229788 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.197799110Z" level=info msg="ignoring event" container=bd58a925eaa825cc76957232619ec19c70cecc019cb25f49a4637dd85d36467e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.205822438Z" level=info msg="ignoring event" container=db58c33609d29cc02ae93e073885b17014c1d11d5a3ee00ab38485a99280f166 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.216730027Z" level=info msg="ignoring event" container=baab4a50ee7b082fecee7e9b1b73a088c90ca344529638d3965bd1579b9bb00c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.229531054Z" level=info msg="ignoring event" container=a187ab159787b06696c316bc99d03a3548741aac168d6e659e2b2a18389d073c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.377335039Z" level=info msg="ignoring event" container=0db3d3e14a06671430a9b77228a49cc3e50137d70f2e2c10c4e1c56f296f7084 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.455240683Z" level=info msg="ignoring event" container=dbc9dcaf01c35333a4d5fdf3bd197dcce0dfa505ea5df3666309137bbfbe5707 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:52:54 addons-634197 dockerd[1094]: time="2023-07-19T23:52:54.478072590Z" level=info msg="ignoring event" container=f79d36b6a7cfede81cd035b02857a5308fd4433fff1ddf4f95f1d8444000f576 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:53:00 addons-634197 dockerd[1094]: time="2023-07-19T23:53:00.925333443Z" level=info msg="ignoring event" container=29462c8f52bf9a8b1bee80b170022c3db38deadc945a75abe018844fa4331c4a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:53:00 addons-634197 dockerd[1094]: time="2023-07-19T23:53:00.930305643Z" level=info msg="ignoring event" container=18057c2ca80a072e026121b907af217da1cf731d3d183748decce80d634a0d28 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:53:01 addons-634197 dockerd[1094]: time="2023-07-19T23:53:01.120799606Z" level=info msg="ignoring event" container=b52f78a591c6788cb72ae9b518e2500071c6ed1bf0afae516304dd5407dee001 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:53:01 addons-634197 dockerd[1094]: time="2023-07-19T23:53:01.174293855Z" level=info msg="ignoring event" container=80e5d317bcc494323013ac2e1dca20600592b9bb1508b69154f29838b982d2e0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:53:01 addons-634197 cri-dockerd[1304]: time="2023-07-19T23:53:01Z" level=error msg="EOF Failed to get stats from container 29462c8f52bf9a8b1bee80b170022c3db38deadc945a75abe018844fa4331c4a"
	Jul 19 23:53:01 addons-634197 cri-dockerd[1304]: time="2023-07-19T23:53:01Z" level=error msg="EOF Failed to get stats from container 18057c2ca80a072e026121b907af217da1cf731d3d183748decce80d634a0d28"
	Jul 19 23:53:03 addons-634197 dockerd[1094]: time="2023-07-19T23:53:03.586094842Z" level=info msg="ignoring event" container=7c3518c8d2767a9849ecf0e3781b64035862c2c4e437eeed0e0a2b8f968be190 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:53:04 addons-634197 dockerd[1094]: time="2023-07-19T23:53:04.861045213Z" level=info msg="ignoring event" container=5e2379f57d69bc62e60979e932478d5742b29b15122ac7dc9e22fcc75b0d6ddf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:53:06 addons-634197 dockerd[1094]: time="2023-07-19T23:53:06.063926501Z" level=info msg="Container failed to exit within 1s of signal 15 - using the force" container=2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3
	Jul 19 23:53:06 addons-634197 dockerd[1094]: time="2023-07-19T23:53:06.140701186Z" level=info msg="ignoring event" container=2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 19 23:53:06 addons-634197 dockerd[1094]: time="2023-07-19T23:53:06.269113327Z" level=info msg="ignoring event" container=410a3341846bde12335732ef9391e7e819550628c22b77ee102a684e22ef36bc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                                        CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	5e2379f57d69b       13753a81eccfd                                                                                                                9 seconds ago        Exited              hello-world-app           2                   a9d04904d55fb       hello-world-app-65bdb79f98-scw24
	8c7f7cfa1ebaa       nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6                                                33 seconds ago       Running             nginx                     0                   534bad2da40c3       nginx
	17a94b6a8bae6       ghcr.io/headlamp-k8s/headlamp@sha256:67ba87b88218563eec9684525904936609713b02dcbcf4390cd055766217ed45                        About a minute ago   Running             headlamp                  0                   af2c6cc349c80       headlamp-66f6498c69-c75fn
	d6bed8cf086a0       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf                 About a minute ago   Running             gcp-auth                  0                   cff7638d87be8       gcp-auth-58478865f7-2v8qm
	97ab8c9b64078       8f2588812ab29                                                                                                                2 minutes ago        Exited              patch                     1                   4bd5f6dd77dec       ingress-nginx-admission-patch-d5tj4
	3edd4aa01ed62       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:543c40fd093964bc9ab509d3e791f9989963021f1e9e4c9c7b6700b02bfb227b   2 minutes ago        Exited              create                    0                   60bb81d84d02e       ingress-nginx-admission-create-4bdxn
	3c1e8c7cdc367       ba04bb24b9575                                                                                                                2 minutes ago        Running             storage-provisioner       0                   5f1919cabd616       storage-provisioner
	1590cadba9e7f       97e04611ad434                                                                                                                3 minutes ago        Running             coredns                   0                   3155cceef0acb       coredns-5d78c9869d-7c5mt
	01c3d18c74c18       fb73e92641fd5                                                                                                                3 minutes ago        Running             kube-proxy                0                   a46b42cd770c2       kube-proxy-mnfk5
	e04b106234a4f       24bc64e911039                                                                                                                3 minutes ago        Running             etcd                      0                   5337149b58b2d       etcd-addons-634197
	0708c914920f5       bcb9e554eaab6                                                                                                                3 minutes ago        Running             kube-scheduler            0                   5f027bcc1fbe7       kube-scheduler-addons-634197
	a0de04640704e       39dfb036b0986                                                                                                                3 minutes ago        Running             kube-apiserver            0                   e93dc82404307       kube-apiserver-addons-634197
	a296ec6cc5c1d       ab3683b584ae5                                                                                                                3 minutes ago        Running             kube-controller-manager   0                   3ed2d8e577b91       kube-controller-manager-addons-634197
	
	* 
	* ==> coredns [1590cadba9e7] <==
	* [INFO] 10.244.0.17:45833 - 33077 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000066691s
	[INFO] 10.244.0.17:36249 - 46464 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.007812581s
	[INFO] 10.244.0.17:36249 - 26214 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002309309s
	[INFO] 10.244.0.17:45833 - 25518 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.003887854s
	[INFO] 10.244.0.17:36249 - 40600 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000350388s
	[INFO] 10.244.0.17:45833 - 50410 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002203859s
	[INFO] 10.244.0.17:45833 - 39439 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000149085s
	[INFO] 10.244.0.17:46930 - 55419 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000150554s
	[INFO] 10.244.0.17:44198 - 59838 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000127211s
	[INFO] 10.244.0.17:46930 - 26468 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000070333s
	[INFO] 10.244.0.17:44198 - 2671 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000074567s
	[INFO] 10.244.0.17:46930 - 50896 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000095778s
	[INFO] 10.244.0.17:44198 - 51998 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000064008s
	[INFO] 10.244.0.17:46930 - 47715 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000075913s
	[INFO] 10.244.0.17:44198 - 18048 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000067568s
	[INFO] 10.244.0.17:46930 - 36343 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000091781s
	[INFO] 10.244.0.17:44198 - 64584 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000060808s
	[INFO] 10.244.0.17:46930 - 35265 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000067749s
	[INFO] 10.244.0.17:44198 - 41109 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000125734s
	[INFO] 10.244.0.17:44198 - 33843 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001056096s
	[INFO] 10.244.0.17:46930 - 10562 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001587635s
	[INFO] 10.244.0.17:44198 - 41333 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001107493s
	[INFO] 10.244.0.17:46930 - 26009 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00109319s
	[INFO] 10.244.0.17:44198 - 6592 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000063786s
	[INFO] 10.244.0.17:46930 - 42443 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000091429s
	
	* 
	* ==> describe nodes <==
	* Name:               addons-634197
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-634197
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=fd270bde4b7e946c995f2329996587ae45fe53d4
	                    minikube.k8s.io/name=addons-634197
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_07_19T23_49_59_0700
	                    minikube.k8s.io/version=v1.31.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-634197
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 19 Jul 2023 23:49:56 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-634197
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 19 Jul 2023 23:53:04 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 19 Jul 2023 23:53:04 +0000   Wed, 19 Jul 2023 23:49:53 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 19 Jul 2023 23:53:04 +0000   Wed, 19 Jul 2023 23:49:53 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 19 Jul 2023 23:53:04 +0000   Wed, 19 Jul 2023 23:49:53 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 19 Jul 2023 23:53:04 +0000   Wed, 19 Jul 2023 23:50:00 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-634197
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	System Info:
	  Machine ID:                 7cdc17e0953f4e828246824df052142d
	  System UUID:                50e82ebe-622b-44c0-8ba3-03caafa8ecfc
	  Boot ID:                    4b2b6d1f-58cb-4234-92d6-a62bd4106387
	  Kernel Version:             5.15.0-1039-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.4
	  Kubelet Version:            v1.27.3
	  Kube-Proxy Version:         v1.27.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-65bdb79f98-scw24         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         36s
	  gcp-auth                    gcp-auth-58478865f7-2v8qm                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m50s
	  headlamp                    headlamp-66f6498c69-c75fn                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         65s
	  kube-system                 coredns-5d78c9869d-7c5mt                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     3m1s
	  kube-system                 etcd-addons-634197                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         3m14s
	  kube-system                 kube-apiserver-addons-634197             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m14s
	  kube-system                 kube-controller-manager-addons-634197    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m14s
	  kube-system                 kube-proxy-mnfk5                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m1s
	  kube-system                 kube-scheduler-addons-634197             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m14s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m56s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)
	  memory             170Mi (2%!)(MISSING)  170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 2m59s                  kube-proxy       
	  Normal  NodeHasSufficientMemory  3m22s (x8 over 3m22s)  kubelet          Node addons-634197 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m22s (x8 over 3m22s)  kubelet          Node addons-634197 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m22s (x7 over 3m22s)  kubelet          Node addons-634197 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  3m22s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  3m14s                  kubelet          Node addons-634197 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m14s                  kubelet          Node addons-634197 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m14s                  kubelet          Node addons-634197 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             3m14s                  kubelet          Node addons-634197 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  3m14s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  Starting                 3m14s                  kubelet          Starting kubelet.
	  Normal  NodeReady                3m13s                  kubelet          Node addons-634197 status is now: NodeReady
	  Normal  RegisteredNode           3m2s                   node-controller  Node addons-634197 event: Registered Node addons-634197 in Controller
	
	* 
	* ==> dmesg <==
	* [  +0.001119] FS-Cache: O-key=[8] '8e5d3b0000000000'
	[  +0.000822] FS-Cache: N-cookie c=0000001e [p=00000015 fl=2 nc=0 na=1]
	[  +0.000938] FS-Cache: N-cookie d=00000000759abd80{9p.inode} n=00000000de6d8a27
	[  +0.001030] FS-Cache: N-key=[8] '8e5d3b0000000000'
	[  +0.002630] FS-Cache: Duplicate cookie detected
	[  +0.000737] FS-Cache: O-cookie c=00000018 [p=00000015 fl=226 nc=0 na=1]
	[  +0.000981] FS-Cache: O-cookie d=00000000759abd80{9p.inode} n=00000000b19664d6
	[  +0.001051] FS-Cache: O-key=[8] '8e5d3b0000000000'
	[  +0.000729] FS-Cache: N-cookie c=0000001f [p=00000015 fl=2 nc=0 na=1]
	[  +0.000955] FS-Cache: N-cookie d=00000000759abd80{9p.inode} n=0000000061c02f22
	[  +0.001049] FS-Cache: N-key=[8] '8e5d3b0000000000'
	[  +1.953014] FS-Cache: Duplicate cookie detected
	[  +0.000735] FS-Cache: O-cookie c=00000016 [p=00000015 fl=226 nc=0 na=1]
	[  +0.001136] FS-Cache: O-cookie d=00000000759abd80{9p.inode} n=00000000a249e8e5
	[  +0.001080] FS-Cache: O-key=[8] '8d5d3b0000000000'
	[  +0.000724] FS-Cache: N-cookie c=00000021 [p=00000015 fl=2 nc=0 na=1]
	[  +0.000918] FS-Cache: N-cookie d=00000000759abd80{9p.inode} n=000000007b372e9c
	[  +0.001087] FS-Cache: N-key=[8] '8d5d3b0000000000'
	[  +0.408656] FS-Cache: Duplicate cookie detected
	[  +0.000829] FS-Cache: O-cookie c=0000001b [p=00000015 fl=226 nc=0 na=1]
	[  +0.000972] FS-Cache: O-cookie d=00000000759abd80{9p.inode} n=0000000095238ffe
	[  +0.001178] FS-Cache: O-key=[8] '935d3b0000000000'
	[  +0.000708] FS-Cache: N-cookie c=00000022 [p=00000015 fl=2 nc=0 na=1]
	[  +0.000951] FS-Cache: N-cookie d=00000000759abd80{9p.inode} n=00000000421eab23
	[  +0.001101] FS-Cache: N-key=[8] '935d3b0000000000'
	
	* 
	* ==> etcd [e04b106234a4] <==
	* {"level":"info","ts":"2023-07-19T23:49:52.595Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2023-07-19T23:49:52.602Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-07-19T23:49:52.636Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2023-07-19T23:49:52.636Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-07-19T23:49:52.636Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-07-19T23:49:52.636Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2023-07-19T23:49:52.639Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2023-07-19T23:49:53.380Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-07-19T23:49:53.381Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-07-19T23:49:53.381Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-07-19T23:49:53.381Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-07-19T23:49:53.381Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-07-19T23:49:53.381Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-07-19T23:49:53.381Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-07-19T23:49:53.386Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-19T23:49:53.390Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-634197 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-07-19T23:49:53.390Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-07-19T23:49:53.392Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2023-07-19T23:49:53.392Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-19T23:49:53.392Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-19T23:49:53.393Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-19T23:49:53.393Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-07-19T23:49:53.394Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-07-19T23:49:53.394Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2023-07-19T23:49:53.399Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	
	* 
	* ==> gcp-auth [d6bed8cf086a] <==
	* 2023/07/19 23:52:00 GCP Auth Webhook started!
	2023/07/19 23:52:08 Ready to marshal response ...
	2023/07/19 23:52:08 Ready to write response ...
	2023/07/19 23:52:08 Ready to marshal response ...
	2023/07/19 23:52:08 Ready to write response ...
	2023/07/19 23:52:08 Ready to marshal response ...
	2023/07/19 23:52:08 Ready to write response ...
	2023/07/19 23:52:12 Ready to marshal response ...
	2023/07/19 23:52:12 Ready to write response ...
	2023/07/19 23:52:27 Ready to marshal response ...
	2023/07/19 23:52:27 Ready to write response ...
	2023/07/19 23:52:37 Ready to marshal response ...
	2023/07/19 23:52:37 Ready to write response ...
	2023/07/19 23:52:43 Ready to marshal response ...
	2023/07/19 23:52:43 Ready to write response ...
	2023/07/19 23:52:47 Ready to marshal response ...
	2023/07/19 23:52:47 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  23:53:13 up  3:35,  0 users,  load average: 1.78, 2.24, 2.12
	Linux addons-634197 5.15.0-1039-aws #44~20.04.1-Ubuntu SMP Thu Jun 22 12:21:08 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kube-apiserver [a0de04640704] <==
	* I0719 23:52:39.568186       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	I0719 23:52:47.777137       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs=map[IPv4:10.110.239.112]
	E0719 23:52:59.632999       1 handler_proxy.go:144] error resolving kube-system/metrics-server: service "metrics-server" not found
	W0719 23:52:59.633025       1 handler_proxy.go:100] no RequestInfo found in the context
	E0719 23:52:59.633127       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0719 23:52:59.633345       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0719 23:52:59.644822       1 controller.go:132] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
	I0719 23:53:00.589436       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0719 23:53:00.589576       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0719 23:53:00.607385       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0719 23:53:00.607444       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0719 23:53:00.626114       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0719 23:53:00.626159       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0719 23:53:00.637351       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0719 23:53:00.637404       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0719 23:53:00.658179       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0719 23:53:00.658240       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0719 23:53:00.669250       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0719 23:53:00.669311       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0719 23:53:00.739594       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0719 23:53:00.739874       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W0719 23:53:01.637543       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W0719 23:53:01.784046       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W0719 23:53:01.784047       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	
	* 
	* ==> kube-controller-manager [a296ec6cc5c1] <==
	* E0719 23:53:01.786961       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource
	W0719 23:53:02.663632       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:02.663668       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0719 23:53:02.754375       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:02.754412       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0719 23:53:03.204028       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:03.204068       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0719 23:53:04.998085       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-create
	I0719 23:53:05.006611       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-patch
	W0719 23:53:05.283452       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:05.283489       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0719 23:53:05.299336       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:05.299377       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0719 23:53:05.397031       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:05.397064       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0719 23:53:09.366924       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:09.366959       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0719 23:53:11.050953       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:11.050991       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0719 23:53:11.392646       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0719 23:53:11.392679       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0719 23:53:11.816465       1 shared_informer.go:311] Waiting for caches to sync for resource quota
	I0719 23:53:11.816597       1 shared_informer.go:318] Caches are synced for resource quota
	I0719 23:53:12.278356       1 shared_informer.go:311] Waiting for caches to sync for garbage collector
	I0719 23:53:12.278414       1 shared_informer.go:318] Caches are synced for garbage collector
	
	* 
	* ==> kube-proxy [01c3d18c74c1] <==
	* I0719 23:50:14.226144       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0719 23:50:14.226283       1 server_others.go:110] "Detected node IP" address="192.168.49.2"
	I0719 23:50:14.226303       1 server_others.go:554] "Using iptables proxy"
	I0719 23:50:14.264570       1 server_others.go:192] "Using iptables Proxier"
	I0719 23:50:14.264606       1 server_others.go:199] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0719 23:50:14.264614       1 server_others.go:200] "Creating dualStackProxier for iptables"
	I0719 23:50:14.264627       1 server_others.go:484] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, defaulting to no-op detect-local for IPv6"
	I0719 23:50:14.264694       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0719 23:50:14.267027       1 server.go:658] "Version info" version="v1.27.3"
	I0719 23:50:14.267047       1 server.go:660] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0719 23:50:14.272439       1 config.go:188] "Starting service config controller"
	I0719 23:50:14.272477       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0719 23:50:14.272524       1 config.go:97] "Starting endpoint slice config controller"
	I0719 23:50:14.272528       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0719 23:50:14.274596       1 config.go:315] "Starting node config controller"
	I0719 23:50:14.274612       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0719 23:50:14.372898       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0719 23:50:14.372946       1 shared_informer.go:318] Caches are synced for service config
	I0719 23:50:14.378039       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [0708c914920f] <==
	* W0719 23:49:57.457120       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0719 23:49:57.457201       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0719 23:49:57.457577       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0719 23:49:57.457672       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0719 23:49:57.457884       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0719 23:49:57.457948       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0719 23:49:57.458094       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0719 23:49:57.458142       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0719 23:49:57.458287       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0719 23:49:57.458371       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0719 23:49:57.458499       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0719 23:49:57.458607       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0719 23:49:57.459092       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0719 23:49:57.459230       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0719 23:49:57.465376       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0719 23:49:57.466476       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0719 23:49:57.465660       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0719 23:49:57.466543       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0719 23:49:57.465718       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0719 23:49:57.466557       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0719 23:49:57.465780       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0719 23:49:57.466570       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0719 23:49:57.469561       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0719 23:49:57.469588       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	I0719 23:49:58.552557       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Jul 19 23:53:01 addons-634197 kubelet[2336]: I0719 23:53:01.687287    2336 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=2baa1a88-72d9-4d49-810c-701c9b9d05a6 path="/var/lib/kubelet/pods/2baa1a88-72d9-4d49-810c-701c9b9d05a6/volumes"
	Jul 19 23:53:03 addons-634197 kubelet[2336]: I0719 23:53:03.686817    2336 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=c998da6e-2efa-4025-abbd-97715faab9bc path="/var/lib/kubelet/pods/c998da6e-2efa-4025-abbd-97715faab9bc/volumes"
	Jul 19 23:53:03 addons-634197 kubelet[2336]: I0719 23:53:03.782116    2336 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq8f5\" (UniqueName: \"kubernetes.io/projected/7d557699-0b8f-4412-80f4-ef9c9b4cda92-kube-api-access-vq8f5\") pod \"7d557699-0b8f-4412-80f4-ef9c9b4cda92\" (UID: \"7d557699-0b8f-4412-80f4-ef9c9b4cda92\") "
	Jul 19 23:53:03 addons-634197 kubelet[2336]: I0719 23:53:03.786441    2336 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d557699-0b8f-4412-80f4-ef9c9b4cda92-kube-api-access-vq8f5" (OuterVolumeSpecName: "kube-api-access-vq8f5") pod "7d557699-0b8f-4412-80f4-ef9c9b4cda92" (UID: "7d557699-0b8f-4412-80f4-ef9c9b4cda92"). InnerVolumeSpecName "kube-api-access-vq8f5". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 19 23:53:03 addons-634197 kubelet[2336]: I0719 23:53:03.882889    2336 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-vq8f5\" (UniqueName: \"kubernetes.io/projected/7d557699-0b8f-4412-80f4-ef9c9b4cda92-kube-api-access-vq8f5\") on node \"addons-634197\" DevicePath \"\""
	Jul 19 23:53:04 addons-634197 kubelet[2336]: I0719 23:53:04.286072    2336 scope.go:115] "RemoveContainer" containerID="ffcbc98b20229c4925afea3ba44e29149907d4068484f1e27570c2e0d41fa508"
	Jul 19 23:53:04 addons-634197 kubelet[2336]: I0719 23:53:04.678432    2336 scope.go:115] "RemoveContainer" containerID="c0ed2778118af2c184d1d1b94d212571315503e57d95d923460dc45ff1c2d5f4"
	Jul 19 23:53:05 addons-634197 kubelet[2336]: E0719 23:53:05.047908    2336 event.go:280] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7799c6795f-tqlxf.177369f4bbe5df52", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7799c6795f-tqlxf", UID:"b8e33042-7cc5-464f-ba4d-2ef10a011694", APIVersion:"v1", ResourceVersion:"646", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stopping container controller", Source:v1.EventSource{Componen
t:"kubelet", Host:"addons-634197"}, FirstTimestamp:time.Date(2023, time.July, 19, 23, 53, 5, 39408978, time.Local), LastTimestamp:time.Date(2023, time.July, 19, 23, 53, 5, 39408978, time.Local), Count:1, Type:"Normal", EventTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7799c6795f-tqlxf.177369f4bbe5df52" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 19 23:53:05 addons-634197 kubelet[2336]: I0719 23:53:05.312340    2336 scope.go:115] "RemoveContainer" containerID="c0ed2778118af2c184d1d1b94d212571315503e57d95d923460dc45ff1c2d5f4"
	Jul 19 23:53:05 addons-634197 kubelet[2336]: I0719 23:53:05.312634    2336 scope.go:115] "RemoveContainer" containerID="5e2379f57d69bc62e60979e932478d5742b29b15122ac7dc9e22fcc75b0d6ddf"
	Jul 19 23:53:05 addons-634197 kubelet[2336]: E0719 23:53:05.314261    2336 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 20s restarting failed container=hello-world-app pod=hello-world-app-65bdb79f98-scw24_default(83476790-5385-4219-8ef2-5e78b82e78b4)\"" pod="default/hello-world-app-65bdb79f98-scw24" podUID=83476790-5385-4219-8ef2-5e78b82e78b4
	Jul 19 23:53:05 addons-634197 kubelet[2336]: I0719 23:53:05.686507    2336 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=469d5bb9-46c9-4b04-862d-5079f99a22bc path="/var/lib/kubelet/pods/469d5bb9-46c9-4b04-862d-5079f99a22bc/volumes"
	Jul 19 23:53:05 addons-634197 kubelet[2336]: I0719 23:53:05.686959    2336 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=7d557699-0b8f-4412-80f4-ef9c9b4cda92 path="/var/lib/kubelet/pods/7d557699-0b8f-4412-80f4-ef9c9b4cda92/volumes"
	Jul 19 23:53:05 addons-634197 kubelet[2336]: I0719 23:53:05.687348    2336 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=bf149252-1c51-43e1-b001-a2fabe49e42f path="/var/lib/kubelet/pods/bf149252-1c51-43e1-b001-a2fabe49e42f/volumes"
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.342789    2336 scope.go:115] "RemoveContainer" containerID="2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3"
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.361695    2336 scope.go:115] "RemoveContainer" containerID="2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3"
	Jul 19 23:53:06 addons-634197 kubelet[2336]: E0719 23:53:06.362607    2336 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3" containerID="2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3"
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.362657    2336 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3} err="failed to get container status \"2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3\": rpc error: code = Unknown desc = Error response from daemon: No such container: 2676f7754627ccdea43c5577a1ba09fc2f75566771cbf22c5dbcae60f9ac77d3"
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.398855    2336 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8e33042-7cc5-464f-ba4d-2ef10a011694-webhook-cert\") pod \"b8e33042-7cc5-464f-ba4d-2ef10a011694\" (UID: \"b8e33042-7cc5-464f-ba4d-2ef10a011694\") "
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.398929    2336 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb64l\" (UniqueName: \"kubernetes.io/projected/b8e33042-7cc5-464f-ba4d-2ef10a011694-kube-api-access-zb64l\") pod \"b8e33042-7cc5-464f-ba4d-2ef10a011694\" (UID: \"b8e33042-7cc5-464f-ba4d-2ef10a011694\") "
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.402615    2336 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8e33042-7cc5-464f-ba4d-2ef10a011694-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b8e33042-7cc5-464f-ba4d-2ef10a011694" (UID: "b8e33042-7cc5-464f-ba4d-2ef10a011694"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.403764    2336 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e33042-7cc5-464f-ba4d-2ef10a011694-kube-api-access-zb64l" (OuterVolumeSpecName: "kube-api-access-zb64l") pod "b8e33042-7cc5-464f-ba4d-2ef10a011694" (UID: "b8e33042-7cc5-464f-ba4d-2ef10a011694"). InnerVolumeSpecName "kube-api-access-zb64l". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.500213    2336 reconciler_common.go:300] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8e33042-7cc5-464f-ba4d-2ef10a011694-webhook-cert\") on node \"addons-634197\" DevicePath \"\""
	Jul 19 23:53:06 addons-634197 kubelet[2336]: I0719 23:53:06.500258    2336 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-zb64l\" (UniqueName: \"kubernetes.io/projected/b8e33042-7cc5-464f-ba4d-2ef10a011694-kube-api-access-zb64l\") on node \"addons-634197\" DevicePath \"\""
	Jul 19 23:53:07 addons-634197 kubelet[2336]: I0719 23:53:07.686351    2336 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=b8e33042-7cc5-464f-ba4d-2ef10a011694 path="/var/lib/kubelet/pods/b8e33042-7cc5-464f-ba4d-2ef10a011694/volumes"
	
	* 
	* ==> storage-provisioner [3c1e8c7cdc36] <==
	* I0719 23:50:18.912816       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0719 23:50:18.943595       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0719 23:50:18.943682       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0719 23:50:18.975786       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0719 23:50:18.975956       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-634197_c2d5aa6a-5117-483f-a957-0f049a59275b!
	I0719 23:50:18.985517       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"93ae56b0-2b9a-469c-839a-e314d9bf2dde", APIVersion:"v1", ResourceVersion:"594", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-634197_c2d5aa6a-5117-483f-a957-0f049a59275b became leader
	I0719 23:50:19.076765       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-634197_c2d5aa6a-5117-483f-a957-0f049a59275b!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-634197 -n addons-634197
helpers_test.go:261: (dbg) Run:  kubectl --context addons-634197 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (37.87s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (57.23s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-520951 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:183: (dbg) Done: kubectl --context ingress-addon-legacy-520951 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (13.481052948s)
addons_test.go:208: (dbg) Run:  kubectl --context ingress-addon-legacy-520951 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context ingress-addon-legacy-520951 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [a2bdf530-7e60-4817-a03e-b824530ed005] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [a2bdf530-7e60-4817-a03e-b824530ed005] Running
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 9.013251836s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-520951 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context ingress-addon-legacy-520951 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-520951 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.024590194s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-520951 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-520951 addons disable ingress-dns --alsologtostderr -v=1: (8.60773744s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-520951 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-520951 addons disable ingress --alsologtostderr -v=1: (7.509727132s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-520951
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-520951:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0d3998b7f76f69d4afae7b2b96b9d4a4685356eefb0c2dac0af2a04829c3775b",
	        "Created": "2023-07-19T23:59:03.657850172Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 526803,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-19T23:59:03.997652384Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:f52519afe5f6d6f3ce84cbd7f651b1292638d32ca98ee43d88f2d69e113e44de",
	        "ResolvConfPath": "/var/lib/docker/containers/0d3998b7f76f69d4afae7b2b96b9d4a4685356eefb0c2dac0af2a04829c3775b/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0d3998b7f76f69d4afae7b2b96b9d4a4685356eefb0c2dac0af2a04829c3775b/hostname",
	        "HostsPath": "/var/lib/docker/containers/0d3998b7f76f69d4afae7b2b96b9d4a4685356eefb0c2dac0af2a04829c3775b/hosts",
	        "LogPath": "/var/lib/docker/containers/0d3998b7f76f69d4afae7b2b96b9d4a4685356eefb0c2dac0af2a04829c3775b/0d3998b7f76f69d4afae7b2b96b9d4a4685356eefb0c2dac0af2a04829c3775b-json.log",
	        "Name": "/ingress-addon-legacy-520951",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ingress-addon-legacy-520951:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "ingress-addon-legacy-520951",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/d31b7aadb5394514c536e2979f99e45592cb5b8419d64d8a189ba9c5f3dfe4ea-init/diff:/var/lib/docker/overlay2/91062a1696abf51e43ba788b12e4bc3e8b35395a23d1306c55e792c6df8f8ca8/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d31b7aadb5394514c536e2979f99e45592cb5b8419d64d8a189ba9c5f3dfe4ea/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d31b7aadb5394514c536e2979f99e45592cb5b8419d64d8a189ba9c5f3dfe4ea/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d31b7aadb5394514c536e2979f99e45592cb5b8419d64d8a189ba9c5f3dfe4ea/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-520951",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-520951/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-520951",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-520951",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-520951",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "3973eb2948a8b60a62c8d94dd951d1a52e9dfb77625ca9552ba954337b7a5d9b",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33396"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33395"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33392"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33394"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33393"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/3973eb2948a8",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-520951": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "0d3998b7f76f",
	                        "ingress-addon-legacy-520951"
	                    ],
	                    "NetworkID": "4d144f252665c7bc17483e5d6c5f252909155d4df31b2c3958f5f07aa52be9c6",
	                    "EndpointID": "9b3bfab136ce70472f2a991d283303f16411811d0d55d1b10857c214af4f6a73",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p ingress-addon-legacy-520951 -n ingress-addon-legacy-520951
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-520951 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-520951 logs -n 25: (1.026626699s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	|    Command     |                   Args                   |           Profile           |  User   | Version |     Start Time      |      End Time       |
	|----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| mount          | -p functional-275751                     | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:57 UTC |                     |
	|                | --kill=true                              |                             |         |         |                     |                     |
	| update-context | functional-275751                        | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:57 UTC | 19 Jul 23 23:57 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| update-context | functional-275751                        | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:57 UTC | 19 Jul 23 23:57 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| update-context | functional-275751                        | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:57 UTC | 19 Jul 23 23:57 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| image          | functional-275751                        | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:57 UTC | 19 Jul 23 23:57 UTC |
	|                | image ls --format short                  |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| image          | functional-275751                        | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:57 UTC | 19 Jul 23 23:57 UTC |
	|                | image ls --format yaml                   |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| ssh            | functional-275751 ssh pgrep              | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:57 UTC |                     |
	|                | buildkitd                                |                             |         |         |                     |                     |
	| image          | functional-275751 image build -t         | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:57 UTC | 19 Jul 23 23:58 UTC |
	|                | localhost/my-image:functional-275751     |                             |         |         |                     |                     |
	|                | testdata/build --alsologtostderr         |                             |         |         |                     |                     |
	| image          | functional-275751 image ls               | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	| image          | functional-275751                        | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	|                | image ls --format json                   |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| image          | functional-275751                        | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	|                | image ls --format table                  |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| delete         | -p functional-275751                     | functional-275751           | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	| start          | -p image-127799                          | image-127799                | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	|                | --driver=docker                          |                             |         |         |                     |                     |
	|                | --container-runtime=docker               |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-127799                | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	|                | ./testdata/image-build/test-normal       |                             |         |         |                     |                     |
	|                | -p image-127799                          |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-127799                | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	|                | --build-opt=build-arg=ENV_A=test_env_str |                             |         |         |                     |                     |
	|                | --build-opt=no-cache                     |                             |         |         |                     |                     |
	|                | ./testdata/image-build/test-arg -p       |                             |         |         |                     |                     |
	|                | image-127799                             |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-127799                | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	|                | ./testdata/image-build/test-normal       |                             |         |         |                     |                     |
	|                | --build-opt=no-cache -p                  |                             |         |         |                     |                     |
	|                | image-127799                             |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-127799                | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	|                | -f inner/Dockerfile                      |                             |         |         |                     |                     |
	|                | ./testdata/image-build/test-f            |                             |         |         |                     |                     |
	|                | -p image-127799                          |                             |         |         |                     |                     |
	| delete         | -p image-127799                          | image-127799                | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 19 Jul 23 23:58 UTC |
	| start          | -p ingress-addon-legacy-520951           | ingress-addon-legacy-520951 | jenkins | v1.31.0 | 19 Jul 23 23:58 UTC | 20 Jul 23 00:00 UTC |
	|                | --kubernetes-version=v1.18.20            |                             |         |         |                     |                     |
	|                | --memory=4096 --wait=true                |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	|                | -v=5 --driver=docker                     |                             |         |         |                     |                     |
	|                | --container-runtime=docker               |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-520951              | ingress-addon-legacy-520951 | jenkins | v1.31.0 | 20 Jul 23 00:00 UTC | 20 Jul 23 00:00 UTC |
	|                | addons enable ingress                    |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-520951              | ingress-addon-legacy-520951 | jenkins | v1.31.0 | 20 Jul 23 00:00 UTC | 20 Jul 23 00:00 UTC |
	|                | addons enable ingress-dns                |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |
	| ssh            | ingress-addon-legacy-520951              | ingress-addon-legacy-520951 | jenkins | v1.31.0 | 20 Jul 23 00:00 UTC | 20 Jul 23 00:00 UTC |
	|                | ssh curl -s http://127.0.0.1/            |                             |         |         |                     |                     |
	|                | -H 'Host: nginx.example.com'             |                             |         |         |                     |                     |
	| ip             | ingress-addon-legacy-520951 ip           | ingress-addon-legacy-520951 | jenkins | v1.31.0 | 20 Jul 23 00:00 UTC | 20 Jul 23 00:00 UTC |
	| addons         | ingress-addon-legacy-520951              | ingress-addon-legacy-520951 | jenkins | v1.31.0 | 20 Jul 23 00:00 UTC | 20 Jul 23 00:01 UTC |
	|                | addons disable ingress-dns               |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-520951              | ingress-addon-legacy-520951 | jenkins | v1.31.0 | 20 Jul 23 00:01 UTC | 20 Jul 23 00:01 UTC |
	|                | addons disable ingress                   |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |
	|----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/19 23:58:48
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0719 23:58:48.352464  526347 out.go:296] Setting OutFile to fd 1 ...
	I0719 23:58:48.352651  526347 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:58:48.352659  526347 out.go:309] Setting ErrFile to fd 2...
	I0719 23:58:48.352665  526347 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:58:48.352935  526347 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	I0719 23:58:48.353348  526347 out.go:303] Setting JSON to false
	I0719 23:58:48.354250  526347 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":13274,"bootTime":1689797855,"procs":206,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0719 23:58:48.354322  526347 start.go:138] virtualization:  
	I0719 23:58:48.356906  526347 out.go:177] * [ingress-addon-legacy-520951] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0719 23:58:48.359243  526347 out.go:177]   - MINIKUBE_LOCATION=15585
	I0719 23:58:48.361058  526347 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0719 23:58:48.359468  526347 notify.go:220] Checking for updates...
	I0719 23:58:48.364073  526347 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0719 23:58:48.365785  526347 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	I0719 23:58:48.367398  526347 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0719 23:58:48.368970  526347 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0719 23:58:48.370695  526347 driver.go:373] Setting default libvirt URI to qemu:///system
	I0719 23:58:48.395323  526347 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0719 23:58:48.395425  526347 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:58:48.470768  526347 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-07-19 23:58:48.461388896 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:58:48.470869  526347 docker.go:294] overlay module found
	I0719 23:58:48.473624  526347 out.go:177] * Using the docker driver based on user configuration
	I0719 23:58:48.475413  526347 start.go:298] selected driver: docker
	I0719 23:58:48.475442  526347 start.go:880] validating driver "docker" against <nil>
	I0719 23:58:48.475455  526347 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0719 23:58:48.476121  526347 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:58:48.546262  526347 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-07-19 23:58:48.537107887 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:58:48.546444  526347 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0719 23:58:48.546696  526347 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0719 23:58:48.548444  526347 out.go:177] * Using Docker driver with root privileges
	I0719 23:58:48.549937  526347 cni.go:84] Creating CNI manager for ""
	I0719 23:58:48.549962  526347 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0719 23:58:48.549976  526347 start_flags.go:319] config:
	{Name:ingress-addon-legacy-520951 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-520951 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:doc
ker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:58:48.551980  526347 out.go:177] * Starting control plane node ingress-addon-legacy-520951 in cluster ingress-addon-legacy-520951
	I0719 23:58:48.553617  526347 cache.go:122] Beginning downloading kic base image for docker with docker
	I0719 23:58:48.555439  526347 out.go:177] * Pulling base image ...
	I0719 23:58:48.556944  526347 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0719 23:58:48.556994  526347 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0719 23:58:48.574162  526347 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon, skipping pull
	I0719 23:58:48.574183  526347 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in daemon, skipping load
	I0719 23:58:48.630494  526347 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I0719 23:58:48.630535  526347 cache.go:57] Caching tarball of preloaded images
	I0719 23:58:48.630687  526347 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0719 23:58:48.632567  526347 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I0719 23:58:48.634225  526347 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0719 23:58:48.756035  526347 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4?checksum=md5:c8c260b886393123ce9d312d8ac2379e -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I0719 23:58:56.356437  526347 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0719 23:58:56.356538  526347 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0719 23:58:57.434417  526347 cache.go:60] Finished verifying existence of preloaded tar for  v1.18.20 on docker
	I0719 23:58:57.434791  526347 profile.go:148] Saving config to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/config.json ...
	I0719 23:58:57.434825  526347 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/config.json: {Name:mkc74a5e238b8423f8e7100d87c14f6b9742267c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:58:57.435012  526347 cache.go:195] Successfully downloaded all kic artifacts
	I0719 23:58:57.435072  526347 start.go:365] acquiring machines lock for ingress-addon-legacy-520951: {Name:mk1b23545cbf390f11ef2bf32745468a4d996919 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0719 23:58:57.435128  526347 start.go:369] acquired machines lock for "ingress-addon-legacy-520951" in 42.608µs
	I0719 23:58:57.435152  526347 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-520951 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-520951 Namespace:default APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0719 23:58:57.435226  526347 start.go:125] createHost starting for "" (driver="docker")
	I0719 23:58:57.438438  526347 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I0719 23:58:57.438707  526347 start.go:159] libmachine.API.Create for "ingress-addon-legacy-520951" (driver="docker")
	I0719 23:58:57.438736  526347 client.go:168] LocalClient.Create starting
	I0719 23:58:57.438830  526347 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem
	I0719 23:58:57.438869  526347 main.go:141] libmachine: Decoding PEM data...
	I0719 23:58:57.438889  526347 main.go:141] libmachine: Parsing certificate...
	I0719 23:58:57.438956  526347 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem
	I0719 23:58:57.438979  526347 main.go:141] libmachine: Decoding PEM data...
	I0719 23:58:57.438995  526347 main.go:141] libmachine: Parsing certificate...
	I0719 23:58:57.439333  526347 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-520951 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0719 23:58:57.456003  526347 cli_runner.go:211] docker network inspect ingress-addon-legacy-520951 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0719 23:58:57.456076  526347 network_create.go:281] running [docker network inspect ingress-addon-legacy-520951] to gather additional debugging logs...
	I0719 23:58:57.456097  526347 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-520951
	W0719 23:58:57.474832  526347 cli_runner.go:211] docker network inspect ingress-addon-legacy-520951 returned with exit code 1
	I0719 23:58:57.474867  526347 network_create.go:284] error running [docker network inspect ingress-addon-legacy-520951]: docker network inspect ingress-addon-legacy-520951: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-520951 not found
	I0719 23:58:57.474880  526347 network_create.go:286] output of [docker network inspect ingress-addon-legacy-520951]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-520951 not found
	
	** /stderr **
	I0719 23:58:57.474954  526347 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0719 23:58:57.493022  526347 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000f3a890}
	I0719 23:58:57.493062  526347 network_create.go:123] attempt to create docker network ingress-addon-legacy-520951 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0719 23:58:57.493117  526347 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-520951 ingress-addon-legacy-520951
	I0719 23:58:57.567558  526347 network_create.go:107] docker network ingress-addon-legacy-520951 192.168.49.0/24 created
	I0719 23:58:57.567588  526347 kic.go:117] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-520951" container
	I0719 23:58:57.567658  526347 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0719 23:58:57.586730  526347 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-520951 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-520951 --label created_by.minikube.sigs.k8s.io=true
	I0719 23:58:57.605253  526347 oci.go:103] Successfully created a docker volume ingress-addon-legacy-520951
	I0719 23:58:57.605338  526347 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-520951-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-520951 --entrypoint /usr/bin/test -v ingress-addon-legacy-520951:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib
	I0719 23:58:58.897836  526347 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-520951-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-520951 --entrypoint /usr/bin/test -v ingress-addon-legacy-520951:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib: (1.292441692s)
	I0719 23:58:58.897865  526347 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-520951
	I0719 23:58:58.897889  526347 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0719 23:58:58.897908  526347 kic.go:190] Starting extracting preloaded images to volume ...
	I0719 23:58:58.898020  526347 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-520951:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir
	I0719 23:59:03.567430  526347 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-520951:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir: (4.669364885s)
	I0719 23:59:03.567463  526347 kic.go:199] duration metric: took 4.669551 seconds to extract preloaded images to volume
	W0719 23:59:03.567601  526347 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0719 23:59:03.567720  526347 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0719 23:59:03.641516  526347 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-520951 --name ingress-addon-legacy-520951 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-520951 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-520951 --network ingress-addon-legacy-520951 --ip 192.168.49.2 --volume ingress-addon-legacy-520951:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631
	I0719 23:59:04.008628  526347 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-520951 --format={{.State.Running}}
	I0719 23:59:04.035348  526347 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-520951 --format={{.State.Status}}
	I0719 23:59:04.059093  526347 cli_runner.go:164] Run: docker exec ingress-addon-legacy-520951 stat /var/lib/dpkg/alternatives/iptables
	I0719 23:59:04.151143  526347 oci.go:144] the created container "ingress-addon-legacy-520951" has a running status.
	I0719 23:59:04.151170  526347 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa...
	I0719 23:59:04.934254  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0719 23:59:04.934356  526347 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0719 23:59:04.989211  526347 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-520951 --format={{.State.Status}}
	I0719 23:59:05.021324  526347 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0719 23:59:05.021346  526347 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-520951 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0719 23:59:05.127839  526347 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-520951 --format={{.State.Status}}
	I0719 23:59:05.170247  526347 machine.go:88] provisioning docker machine ...
	I0719 23:59:05.170276  526347 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-520951"
	I0719 23:59:05.170342  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:05.198990  526347 main.go:141] libmachine: Using SSH client type: native
	I0719 23:59:05.199448  526347 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33396 <nil> <nil>}
	I0719 23:59:05.199461  526347 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-520951 && echo "ingress-addon-legacy-520951" | sudo tee /etc/hostname
	I0719 23:59:05.354727  526347 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-520951
	
	I0719 23:59:05.354863  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:05.376091  526347 main.go:141] libmachine: Using SSH client type: native
	I0719 23:59:05.376526  526347 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33396 <nil> <nil>}
	I0719 23:59:05.376550  526347 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-520951' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-520951/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-520951' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0719 23:59:05.524518  526347 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0719 23:59:05.524546  526347 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/15585-475114/.minikube CaCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/15585-475114/.minikube}
	I0719 23:59:05.524570  526347 ubuntu.go:177] setting up certificates
	I0719 23:59:05.524584  526347 provision.go:83] configureAuth start
	I0719 23:59:05.524663  526347 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-520951
	I0719 23:59:05.543221  526347 provision.go:138] copyHostCerts
	I0719 23:59:05.543265  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/15585-475114/.minikube/ca.pem
	I0719 23:59:05.543299  526347 exec_runner.go:144] found /home/jenkins/minikube-integration/15585-475114/.minikube/ca.pem, removing ...
	I0719 23:59:05.543310  526347 exec_runner.go:203] rm: /home/jenkins/minikube-integration/15585-475114/.minikube/ca.pem
	I0719 23:59:05.543389  526347 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/ca.pem (1082 bytes)
	I0719 23:59:05.543476  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/15585-475114/.minikube/cert.pem
	I0719 23:59:05.543497  526347 exec_runner.go:144] found /home/jenkins/minikube-integration/15585-475114/.minikube/cert.pem, removing ...
	I0719 23:59:05.543501  526347 exec_runner.go:203] rm: /home/jenkins/minikube-integration/15585-475114/.minikube/cert.pem
	I0719 23:59:05.543533  526347 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/cert.pem (1123 bytes)
	I0719 23:59:05.543581  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/15585-475114/.minikube/key.pem
	I0719 23:59:05.543608  526347 exec_runner.go:144] found /home/jenkins/minikube-integration/15585-475114/.minikube/key.pem, removing ...
	I0719 23:59:05.543616  526347 exec_runner.go:203] rm: /home/jenkins/minikube-integration/15585-475114/.minikube/key.pem
	I0719 23:59:05.543651  526347 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/key.pem (1679 bytes)
	I0719 23:59:05.543698  526347 provision.go:112] generating server cert: /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-520951 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-520951]
	I0719 23:59:05.741191  526347 provision.go:172] copyRemoteCerts
	I0719 23:59:05.741283  526347 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0719 23:59:05.741328  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:05.759013  526347 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33396 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa Username:docker}
	I0719 23:59:05.854682  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0719 23:59:05.854743  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0719 23:59:05.884002  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0719 23:59:05.884080  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0719 23:59:05.914193  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0719 23:59:05.914253  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)
	I0719 23:59:05.943169  526347 provision.go:86] duration metric: configureAuth took 418.567343ms
	I0719 23:59:05.943196  526347 ubuntu.go:193] setting minikube options for container-runtime
	I0719 23:59:05.943389  526347 config.go:182] Loaded profile config "ingress-addon-legacy-520951": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I0719 23:59:05.943452  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:05.963501  526347 main.go:141] libmachine: Using SSH client type: native
	I0719 23:59:05.963953  526347 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33396 <nil> <nil>}
	I0719 23:59:05.963970  526347 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0719 23:59:06.100636  526347 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0719 23:59:06.100656  526347 ubuntu.go:71] root file system type: overlay
	I0719 23:59:06.100787  526347 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0719 23:59:06.100858  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:06.126567  526347 main.go:141] libmachine: Using SSH client type: native
	I0719 23:59:06.127102  526347 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33396 <nil> <nil>}
	I0719 23:59:06.127199  526347 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0719 23:59:06.274152  526347 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0719 23:59:06.274235  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:06.296236  526347 main.go:141] libmachine: Using SSH client type: native
	I0719 23:59:06.296713  526347 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33396 <nil> <nil>}
	I0719 23:59:06.296739  526347 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0719 23:59:07.096456  526347 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-07-07 14:51:01.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-07-19 23:59:06.268296249 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0719 23:59:07.096493  526347 machine.go:91] provisioned docker machine in 1.926227267s
	I0719 23:59:07.096504  526347 client.go:171] LocalClient.Create took 9.657762675s
	I0719 23:59:07.096520  526347 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-520951" took 9.657810879s
	I0719 23:59:07.096532  526347 start.go:300] post-start starting for "ingress-addon-legacy-520951" (driver="docker")
	I0719 23:59:07.096541  526347 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0719 23:59:07.096608  526347 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0719 23:59:07.096657  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:07.114414  526347 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33396 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa Username:docker}
	I0719 23:59:07.209132  526347 ssh_runner.go:195] Run: cat /etc/os-release
	I0719 23:59:07.213111  526347 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0719 23:59:07.213147  526347 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0719 23:59:07.213158  526347 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0719 23:59:07.213165  526347 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0719 23:59:07.213174  526347 filesync.go:126] Scanning /home/jenkins/minikube-integration/15585-475114/.minikube/addons for local assets ...
	I0719 23:59:07.213239  526347 filesync.go:126] Scanning /home/jenkins/minikube-integration/15585-475114/.minikube/files for local assets ...
	I0719 23:59:07.213319  526347 filesync.go:149] local asset: /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/4805052.pem -> 4805052.pem in /etc/ssl/certs
	I0719 23:59:07.213331  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/4805052.pem -> /etc/ssl/certs/4805052.pem
	I0719 23:59:07.213433  526347 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0719 23:59:07.223582  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/4805052.pem --> /etc/ssl/certs/4805052.pem (1708 bytes)
	I0719 23:59:07.251517  526347 start.go:303] post-start completed in 154.971469ms
	I0719 23:59:07.251882  526347 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-520951
	I0719 23:59:07.271358  526347 profile.go:148] Saving config to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/config.json ...
	I0719 23:59:07.271641  526347 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0719 23:59:07.271692  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:07.289500  526347 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33396 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa Username:docker}
	I0719 23:59:07.380941  526347 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0719 23:59:07.386608  526347 start.go:128] duration metric: createHost completed in 9.951367285s
	I0719 23:59:07.386635  526347 start.go:83] releasing machines lock for "ingress-addon-legacy-520951", held for 9.951493314s
	I0719 23:59:07.386711  526347 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-520951
	I0719 23:59:07.406477  526347 ssh_runner.go:195] Run: cat /version.json
	I0719 23:59:07.406493  526347 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0719 23:59:07.406557  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:07.406639  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:07.429970  526347 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33396 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa Username:docker}
	I0719 23:59:07.430353  526347 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33396 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa Username:docker}
	I0719 23:59:07.519375  526347 ssh_runner.go:195] Run: systemctl --version
	I0719 23:59:07.669143  526347 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0719 23:59:07.675272  526347 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0719 23:59:07.705617  526347 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0719 23:59:07.705709  526347 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0719 23:59:07.725453  526347 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0719 23:59:07.745376  526347 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0719 23:59:07.745406  526347 start.go:466] detecting cgroup driver to use...
	I0719 23:59:07.745437  526347 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0719 23:59:07.745566  526347 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0719 23:59:07.765059  526347 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0719 23:59:07.776747  526347 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0719 23:59:07.789201  526347 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0719 23:59:07.789270  526347 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0719 23:59:07.801476  526347 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0719 23:59:07.813808  526347 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0719 23:59:07.825882  526347 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0719 23:59:07.837740  526347 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0719 23:59:07.848704  526347 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0719 23:59:07.860440  526347 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0719 23:59:07.870935  526347 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0719 23:59:07.881014  526347 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0719 23:59:07.980200  526347 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0719 23:59:08.088012  526347 start.go:466] detecting cgroup driver to use...
	I0719 23:59:08.088104  526347 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0719 23:59:08.088196  526347 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0719 23:59:08.110304  526347 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0719 23:59:08.110420  526347 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0719 23:59:08.125813  526347 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock
	" | sudo tee /etc/crictl.yaml"
	I0719 23:59:08.147575  526347 ssh_runner.go:195] Run: which cri-dockerd
	I0719 23:59:08.152314  526347 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0719 23:59:08.164438  526347 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0719 23:59:08.186663  526347 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0719 23:59:08.295578  526347 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0719 23:59:08.408140  526347 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0719 23:59:08.408171  526347 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0719 23:59:08.431245  526347 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0719 23:59:08.544550  526347 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0719 23:59:08.818627  526347 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0719 23:59:08.846260  526347 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0719 23:59:08.875013  526347 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 24.0.4 ...
	I0719 23:59:08.875142  526347 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-520951 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0719 23:59:08.892645  526347 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0719 23:59:08.897325  526347 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0719 23:59:08.911279  526347 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0719 23:59:08.911353  526347 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0719 23:59:08.933417  526347 docker.go:636] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I0719 23:59:08.933438  526347 docker.go:642] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I0719 23:59:08.933490  526347 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0719 23:59:08.944189  526347 ssh_runner.go:195] Run: which lz4
	I0719 23:59:08.948560  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4
	I0719 23:59:08.948654  526347 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0719 23:59:08.952909  526347 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0719 23:59:08.952944  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (459739018 bytes)
	I0719 23:59:11.058213  526347 docker.go:600] Took 2.109590 seconds to copy over tarball
	I0719 23:59:11.058330  526347 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0719 23:59:13.521618  526347 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.463257996s)
	I0719 23:59:13.521642  526347 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0719 23:59:13.602998  526347 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0719 23:59:13.613717  526347 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)
	I0719 23:59:13.634588  526347 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0719 23:59:13.730811  526347 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0719 23:59:15.221286  526347 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.490436067s)
	I0719 23:59:15.221389  526347 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0719 23:59:15.243002  526347 docker.go:636] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I0719 23:59:15.243023  526347 docker.go:642] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I0719 23:59:15.243030  526347 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0719 23:59:15.244480  526347 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0719 23:59:15.244687  526347 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I0719 23:59:15.244841  526347 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I0719 23:59:15.244906  526347 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I0719 23:59:15.245097  526347 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I0719 23:59:15.245177  526347 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0719 23:59:15.245227  526347 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I0719 23:59:15.245377  526347 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I0719 23:59:15.245983  526347 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I0719 23:59:15.246354  526347 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	I0719 23:59:15.246664  526347 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	I0719 23:59:15.246886  526347 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0719 23:59:15.247195  526347 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I0719 23:59:15.247363  526347 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I0719 23:59:15.248203  526347 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0719 23:59:15.248454  526347 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	W0719 23:59:15.691962  526347 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0719 23:59:15.692134  526347 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20
	I0719 23:59:15.701253  526347 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2
	W0719 23:59:15.703840  526347 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing
	I0719 23:59:15.704022  526347 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0
	W0719 23:59:15.708658  526347 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0719 23:59:15.708805  526347 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20
	W0719 23:59:15.722549  526347 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0719 23:59:15.722701  526347 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20
	I0719 23:59:15.728056  526347 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime
	I0719 23:59:15.728101  526347 docker.go:316] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0719 23:59:15.728155  526347 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I0719 23:59:15.746324  526347 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime
	I0719 23:59:15.746375  526347 docker.go:316] Removing image: registry.k8s.io/etcd:3.4.3-0
	I0719 23:59:15.746423  526347 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0
	I0719 23:59:15.747569  526347 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime
	I0719 23:59:15.747604  526347 docker.go:316] Removing image: registry.k8s.io/pause:3.2
	I0719 23:59:15.747640  526347 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2
	I0719 23:59:15.768188  526347 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime
	I0719 23:59:15.768235  526347 docker.go:316] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I0719 23:59:15.768287  526347 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20
	W0719 23:59:15.773959  526347 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing
	I0719 23:59:15.774141  526347 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7
	W0719 23:59:15.780226  526347 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0719 23:59:15.780476  526347 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20
	I0719 23:59:15.802911  526347 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20
	I0719 23:59:15.803121  526347 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime
	I0719 23:59:15.803158  526347 docker.go:316] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I0719 23:59:15.803205  526347 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20
	I0719 23:59:15.815282  526347 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0
	I0719 23:59:15.822704  526347 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2
	I0719 23:59:15.863920  526347 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime
	I0719 23:59:15.863956  526347 docker.go:316] Removing image: registry.k8s.io/coredns:1.6.7
	I0719 23:59:15.863993  526347 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime
	I0719 23:59:15.864003  526347 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7
	I0719 23:59:15.864016  526347 docker.go:316] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I0719 23:59:15.863927  526347 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20
	I0719 23:59:15.864053  526347 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20
	I0719 23:59:15.872725  526347 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20
	W0719 23:59:15.879691  526347 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0719 23:59:15.879859  526347 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0719 23:59:15.899688  526347 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7
	I0719 23:59:15.900001  526347 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20
	I0719 23:59:15.912218  526347 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0719 23:59:15.912263  526347 docker.go:316] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0719 23:59:15.912309  526347 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0719 23:59:15.950231  526347 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0719 23:59:15.950369  526347 cache_images.go:92] LoadImages completed in 707.326866ms
	W0719 23:59:15.950447  526347 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20: no such file or directory
	I0719 23:59:15.950583  526347 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0719 23:59:16.017045  526347 cni.go:84] Creating CNI manager for ""
	I0719 23:59:16.017083  526347 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0719 23:59:16.017093  526347 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0719 23:59:16.017112  526347 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-520951 NodeName:ingress-addon-legacy-520951 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.
crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0719 23:59:16.017269  526347 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /var/run/dockershim.sock
	  name: "ingress-addon-legacy-520951"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0719 23:59:16.017345  526347 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-520951 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-520951 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0719 23:59:16.017416  526347 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I0719 23:59:16.028992  526347 binaries.go:44] Found k8s binaries, skipping transfer
	I0719 23:59:16.029060  526347 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0719 23:59:16.039248  526347 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (354 bytes)
	I0719 23:59:16.059866  526347 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I0719 23:59:16.080787  526347 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2124 bytes)
	I0719 23:59:16.101577  526347 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0719 23:59:16.105851  526347 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0719 23:59:16.118776  526347 certs.go:56] Setting up /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951 for IP: 192.168.49.2
	I0719 23:59:16.118808  526347 certs.go:190] acquiring lock for shared ca certs: {Name:mk12f0b6d33973829acc3e8320bcb5c1c1ccc407 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:16.118956  526347 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/15585-475114/.minikube/ca.key
	I0719 23:59:16.119001  526347 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.key
	I0719 23:59:16.119048  526347 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.key
	I0719 23:59:16.119057  526347 crypto.go:68] Generating cert /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt with IP's: []
	I0719 23:59:16.279527  526347 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt ...
	I0719 23:59:16.279559  526347 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: {Name:mkb18476b1162ba19836fe91afd0d834060a0fa5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:16.279749  526347 crypto.go:164] Writing key to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.key ...
	I0719 23:59:16.279761  526347 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.key: {Name:mk2ec6ef843b2f4e208e86f69ae9199684044c0d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:16.279853  526347 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.key.dd3b5fb2
	I0719 23:59:16.279870  526347 crypto.go:68] Generating cert /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0719 23:59:16.547528  526347 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.crt.dd3b5fb2 ...
	I0719 23:59:16.547557  526347 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.crt.dd3b5fb2: {Name:mk6f08d1ac0e514e8bb2ad29d620a0a78077e5b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:16.547731  526347 crypto.go:164] Writing key to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.key.dd3b5fb2 ...
	I0719 23:59:16.547741  526347 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.key.dd3b5fb2: {Name:mkb6ddf81f7cdcfdf68df1b2a96a3ce596d72330 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:16.547829  526347 certs.go:337] copying /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.crt
	I0719 23:59:16.547900  526347 certs.go:341] copying /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.key
	I0719 23:59:16.547960  526347 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.key
	I0719 23:59:16.547975  526347 crypto.go:68] Generating cert /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.crt with IP's: []
	I0719 23:59:17.848624  526347 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.crt ...
	I0719 23:59:17.848657  526347 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.crt: {Name:mka7682e01b2989777f8af5206890e82686ed6e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:17.848842  526347 crypto.go:164] Writing key to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.key ...
	I0719 23:59:17.848859  526347 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.key: {Name:mkf5490ee4b808fb226f09cbb8e9c6af50691f50 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:17.848945  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0719 23:59:17.848970  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0719 23:59:17.848985  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0719 23:59:17.849007  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0719 23:59:17.849023  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0719 23:59:17.849038  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0719 23:59:17.849053  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0719 23:59:17.849065  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0719 23:59:17.849123  526347 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/480505.pem (1338 bytes)
	W0719 23:59:17.849163  526347 certs.go:433] ignoring /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/480505_empty.pem, impossibly tiny 0 bytes
	I0719 23:59:17.849176  526347 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca-key.pem (1679 bytes)
	I0719 23:59:17.849210  526347 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem (1082 bytes)
	I0719 23:59:17.849239  526347 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem (1123 bytes)
	I0719 23:59:17.849268  526347 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem (1679 bytes)
	I0719 23:59:17.849316  526347 certs.go:437] found cert: /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/4805052.pem (1708 bytes)
	I0719 23:59:17.849348  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/480505.pem -> /usr/share/ca-certificates/480505.pem
	I0719 23:59:17.849365  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/4805052.pem -> /usr/share/ca-certificates/4805052.pem
	I0719 23:59:17.849383  526347 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0719 23:59:17.849923  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0719 23:59:17.879654  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0719 23:59:17.907828  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0719 23:59:17.936340  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0719 23:59:17.963981  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0719 23:59:17.992008  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0719 23:59:18.025703  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0719 23:59:18.057190  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0719 23:59:18.088609  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/certs/480505.pem --> /usr/share/ca-certificates/480505.pem (1338 bytes)
	I0719 23:59:18.120508  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/4805052.pem --> /usr/share/ca-certificates/4805052.pem (1708 bytes)
	I0719 23:59:18.150359  526347 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0719 23:59:18.179064  526347 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0719 23:59:18.200022  526347 ssh_runner.go:195] Run: openssl version
	I0719 23:59:18.207086  526347 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/480505.pem && ln -fs /usr/share/ca-certificates/480505.pem /etc/ssl/certs/480505.pem"
	I0719 23:59:18.219152  526347 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/480505.pem
	I0719 23:59:18.223816  526347 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Jul 19 23:54 /usr/share/ca-certificates/480505.pem
	I0719 23:59:18.223885  526347 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/480505.pem
	I0719 23:59:18.232490  526347 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/480505.pem /etc/ssl/certs/51391683.0"
	I0719 23:59:18.244268  526347 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4805052.pem && ln -fs /usr/share/ca-certificates/4805052.pem /etc/ssl/certs/4805052.pem"
	I0719 23:59:18.255984  526347 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4805052.pem
	I0719 23:59:18.260472  526347 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Jul 19 23:54 /usr/share/ca-certificates/4805052.pem
	I0719 23:59:18.260579  526347 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4805052.pem
	I0719 23:59:18.268992  526347 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/4805052.pem /etc/ssl/certs/3ec20f2e.0"
	I0719 23:59:18.280215  526347 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0719 23:59:18.291706  526347 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0719 23:59:18.296419  526347 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 19 23:49 /usr/share/ca-certificates/minikubeCA.pem
	I0719 23:59:18.296491  526347 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0719 23:59:18.304805  526347 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0719 23:59:18.316066  526347 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0719 23:59:18.320302  526347 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0719 23:59:18.320373  526347 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-520951 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-520951 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMe
trics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:59:18.320510  526347 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0719 23:59:18.339917  526347 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0719 23:59:18.350334  526347 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0719 23:59:18.361163  526347 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0719 23:59:18.361276  526347 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0719 23:59:18.371674  526347 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0719 23:59:18.371718  526347 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0719 23:59:18.428129  526347 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I0719 23:59:18.428392  526347 kubeadm.go:322] [preflight] Running pre-flight checks
	I0719 23:59:18.645724  526347 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0719 23:59:18.645820  526347 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1039-aws
	I0719 23:59:18.645884  526347 kubeadm.go:322] DOCKER_VERSION: 24.0.4
	I0719 23:59:18.645922  526347 kubeadm.go:322] OS: Linux
	I0719 23:59:18.645970  526347 kubeadm.go:322] CGROUPS_CPU: enabled
	I0719 23:59:18.646019  526347 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0719 23:59:18.646070  526347 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0719 23:59:18.646119  526347 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0719 23:59:18.646176  526347 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0719 23:59:18.646224  526347 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0719 23:59:18.735565  526347 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0719 23:59:18.735671  526347 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0719 23:59:18.735765  526347 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0719 23:59:18.948395  526347 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0719 23:59:18.950102  526347 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0719 23:59:18.950196  526347 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0719 23:59:19.060661  526347 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0719 23:59:19.067811  526347 out.go:204]   - Generating certificates and keys ...
	I0719 23:59:19.067973  526347 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0719 23:59:19.068094  526347 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0719 23:59:19.539066  526347 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0719 23:59:19.757719  526347 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0719 23:59:20.030110  526347 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0719 23:59:20.269828  526347 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0719 23:59:20.638812  526347 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0719 23:59:20.639202  526347 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-520951 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0719 23:59:21.143139  526347 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0719 23:59:21.143542  526347 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-520951 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0719 23:59:21.569432  526347 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0719 23:59:22.501092  526347 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0719 23:59:22.842311  526347 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0719 23:59:22.842634  526347 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0719 23:59:23.075416  526347 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0719 23:59:23.316532  526347 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0719 23:59:23.911654  526347 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0719 23:59:24.375779  526347 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0719 23:59:24.376753  526347 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0719 23:59:24.378954  526347 out.go:204]   - Booting up control plane ...
	I0719 23:59:24.379069  526347 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0719 23:59:24.393999  526347 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0719 23:59:24.394110  526347 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0719 23:59:24.394202  526347 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0719 23:59:24.399381  526347 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0719 23:59:36.902657  526347 kubeadm.go:322] [apiclient] All control plane components are healthy after 12.503129 seconds
	I0719 23:59:36.902771  526347 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0719 23:59:36.916071  526347 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I0719 23:59:37.437178  526347 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0719 23:59:37.437321  526347 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-520951 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I0719 23:59:37.945796  526347 kubeadm.go:322] [bootstrap-token] Using token: 1rxyyb.jtlk0uh18zegq433
	I0719 23:59:37.947940  526347 out.go:204]   - Configuring RBAC rules ...
	I0719 23:59:37.948058  526347 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0719 23:59:37.964709  526347 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0719 23:59:37.973584  526347 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0719 23:59:37.976788  526347 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0719 23:59:37.980081  526347 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0719 23:59:37.983211  526347 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0719 23:59:37.999792  526347 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0719 23:59:38.355779  526347 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0719 23:59:38.439306  526347 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0719 23:59:38.439325  526347 kubeadm.go:322] 
	I0719 23:59:38.439382  526347 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0719 23:59:38.439386  526347 kubeadm.go:322] 
	I0719 23:59:38.439458  526347 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0719 23:59:38.439463  526347 kubeadm.go:322] 
	I0719 23:59:38.439487  526347 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0719 23:59:38.439542  526347 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0719 23:59:38.439590  526347 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0719 23:59:38.439594  526347 kubeadm.go:322] 
	I0719 23:59:38.439643  526347 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0719 23:59:38.439713  526347 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0719 23:59:38.439777  526347 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0719 23:59:38.439782  526347 kubeadm.go:322] 
	I0719 23:59:38.439861  526347 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0719 23:59:38.439933  526347 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0719 23:59:38.439938  526347 kubeadm.go:322] 
	I0719 23:59:38.440019  526347 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 1rxyyb.jtlk0uh18zegq433 \
	I0719 23:59:38.440119  526347 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:02308911837873b6bc537b1e28367e4f116caaff34a3a3a2b7529aa2ff1345f5 \
	I0719 23:59:38.440141  526347 kubeadm.go:322]     --control-plane 
	I0719 23:59:38.440146  526347 kubeadm.go:322] 
	I0719 23:59:38.440225  526347 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0719 23:59:38.440230  526347 kubeadm.go:322] 
	I0719 23:59:38.440306  526347 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 1rxyyb.jtlk0uh18zegq433 \
	I0719 23:59:38.440405  526347 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:02308911837873b6bc537b1e28367e4f116caaff34a3a3a2b7529aa2ff1345f5 
	I0719 23:59:38.443546  526347 kubeadm.go:322] W0719 23:59:18.427204    1659 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I0719 23:59:38.443807  526347 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
	I0719 23:59:38.443970  526347 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.4. Latest validated version: 19.03
	I0719 23:59:38.444208  526347 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1039-aws\n", err: exit status 1
	I0719 23:59:38.444349  526347 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0719 23:59:38.444506  526347 kubeadm.go:322] W0719 23:59:24.384985    1659 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0719 23:59:38.444697  526347 kubeadm.go:322] W0719 23:59:24.387891    1659 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0719 23:59:38.444731  526347 cni.go:84] Creating CNI manager for ""
	I0719 23:59:38.444756  526347 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0719 23:59:38.444865  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:38.444964  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.31.0 minikube.k8s.io/commit=fd270bde4b7e946c995f2329996587ae45fe53d4 minikube.k8s.io/name=ingress-addon-legacy-520951 minikube.k8s.io/updated_at=2023_07_19T23_59_38_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:38.445030  526347 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0719 23:59:39.105721  526347 ops.go:34] apiserver oom_adj: -16
	I0719 23:59:39.105804  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:39.702638  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:40.202290  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:40.702340  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:41.203061  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:41.702093  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:42.202650  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:42.702629  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:43.202101  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:43.702109  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:44.202641  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:44.703042  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:45.202295  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:45.702311  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:46.202855  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:46.702917  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:47.202748  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:47.702565  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:48.202411  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:48.702310  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:49.202629  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:49.702157  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:50.202901  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:50.702075  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:51.202363  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:51.702282  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:52.202465  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:52.702100  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:53.202750  526347 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0719 23:59:53.371780  526347 kubeadm.go:1081] duration metric: took 14.926967463s to wait for elevateKubeSystemPrivileges.
	I0719 23:59:53.371812  526347 kubeadm.go:406] StartCluster complete in 35.051440972s
	I0719 23:59:53.371828  526347 settings.go:142] acquiring lock: {Name:mk41fff0c17add5da17be8845b4b2b979fdedd20 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:53.371888  526347 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0719 23:59:53.372658  526347 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/kubeconfig: {Name:mk1d564203301f80896734e3ac033e5a4f1a12de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:59:53.373349  526347 kapi.go:59] client config for ingress-addon-legacy-520951: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt", KeyFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.key", CAFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6940), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0719 23:59:53.374858  526347 config.go:182] Loaded profile config "ingress-addon-legacy-520951": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I0719 23:59:53.374916  526347 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0719 23:59:53.375067  526347 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
	I0719 23:59:53.375139  526347 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-520951"
	I0719 23:59:53.375161  526347 addons.go:231] Setting addon storage-provisioner=true in "ingress-addon-legacy-520951"
	I0719 23:59:53.375262  526347 host.go:66] Checking if "ingress-addon-legacy-520951" exists ...
	I0719 23:59:53.375721  526347 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-520951 --format={{.State.Status}}
	I0719 23:59:53.376036  526347 cert_rotation.go:137] Starting client certificate rotation controller
	I0719 23:59:53.376603  526347 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-520951"
	I0719 23:59:53.376627  526347 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-520951"
	I0719 23:59:53.376894  526347 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-520951 --format={{.State.Status}}
	I0719 23:59:53.425384  526347 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0719 23:59:53.427092  526347 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0719 23:59:53.427117  526347 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0719 23:59:53.427183  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:53.443344  526347 kapi.go:59] client config for ingress-addon-legacy-520951: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt", KeyFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.key", CAFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6940), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0719 23:59:53.445881  526347 addons.go:231] Setting addon default-storageclass=true in "ingress-addon-legacy-520951"
	I0719 23:59:53.445925  526347 host.go:66] Checking if "ingress-addon-legacy-520951" exists ...
	I0719 23:59:53.446387  526347 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-520951 --format={{.State.Status}}
	I0719 23:59:53.466433  526347 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33396 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa Username:docker}
	I0719 23:59:53.477745  526347 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0719 23:59:53.477765  526347 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0719 23:59:53.477830  526347 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-520951
	I0719 23:59:53.506852  526347 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33396 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/ingress-addon-legacy-520951/id_rsa Username:docker}
	I0719 23:59:53.586180  526347 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0719 23:59:53.651511  526347 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0719 23:59:53.703757  526347 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0719 23:59:53.984730  526347 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-520951" context rescaled to 1 replicas
	I0719 23:59:53.984770  526347 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0719 23:59:53.986872  526347 out.go:177] * Verifying Kubernetes components...
	I0719 23:59:53.988713  526347 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0719 23:59:54.212358  526347 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0719 23:59:54.368527  526347 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
	I0719 23:59:54.367138  526347 kapi.go:59] client config for ingress-addon-legacy-520951: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt", KeyFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.key", CAFile:"/home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6940), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0719 23:59:54.370682  526347 addons.go:502] enable addons completed in 995.597779ms: enabled=[default-storageclass storage-provisioner]
	I0719 23:59:54.370934  526347 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-520951" to be "Ready" ...
	I0719 23:59:54.374345  526347 node_ready.go:49] node "ingress-addon-legacy-520951" has status "Ready":"True"
	I0719 23:59:54.374410  526347 node_ready.go:38] duration metric: took 3.450082ms waiting for node "ingress-addon-legacy-520951" to be "Ready" ...
	I0719 23:59:54.374436  526347 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0719 23:59:54.383736  526347 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-k827s" in "kube-system" namespace to be "Ready" ...
	I0719 23:59:56.401613  526347 pod_ready.go:102] pod "coredns-66bff467f8-k827s" in "kube-system" namespace has status "Ready":"False"
	I0719 23:59:58.896284  526347 pod_ready.go:102] pod "coredns-66bff467f8-k827s" in "kube-system" namespace has status "Ready":"False"
	I0720 00:00:00.897265  526347 pod_ready.go:102] pod "coredns-66bff467f8-k827s" in "kube-system" namespace has status "Ready":"False"
	I0720 00:00:01.397428  526347 pod_ready.go:92] pod "coredns-66bff467f8-k827s" in "kube-system" namespace has status "Ready":"True"
	I0720 00:00:01.397454  526347 pod_ready.go:81] duration metric: took 7.013646344s waiting for pod "coredns-66bff467f8-k827s" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.397466  526347 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-520951" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.403253  526347 pod_ready.go:92] pod "etcd-ingress-addon-legacy-520951" in "kube-system" namespace has status "Ready":"True"
	I0720 00:00:01.403281  526347 pod_ready.go:81] duration metric: took 5.807859ms waiting for pod "etcd-ingress-addon-legacy-520951" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.403293  526347 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-520951" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.409890  526347 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-520951" in "kube-system" namespace has status "Ready":"True"
	I0720 00:00:01.409939  526347 pod_ready.go:81] duration metric: took 6.637019ms waiting for pod "kube-apiserver-ingress-addon-legacy-520951" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.409952  526347 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-520951" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.416188  526347 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-520951" in "kube-system" namespace has status "Ready":"True"
	I0720 00:00:01.416214  526347 pod_ready.go:81] duration metric: took 6.254599ms waiting for pod "kube-controller-manager-ingress-addon-legacy-520951" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.416227  526347 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tp6rf" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.422091  526347 pod_ready.go:92] pod "kube-proxy-tp6rf" in "kube-system" namespace has status "Ready":"True"
	I0720 00:00:01.422113  526347 pod_ready.go:81] duration metric: took 5.87912ms waiting for pod "kube-proxy-tp6rf" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.422125  526347 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-520951" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.592200  526347 request.go:628] Waited for 169.994668ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-520951
	I0720 00:00:01.792282  526347 request.go:628] Waited for 191.418802ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-520951
	I0720 00:00:01.796041  526347 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-520951" in "kube-system" namespace has status "Ready":"True"
	I0720 00:00:01.796072  526347 pod_ready.go:81] duration metric: took 373.935534ms waiting for pod "kube-scheduler-ingress-addon-legacy-520951" in "kube-system" namespace to be "Ready" ...
	I0720 00:00:01.796109  526347 pod_ready.go:38] duration metric: took 7.421646861s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0720 00:00:01.796140  526347 api_server.go:52] waiting for apiserver process to appear ...
	I0720 00:00:01.796218  526347 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0720 00:00:01.812389  526347 api_server.go:72] duration metric: took 7.827584679s to wait for apiserver process to appear ...
	I0720 00:00:01.812418  526347 api_server.go:88] waiting for apiserver healthz status ...
	I0720 00:00:01.812436  526347 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0720 00:00:01.822116  526347 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0720 00:00:01.828183  526347 api_server.go:141] control plane version: v1.18.20
	I0720 00:00:01.828211  526347 api_server.go:131] duration metric: took 15.786456ms to wait for apiserver health ...
	I0720 00:00:01.828221  526347 system_pods.go:43] waiting for kube-system pods to appear ...
	I0720 00:00:01.991676  526347 request.go:628] Waited for 163.363244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0720 00:00:01.998705  526347 system_pods.go:59] 7 kube-system pods found
	I0720 00:00:01.998744  526347 system_pods.go:61] "coredns-66bff467f8-k827s" [7bc617dd-7548-4ea3-bfa1-dd7403da66ab] Running
	I0720 00:00:01.998757  526347 system_pods.go:61] "etcd-ingress-addon-legacy-520951" [87236f09-2f57-4bf1-839f-e04c45a28552] Running
	I0720 00:00:01.998763  526347 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-520951" [e3bb7074-9ef2-4616-a2f8-2d1f00c60236] Running
	I0720 00:00:01.998769  526347 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-520951" [4353a532-485a-41da-8a5c-72cccea869cf] Running
	I0720 00:00:01.998773  526347 system_pods.go:61] "kube-proxy-tp6rf" [51838fb4-d096-4600-9ca9-e12bfaa1c7b0] Running
	I0720 00:00:01.998779  526347 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-520951" [e0afcecd-9515-4455-8b2a-ab82e0ce4fe3] Running
	I0720 00:00:01.998785  526347 system_pods.go:61] "storage-provisioner" [ffe4ca66-9f93-43f1-a6c8-63b7b43e592c] Running
	I0720 00:00:01.998791  526347 system_pods.go:74] duration metric: took 170.564615ms to wait for pod list to return data ...
	I0720 00:00:01.998801  526347 default_sa.go:34] waiting for default service account to be created ...
	I0720 00:00:02.191254  526347 request.go:628] Waited for 192.3464ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I0720 00:00:02.193785  526347 default_sa.go:45] found service account: "default"
	I0720 00:00:02.193812  526347 default_sa.go:55] duration metric: took 194.999485ms for default service account to be created ...
	I0720 00:00:02.193824  526347 system_pods.go:116] waiting for k8s-apps to be running ...
	I0720 00:00:02.391211  526347 request.go:628] Waited for 197.300572ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0720 00:00:02.397233  526347 system_pods.go:86] 7 kube-system pods found
	I0720 00:00:02.397266  526347 system_pods.go:89] "coredns-66bff467f8-k827s" [7bc617dd-7548-4ea3-bfa1-dd7403da66ab] Running
	I0720 00:00:02.397275  526347 system_pods.go:89] "etcd-ingress-addon-legacy-520951" [87236f09-2f57-4bf1-839f-e04c45a28552] Running
	I0720 00:00:02.397281  526347 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-520951" [e3bb7074-9ef2-4616-a2f8-2d1f00c60236] Running
	I0720 00:00:02.397286  526347 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-520951" [4353a532-485a-41da-8a5c-72cccea869cf] Running
	I0720 00:00:02.397291  526347 system_pods.go:89] "kube-proxy-tp6rf" [51838fb4-d096-4600-9ca9-e12bfaa1c7b0] Running
	I0720 00:00:02.397305  526347 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-520951" [e0afcecd-9515-4455-8b2a-ab82e0ce4fe3] Running
	I0720 00:00:02.397315  526347 system_pods.go:89] "storage-provisioner" [ffe4ca66-9f93-43f1-a6c8-63b7b43e592c] Running
	I0720 00:00:02.397322  526347 system_pods.go:126] duration metric: took 203.491467ms to wait for k8s-apps to be running ...
	I0720 00:00:02.397333  526347 system_svc.go:44] waiting for kubelet service to be running ....
	I0720 00:00:02.397426  526347 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0720 00:00:02.413439  526347 system_svc.go:56] duration metric: took 16.095566ms WaitForService to wait for kubelet.
	I0720 00:00:02.413467  526347 kubeadm.go:581] duration metric: took 8.428669393s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0720 00:00:02.413506  526347 node_conditions.go:102] verifying NodePressure condition ...
	I0720 00:00:02.591932  526347 request.go:628] Waited for 178.335203ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I0720 00:00:02.595126  526347 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0720 00:00:02.595158  526347 node_conditions.go:123] node cpu capacity is 2
	I0720 00:00:02.595170  526347 node_conditions.go:105] duration metric: took 181.650304ms to run NodePressure ...
	I0720 00:00:02.595217  526347 start.go:228] waiting for startup goroutines ...
	I0720 00:00:02.595232  526347 start.go:233] waiting for cluster config update ...
	I0720 00:00:02.595243  526347 start.go:242] writing updated cluster config ...
	I0720 00:00:02.595554  526347 ssh_runner.go:195] Run: rm -f paused
	I0720 00:00:02.658918  526347 start.go:578] kubectl: 1.27.4, cluster: 1.18.20 (minor skew: 9)
	I0720 00:00:02.661523  526347 out.go:177] 
	W0720 00:00:02.663299  526347 out.go:239] ! /usr/local/bin/kubectl is version 1.27.4, which may have incompatibilities with Kubernetes 1.18.20.
	I0720 00:00:02.665488  526347 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I0720 00:00:02.667648  526347 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-520951" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Jul 19 23:59:15 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-19T23:59:15.187163107Z" level=info msg="Daemon has completed initialization"
	Jul 19 23:59:15 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-19T23:59:15.218135715Z" level=info msg="API listen on /var/run/docker.sock"
	Jul 19 23:59:15 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-19T23:59:15.219249656Z" level=info msg="API listen on [::]:2376"
	Jul 19 23:59:15 ingress-addon-legacy-520951 systemd[1]: Started Docker Application Container Engine.
	Jul 20 00:00:04 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:04.363162443Z" level=warning msg="reference for unknown type: " digest="sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7" remote="docker.io/jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7"
	Jul 20 00:00:07 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:07.296510573Z" level=info msg="ignoring event" container=fb968ca972dfdd83381b24aa12618721bb5d69c13707cf8a8fd85142ad224f0d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:07 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:07.327838369Z" level=info msg="ignoring event" container=74951ea77e379366393bd9c87c9ad60b8afcf7ab5ef7d276b45e7776f0ae72d7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:07 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:07.509340005Z" level=info msg="ignoring event" container=4ec1f02dc1ac1b438a4b8d51eb9a3e451a1e1d6f7fcc7eaade913eac424c0495 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:07 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:07.701316932Z" level=info msg="ignoring event" container=f32ec391a511dc1508ef4d9b56a1dd534156c28758efa4e02a6d1372072f5c4a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:08 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:08.007595185Z" level=warning msg="reference for unknown type: " digest="sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324" remote="registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324"
	Jul 20 00:00:08 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:08.534284538Z" level=info msg="ignoring event" container=24d27412c23dd9eb4f74b36ef70055516f7d001e0143f1cf62fef6064bdeaf11 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:14 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:14.707656249Z" level=warning msg="Published ports are discarded when using host network mode"
	Jul 20 00:00:14 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:14.729097811Z" level=warning msg="Published ports are discarded when using host network mode"
	Jul 20 00:00:14 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:14.896723560Z" level=warning msg="reference for unknown type: " digest="sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" remote="docker.io/cryptexlabs/minikube-ingress-dns@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab"
	Jul 20 00:00:21 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:21.183363641Z" level=info msg="ignoring event" container=960170857f2d94cd2c0db48f7c0296aa79c137e758d0937edd71234d8c8e71dc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:21 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:21.792376907Z" level=info msg="ignoring event" container=6c41e1c3c5d9214d8b3f861b20414a698c543ccc031a0ed3229e3591bfcbdbf0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:38 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:38.314676874Z" level=info msg="ignoring event" container=e3a579adce54a526a45a3c3cc13acbb204102c702f22998c1398f07cf3aa2bcf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:40 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:40.764307678Z" level=info msg="ignoring event" container=941306e52191597217650976d1aae2bd60bb1ae26dd908ead991011ba4dfd5c1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:41 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:41.014596651Z" level=info msg="ignoring event" container=e34e19911379bff7206a586c627b6d3cbdfd8965238ec3a6bec11ebbe09d5405 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:54 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:54.134608284Z" level=info msg="ignoring event" container=33571d62ffda039eb7afc2d4a6b3265d9d8ef12bbe6572078b8b96245314c642 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:00:56 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:00:56.229953889Z" level=info msg="ignoring event" container=9ed19a3c42846cb0294cf819094cddafd5cdf075bf3e02f8a624c3a965eef9f6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:01:04 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:01:04.992436585Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=d602e82664fe7355b7a9e3d8590a4b707e1e33654f35b3cc4ef9fa14ae5a08df
	Jul 20 00:01:05 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:01:05.011932945Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=d602e82664fe7355b7a9e3d8590a4b707e1e33654f35b3cc4ef9fa14ae5a08df
	Jul 20 00:01:05 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:01:05.075521754Z" level=info msg="ignoring event" container=d602e82664fe7355b7a9e3d8590a4b707e1e33654f35b3cc4ef9fa14ae5a08df module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 20 00:01:05 ingress-addon-legacy-520951 dockerd[1302]: time="2023-07-20T00:01:05.134144788Z" level=info msg="ignoring event" container=678a2a6acae2eb012e62612d5a16ea022c6c3835aa78cf439f34dea9f3fd68c0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                              CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	9ed19a3c42846       13753a81eccfd                                                                                                      14 seconds ago       Exited              hello-world-app           2                   1633b02488e34       hello-world-app-5f5d8b66bb-4bs69
	ded955d81e11f       nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6                                      40 seconds ago       Running             nginx                     0                   9b62df9a55467       nginx
	d602e82664fe7       registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324   58 seconds ago       Exited              controller                0                   678a2a6acae2e       ingress-nginx-controller-7fcf777cb7-2jbfm
	f32ec391a511d       a883f7fc35610                                                                                                      About a minute ago   Exited              patch                     1                   24d27412c23dd       ingress-nginx-admission-patch-d2pmq
	74951ea77e379       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              create                    0                   4ec1f02dc1ac1       ingress-nginx-admission-create-mvzfj
	776b85442d73f       gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944    About a minute ago   Running             storage-provisioner       0                   57b0b201c7aba       storage-provisioner
	58ea21c457edd       6e17ba78cf3eb                                                                                                      About a minute ago   Running             coredns                   0                   5ecc1deb3c7b8       coredns-66bff467f8-k827s
	33f37bfd10400       565297bc6f7d4                                                                                                      About a minute ago   Running             kube-proxy                0                   e1a3006b4e8c9       kube-proxy-tp6rf
	bb687427bfa40       ab707b0a0ea33                                                                                                      About a minute ago   Running             etcd                      0                   7c6ad72db5ac9       etcd-ingress-addon-legacy-520951
	f073435c2d09b       095f37015706d                                                                                                      About a minute ago   Running             kube-scheduler            0                   bc368039c9f9c       kube-scheduler-ingress-addon-legacy-520951
	c621c18f3b83b       68a4fac29a865                                                                                                      About a minute ago   Running             kube-controller-manager   0                   1858de8247501       kube-controller-manager-ingress-addon-legacy-520951
	b8d713a0aad53       2694cf044d665                                                                                                      About a minute ago   Running             kube-apiserver            0                   79b3d0e0993a0       kube-apiserver-ingress-addon-legacy-520951
	
	* 
	* ==> coredns [58ea21c457ed] <==
	* [INFO] 172.17.0.1:8654 - 25461 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000047318s
	[INFO] 172.17.0.1:8654 - 62788 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000659801s
	[INFO] 172.17.0.1:3528 - 53754 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002043179s
	[INFO] 172.17.0.1:3528 - 62554 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001801146s
	[INFO] 172.17.0.1:8654 - 48989 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001767884s
	[INFO] 172.17.0.1:3528 - 40761 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000123872s
	[INFO] 172.17.0.1:8654 - 20019 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000036102s
	[INFO] 172.17.0.1:22003 - 48699 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000102424s
	[INFO] 172.17.0.1:40324 - 62336 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000038605s
	[INFO] 172.17.0.1:40324 - 48980 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000111925s
	[INFO] 172.17.0.1:22003 - 35407 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000098305s
	[INFO] 172.17.0.1:40324 - 59526 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000037809s
	[INFO] 172.17.0.1:22003 - 51 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000076053s
	[INFO] 172.17.0.1:40324 - 21826 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000036808s
	[INFO] 172.17.0.1:22003 - 63338 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000043577s
	[INFO] 172.17.0.1:40324 - 50807 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000032935s
	[INFO] 172.17.0.1:22003 - 10996 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00003529s
	[INFO] 172.17.0.1:40324 - 3268 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00003373s
	[INFO] 172.17.0.1:22003 - 27888 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000039064s
	[INFO] 172.17.0.1:40324 - 39620 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00152407s
	[INFO] 172.17.0.1:22003 - 35746 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00160082s
	[INFO] 172.17.0.1:40324 - 55857 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000853579s
	[INFO] 172.17.0.1:40324 - 61954 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.001115968s
	[INFO] 172.17.0.1:22003 - 6298 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001649575s
	[INFO] 172.17.0.1:22003 - 9123 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000094981s
	
	* 
	* ==> describe nodes <==
	* Name:               ingress-addon-legacy-520951
	Roles:              master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=ingress-addon-legacy-520951
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=fd270bde4b7e946c995f2329996587ae45fe53d4
	                    minikube.k8s.io/name=ingress-addon-legacy-520951
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_07_19T23_59_38_0700
	                    minikube.k8s.io/version=v1.31.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 19 Jul 2023 23:59:35 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-520951
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 20 Jul 2023 00:01:01 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 20 Jul 2023 00:00:42 +0000   Wed, 19 Jul 2023 23:59:29 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 20 Jul 2023 00:00:42 +0000   Wed, 19 Jul 2023 23:59:29 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 20 Jul 2023 00:00:42 +0000   Wed, 19 Jul 2023 23:59:29 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 20 Jul 2023 00:00:42 +0000   Wed, 19 Jul 2023 23:59:52 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-520951
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	System Info:
	  Machine ID:                 b4eef397c551407e80a98360c64dfb9a
	  System UUID:                41af65f7-5fcd-4a0e-b7e0-1f7cd6fa5d41
	  Boot ID:                    4b2b6d1f-58cb-4234-92d6-a62bd4106387
	  Kernel Version:             5.15.0-1039-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.4
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-4bs69                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         32s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         42s
	  kube-system                 coredns-66bff467f8-k827s                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     77s
	  kube-system                 etcd-ingress-addon-legacy-520951                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 kube-apiserver-ingress-addon-legacy-520951             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-520951    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 kube-proxy-tp6rf                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         77s
	  kube-system                 kube-scheduler-ingress-addon-legacy-520951             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         76s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)
	  memory             70Mi (0%!)(MISSING)   170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From        Message
	  ----    ------                   ----                 ----        -------
	  Normal  NodeHasSufficientMemory  103s (x5 over 103s)  kubelet     Node ingress-addon-legacy-520951 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    103s (x4 over 103s)  kubelet     Node ingress-addon-legacy-520951 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     103s (x4 over 103s)  kubelet     Node ingress-addon-legacy-520951 status is now: NodeHasSufficientPID
	  Normal  Starting                 89s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  88s                  kubelet     Node ingress-addon-legacy-520951 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    88s                  kubelet     Node ingress-addon-legacy-520951 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     88s                  kubelet     Node ingress-addon-legacy-520951 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  88s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                78s                  kubelet     Node ingress-addon-legacy-520951 status is now: NodeReady
	  Normal  Starting                 76s                  kube-proxy  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +0.001020] FS-Cache: O-key=[8] '525f3b0000000000'
	[  +0.000720] FS-Cache: N-cookie c=00000030 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000941] FS-Cache: N-cookie d=00000000759abd80{9p.inode} n=00000000a956ee04
	[  +0.001018] FS-Cache: N-key=[8] '525f3b0000000000'
	[  +0.003469] FS-Cache: Duplicate cookie detected
	[  +0.000689] FS-Cache: O-cookie c=0000002a [p=00000027 fl=226 nc=0 na=1]
	[  +0.000936] FS-Cache: O-cookie d=00000000759abd80{9p.inode} n=00000000d95a16bd
	[  +0.001097] FS-Cache: O-key=[8] '525f3b0000000000'
	[  +0.000733] FS-Cache: N-cookie c=00000031 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000970] FS-Cache: N-cookie d=00000000759abd80{9p.inode} n=00000000a41b9c05
	[  +0.001057] FS-Cache: N-key=[8] '525f3b0000000000'
	[  +2.362835] FS-Cache: Duplicate cookie detected
	[  +0.000731] FS-Cache: O-cookie c=00000028 [p=00000027 fl=226 nc=0 na=1]
	[  +0.000957] FS-Cache: O-cookie d=00000000759abd80{9p.inode} n=000000007b372e9c
	[  +0.001090] FS-Cache: O-key=[8] '515f3b0000000000'
	[  +0.000710] FS-Cache: N-cookie c=00000033 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000927] FS-Cache: N-cookie d=00000000759abd80{9p.inode} n=00000000f1a9e770
	[  +0.001059] FS-Cache: N-key=[8] '515f3b0000000000'
	[  +0.290146] FS-Cache: Duplicate cookie detected
	[  +0.000738] FS-Cache: O-cookie c=0000002d [p=00000027 fl=226 nc=0 na=1]
	[  +0.000929] FS-Cache: O-cookie d=00000000759abd80{9p.inode} n=00000000b4a8c09e
	[  +0.001081] FS-Cache: O-key=[8] '575f3b0000000000'
	[  +0.000730] FS-Cache: N-cookie c=00000034 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000947] FS-Cache: N-cookie d=00000000759abd80{9p.inode} n=00000000b1b9429b
	[  +0.000991] FS-Cache: N-key=[8] '575f3b0000000000'
	
	* 
	* ==> etcd [bb687427bfa4] <==
	* raft2023/07/19 23:59:30 INFO: aec36adc501070cc became follower at term 0
	raft2023/07/19 23:59:30 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	raft2023/07/19 23:59:30 INFO: aec36adc501070cc became follower at term 1
	raft2023/07/19 23:59:30 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-07-19 23:59:30.141592 W | auth: simple token is not cryptographically signed
	2023-07-19 23:59:30.147221 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	2023-07-19 23:59:30.155952 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2023-07-19 23:59:30.156122 I | embed: listening for metrics on http://127.0.0.1:2381
	2023-07-19 23:59:30.156317 I | embed: listening for peers on 192.168.49.2:2380
	2023-07-19 23:59:30.156526 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	raft2023/07/19 23:59:30 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-07-19 23:59:30.156827 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	raft2023/07/19 23:59:30 INFO: aec36adc501070cc is starting a new election at term 1
	raft2023/07/19 23:59:30 INFO: aec36adc501070cc became candidate at term 2
	raft2023/07/19 23:59:30 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2023/07/19 23:59:30 INFO: aec36adc501070cc became leader at term 2
	raft2023/07/19 23:59:30 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2023-07-19 23:59:30.631557 I | etcdserver: setting up the initial cluster version to 3.4
	2023-07-19 23:59:30.632434 I | etcdserver: published {Name:ingress-addon-legacy-520951 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2023-07-19 23:59:30.639289 N | etcdserver/membership: set the initial cluster version to 3.4
	2023-07-19 23:59:30.639466 I | etcdserver/api: enabled capabilities for version 3.4
	2023-07-19 23:59:30.639531 I | embed: ready to serve client requests
	2023-07-19 23:59:30.640946 I | embed: serving client requests on 127.0.0.1:2379
	2023-07-19 23:59:30.641360 I | embed: ready to serve client requests
	2023-07-19 23:59:30.642671 I | embed: serving client requests on 192.168.49.2:2379
	
	* 
	* ==> kernel <==
	*  00:01:10 up  3:43,  0 users,  load average: 1.00, 1.85, 2.01
	Linux ingress-addon-legacy-520951 5.15.0-1039-aws #44~20.04.1-Ubuntu SMP Thu Jun 22 12:21:08 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kube-apiserver [b8d713a0aad5] <==
	* E0719 23:59:35.285658       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.49.2, ResourceVersion: 0, AdditionalErrorMsg: 
	I0719 23:59:35.319532       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I0719 23:59:35.319657       1 cache.go:39] Caches are synced for autoregister controller
	I0719 23:59:35.320037       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I0719 23:59:35.323444       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0719 23:59:35.323476       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0719 23:59:36.107195       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0719 23:59:36.107464       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0719 23:59:36.138087       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I0719 23:59:36.147647       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I0719 23:59:36.147671       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I0719 23:59:36.595397       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0719 23:59:36.633036       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0719 23:59:36.767549       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0719 23:59:36.768727       1 controller.go:609] quota admission added evaluator for: endpoints
	I0719 23:59:36.773219       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0719 23:59:37.553317       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I0719 23:59:38.311065       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I0719 23:59:38.398851       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I0719 23:59:41.942700       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I0719 23:59:53.760636       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I0719 23:59:53.781037       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I0720 00:00:03.576887       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I0720 00:00:28.252938       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	E0720 00:01:02.993623       1 authentication.go:53] Unable to authenticate the request due to an error: [invalid bearer token, Token has been invalidated]
	
	* 
	* ==> kube-controller-manager [c621c18f3b83] <==
	* I0719 23:59:53.777228       1 shared_informer.go:230] Caches are synced for PVC protection 
	I0719 23:59:53.786498       1 shared_informer.go:230] Caches are synced for disruption 
	I0719 23:59:53.786553       1 disruption.go:339] Sending events to api server.
	I0719 23:59:53.786811       1 shared_informer.go:230] Caches are synced for taint 
	I0719 23:59:53.786909       1 node_lifecycle_controller.go:1433] Initializing eviction metric for zone: 
	W0719 23:59:53.786951       1 node_lifecycle_controller.go:1048] Missing timestamp for Node ingress-addon-legacy-520951. Assuming now as a timestamp.
	I0719 23:59:53.786990       1 node_lifecycle_controller.go:1249] Controller detected that zone  is now in state Normal.
	I0719 23:59:53.787028       1 event.go:278] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"ingress-addon-legacy-520951", UID:"731a5f40-64da-4bba-bdc7-a22aba1e2584", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node ingress-addon-legacy-520951 event: Registered Node ingress-addon-legacy-520951 in Controller
	I0719 23:59:53.787515       1 taint_manager.go:187] Starting NoExecuteTaintManager
	I0719 23:59:53.802251       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0719 23:59:53.802290       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0719 23:59:53.803431       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"0dbeabe7-486d-4a95-8534-69eda750c228", APIVersion:"apps/v1", ResourceVersion:"324", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-66bff467f8 to 1
	I0719 23:59:53.805887       1 shared_informer.go:230] Caches are synced for endpoint_slice 
	I0719 23:59:53.816744       1 shared_informer.go:230] Caches are synced for resource quota 
	I0719 23:59:53.854147       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0719 23:59:53.896345       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"de877464-c014-4dbe-b1f0-61f01f588961", APIVersion:"apps/v1", ResourceVersion:"331", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-66bff467f8-k827s
	I0720 00:00:03.557526       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"3608cd20-8fe7-46ef-a427-6943901c3e24", APIVersion:"apps/v1", ResourceVersion:"426", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I0720 00:00:03.590461       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"972b8c2a-6e6c-4514-8507-b2e97d9cf028", APIVersion:"apps/v1", ResourceVersion:"427", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-2jbfm
	I0720 00:00:03.617829       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"4c168aa1-d18e-4e66-80ed-fe4d37540740", APIVersion:"batch/v1", ResourceVersion:"432", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-mvzfj
	I0720 00:00:03.692211       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"f096fe58-29ff-441f-8b2f-e18225094ace", APIVersion:"batch/v1", ResourceVersion:"442", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-d2pmq
	I0720 00:00:07.461065       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"4c168aa1-d18e-4e66-80ed-fe4d37540740", APIVersion:"batch/v1", ResourceVersion:"443", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0720 00:00:08.491236       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"f096fe58-29ff-441f-8b2f-e18225094ace", APIVersion:"batch/v1", ResourceVersion:"453", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0720 00:00:38.129709       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"1b39def2-8b95-47d1-a955-048b07c31e46", APIVersion:"apps/v1", ResourceVersion:"567", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-4bs69
	I0720 00:00:38.135055       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"2420d5fc-230f-41bb-98d8-77680624b769", APIVersion:"apps/v1", ResourceVersion:"566", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	E0720 00:01:07.750943       1 tokens_controller.go:261] error synchronizing serviceaccount ingress-nginx/default: secrets "default-token-252vg" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated
	
	* 
	* ==> kube-proxy [33f37bfd1040] <==
	* W0719 23:59:54.575198       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I0719 23:59:54.589564       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I0719 23:59:54.589773       1 server_others.go:186] Using iptables Proxier.
	I0719 23:59:54.590242       1 server.go:583] Version: v1.18.20
	I0719 23:59:54.594878       1 config.go:315] Starting service config controller
	I0719 23:59:54.594928       1 shared_informer.go:223] Waiting for caches to sync for service config
	I0719 23:59:54.596772       1 config.go:133] Starting endpoints config controller
	I0719 23:59:54.596792       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I0719 23:59:54.695535       1 shared_informer.go:230] Caches are synced for service config 
	I0719 23:59:54.697895       1 shared_informer.go:230] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [f073435c2d09] <==
	* I0719 23:59:35.331760       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0719 23:59:35.331954       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0719 23:59:35.335670       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
	I0719 23:59:35.336366       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0719 23:59:35.338351       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0719 23:59:35.338571       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0719 23:59:35.343039       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0719 23:59:35.343318       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0719 23:59:35.343418       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0719 23:59:35.343493       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0719 23:59:35.343576       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0719 23:59:35.343649       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0719 23:59:35.343713       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0719 23:59:35.343774       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0719 23:59:35.343832       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0719 23:59:35.343886       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0719 23:59:35.344716       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0719 23:59:35.344821       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0719 23:59:36.157814       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0719 23:59:36.183553       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0719 23:59:36.276194       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0719 23:59:36.295928       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0719 23:59:36.338839       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0719 23:59:36.600996       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0719 23:59:39.638685       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* Jul 20 00:00:51 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:00:51.073324    2849 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: e3a579adce54a526a45a3c3cc13acbb204102c702f22998c1398f07cf3aa2bcf
	Jul 20 00:00:51 ingress-addon-legacy-520951 kubelet[2849]: E0720 00:00:51.073678    2849 pod_workers.go:191] Error syncing pod 01e7bcf5-7bed-4586-9873-6aed08fd3240 ("kube-ingress-dns-minikube_kube-system(01e7bcf5-7bed-4586-9873-6aed08fd3240)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with CrashLoopBackOff: "back-off 20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(01e7bcf5-7bed-4586-9873-6aed08fd3240)"
	Jul 20 00:00:54 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:00:54.092275    2849 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-c8dzg" (UniqueName: "kubernetes.io/secret/01e7bcf5-7bed-4586-9873-6aed08fd3240-minikube-ingress-dns-token-c8dzg") pod "01e7bcf5-7bed-4586-9873-6aed08fd3240" (UID: "01e7bcf5-7bed-4586-9873-6aed08fd3240")
	Jul 20 00:00:54 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:00:54.105186    2849 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01e7bcf5-7bed-4586-9873-6aed08fd3240-minikube-ingress-dns-token-c8dzg" (OuterVolumeSpecName: "minikube-ingress-dns-token-c8dzg") pod "01e7bcf5-7bed-4586-9873-6aed08fd3240" (UID: "01e7bcf5-7bed-4586-9873-6aed08fd3240"). InnerVolumeSpecName "minikube-ingress-dns-token-c8dzg". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 20 00:00:54 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:00:54.192611    2849 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-c8dzg" (UniqueName: "kubernetes.io/secret/01e7bcf5-7bed-4586-9873-6aed08fd3240-minikube-ingress-dns-token-c8dzg") on node "ingress-addon-legacy-520951" DevicePath ""
	Jul 20 00:00:55 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:00:55.008300    2849 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: e3a579adce54a526a45a3c3cc13acbb204102c702f22998c1398f07cf3aa2bcf
	Jul 20 00:00:56 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:00:56.073467    2849 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: e34e19911379bff7206a586c627b6d3cbdfd8965238ec3a6bec11ebbe09d5405
	Jul 20 00:00:56 ingress-addon-legacy-520951 kubelet[2849]: W0720 00:00:56.259466    2849 container.go:412] Failed to create summary reader for "/kubepods/besteffort/pod81e1a535-5e60-4f41-b45c-086a23a4d621/9ed19a3c42846cb0294cf819094cddafd5cdf075bf3e02f8a624c3a965eef9f6": none of the resources are being tracked.
	Jul 20 00:00:57 ingress-addon-legacy-520951 kubelet[2849]: W0720 00:00:57.028744    2849 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-4bs69 through plugin: invalid network status for
	Jul 20 00:00:57 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:00:57.034277    2849 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: e34e19911379bff7206a586c627b6d3cbdfd8965238ec3a6bec11ebbe09d5405
	Jul 20 00:00:57 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:00:57.034692    2849 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 9ed19a3c42846cb0294cf819094cddafd5cdf075bf3e02f8a624c3a965eef9f6
	Jul 20 00:00:57 ingress-addon-legacy-520951 kubelet[2849]: E0720 00:00:57.035000    2849 pod_workers.go:191] Error syncing pod 81e1a535-5e60-4f41-b45c-086a23a4d621 ("hello-world-app-5f5d8b66bb-4bs69_default(81e1a535-5e60-4f41-b45c-086a23a4d621)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-4bs69_default(81e1a535-5e60-4f41-b45c-086a23a4d621)"
	Jul 20 00:00:58 ingress-addon-legacy-520951 kubelet[2849]: W0720 00:00:58.043421    2849 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-4bs69 through plugin: invalid network status for
	Jul 20 00:01:02 ingress-addon-legacy-520951 kubelet[2849]: E0720 00:01:02.978481    2849 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-2jbfm.17736a640309b3b0", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-2jbfm", UID:"c1f704ca-c415-41dd-bcb0-ae3ce813defc", APIVersion:"v1", ResourceVersion:"433", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-520951"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc1263c2fba12c7b0, ext:84762896912, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc1263c2fba12c7b0, ext:84762896912, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-2jbfm.17736a640309b3b0" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 20 00:01:02 ingress-addon-legacy-520951 kubelet[2849]: E0720 00:01:02.989833    2849 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-2jbfm.17736a640309b3b0", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-2jbfm", UID:"c1f704ca-c415-41dd-bcb0-ae3ce813defc", APIVersion:"v1", ResourceVersion:"433", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-520951"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc1263c2fba12c7b0, ext:84762896912, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc1263c2fba492807, ext:84766460519, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-2jbfm.17736a640309b3b0" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 20 00:01:06 ingress-addon-legacy-520951 kubelet[2849]: W0720 00:01:06.292530    2849 pod_container_deletor.go:77] Container "678a2a6acae2eb012e62612d5a16ea022c6c3835aa78cf439f34dea9f3fd68c0" not found in pod's containers
	Jul 20 00:01:07 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:01:07.152470    2849 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-4cqw5" (UniqueName: "kubernetes.io/secret/c1f704ca-c415-41dd-bcb0-ae3ce813defc-ingress-nginx-token-4cqw5") pod "c1f704ca-c415-41dd-bcb0-ae3ce813defc" (UID: "c1f704ca-c415-41dd-bcb0-ae3ce813defc")
	Jul 20 00:01:07 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:01:07.152526    2849 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c1f704ca-c415-41dd-bcb0-ae3ce813defc-webhook-cert") pod "c1f704ca-c415-41dd-bcb0-ae3ce813defc" (UID: "c1f704ca-c415-41dd-bcb0-ae3ce813defc")
	Jul 20 00:01:07 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:01:07.158472    2849 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1f704ca-c415-41dd-bcb0-ae3ce813defc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c1f704ca-c415-41dd-bcb0-ae3ce813defc" (UID: "c1f704ca-c415-41dd-bcb0-ae3ce813defc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 20 00:01:07 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:01:07.160606    2849 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1f704ca-c415-41dd-bcb0-ae3ce813defc-ingress-nginx-token-4cqw5" (OuterVolumeSpecName: "ingress-nginx-token-4cqw5") pod "c1f704ca-c415-41dd-bcb0-ae3ce813defc" (UID: "c1f704ca-c415-41dd-bcb0-ae3ce813defc"). InnerVolumeSpecName "ingress-nginx-token-4cqw5". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 20 00:01:07 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:01:07.252863    2849 reconciler.go:319] Volume detached for volume "ingress-nginx-token-4cqw5" (UniqueName: "kubernetes.io/secret/c1f704ca-c415-41dd-bcb0-ae3ce813defc-ingress-nginx-token-4cqw5") on node "ingress-addon-legacy-520951" DevicePath ""
	Jul 20 00:01:07 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:01:07.252914    2849 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c1f704ca-c415-41dd-bcb0-ae3ce813defc-webhook-cert") on node "ingress-addon-legacy-520951" DevicePath ""
	Jul 20 00:01:08 ingress-addon-legacy-520951 kubelet[2849]: I0720 00:01:08.073549    2849 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 9ed19a3c42846cb0294cf819094cddafd5cdf075bf3e02f8a624c3a965eef9f6
	Jul 20 00:01:08 ingress-addon-legacy-520951 kubelet[2849]: E0720 00:01:08.074164    2849 pod_workers.go:191] Error syncing pod 81e1a535-5e60-4f41-b45c-086a23a4d621 ("hello-world-app-5f5d8b66bb-4bs69_default(81e1a535-5e60-4f41-b45c-086a23a4d621)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-4bs69_default(81e1a535-5e60-4f41-b45c-086a23a4d621)"
	Jul 20 00:01:08 ingress-addon-legacy-520951 kubelet[2849]: W0720 00:01:08.089117    2849 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/c1f704ca-c415-41dd-bcb0-ae3ce813defc/volumes" does not exist
	
	* 
	* ==> storage-provisioner [776b85442d73] <==
	* I0719 23:59:56.532827       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0719 23:59:56.545036       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0719 23:59:56.545147       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0719 23:59:56.553021       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0719 23:59:56.553225       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-520951_8973e540-6339-4830-bad7-b274ccbb52c2!
	I0719 23:59:56.554364       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1693f4a2-8c28-492d-87e1-c5487a76fbcf", APIVersion:"v1", ResourceVersion:"381", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-520951_8973e540-6339-4830-bad7-b274ccbb52c2 became leader
	I0719 23:59:56.654379       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-520951_8973e540-6339-4830-bad7-b274ccbb52c2!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-520951 -n ingress-addon-legacy-520951
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-520951 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (57.23s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (296.61s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.17.0.56256938.exe start -p running-upgrade-980796 --memory=2200 --vm-driver=docker  --container-runtime=docker
version_upgrade_test.go:132: (dbg) Done: /tmp/minikube-v1.17.0.56256938.exe start -p running-upgrade-980796 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m21.571904658s)
version_upgrade_test.go:142: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-980796 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0720 00:31:34.763759  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
version_upgrade_test.go:142: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p running-upgrade-980796 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: exit status 90 (3m31.773366974s)

                                                
                                                
-- stdout --
	* [running-upgrade-980796] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=15585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.27.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.27.3
	* Using the docker driver based on existing profile
	* Starting control plane node running-upgrade-980796 in cluster running-upgrade-980796
	* Pulling base image ...
	* Updating the running docker "running-upgrade-980796" container ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0720 00:31:21.244001  701657 out.go:296] Setting OutFile to fd 1 ...
	I0720 00:31:21.244192  701657 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0720 00:31:21.244205  701657 out.go:309] Setting ErrFile to fd 2...
	I0720 00:31:21.244211  701657 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0720 00:31:21.244996  701657 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	I0720 00:31:21.245518  701657 out.go:303] Setting JSON to false
	I0720 00:31:21.246909  701657 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":15227,"bootTime":1689797855,"procs":336,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0720 00:31:21.247177  701657 start.go:138] virtualization:  
	I0720 00:31:21.249644  701657 out.go:177] * [running-upgrade-980796] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0720 00:31:21.250911  701657 out.go:177]   - MINIKUBE_LOCATION=15585
	I0720 00:31:21.252525  701657 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0720 00:31:21.251065  701657 preload.go:306] deleting older generation preload /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v8-v1.20.2-docker-overlay2-arm64.tar.lz4
	I0720 00:31:21.251108  701657 notify.go:220] Checking for updates...
	I0720 00:31:21.256001  701657 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0720 00:31:21.257981  701657 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	I0720 00:31:21.259372  701657 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0720 00:31:21.261231  701657 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0720 00:31:21.263187  701657 config.go:182] Loaded profile config "running-upgrade-980796": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.2
	I0720 00:31:21.265350  701657 out.go:177] * Kubernetes 1.27.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.27.3
	I0720 00:31:21.266897  701657 driver.go:373] Setting default libvirt URI to qemu:///system
	I0720 00:31:21.292496  701657 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0720 00:31:21.292721  701657 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0720 00:31:21.379929  701657 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:5 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:54 SystemTime:2023-07-20 00:31:21.370037715 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0720 00:31:21.380030  701657 docker.go:294] overlay module found
	I0720 00:31:21.381685  701657 out.go:177] * Using the docker driver based on existing profile
	I0720 00:31:21.383453  701657 start.go:298] selected driver: docker
	I0720 00:31:21.383472  701657 start.go:880] validating driver "docker" against &{Name:running-upgrade-980796 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:running-upgrade-980796 Namespace:default APIServerName:minikubeCA APIServer
Names:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.70.61 Port:8443 KubernetesVersion:v1.20.2 ContainerRuntime: ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID: BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath:
StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0720 00:31:21.383582  701657 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0720 00:31:21.384243  701657 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0720 00:31:21.477402  701657 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:5 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:43 OomKillDisable:true NGoroutines:54 SystemTime:2023-07-20 00:31:21.462059 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architec
ture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Serv
erErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0720 00:31:21.477714  701657 cni.go:84] Creating CNI manager for ""
	I0720 00:31:21.477727  701657 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0720 00:31:21.477739  701657 start_flags.go:319] config:
	{Name:running-upgrade-980796 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:running-upgrade-980796 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISock
et: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.70.61 Port:8443 KubernetesVersion:v1.20.2 ContainerRuntime: ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID: BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0720 00:31:21.479739  701657 out.go:177] * Starting control plane node running-upgrade-980796 in cluster running-upgrade-980796
	I0720 00:31:21.481315  701657 cache.go:122] Beginning downloading kic base image for docker with docker
	I0720 00:31:21.482829  701657 out.go:177] * Pulling base image ...
	I0720 00:31:21.484165  701657 preload.go:132] Checking if preload exists for k8s version v1.20.2 and runtime docker
	I0720 00:31:21.484333  701657 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e in local docker daemon
	I0720 00:31:21.513674  701657 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e in local docker daemon, skipping pull
	I0720 00:31:21.513695  701657 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e exists in daemon, skipping load
	W0720 00:31:21.570895  701657 preload.go:115] https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.2/preloaded-images-k8s-v18-v1.20.2-docker-overlay2-arm64.tar.lz4 status code: 404
	I0720 00:31:21.571078  701657 profile.go:148] Saving config to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/running-upgrade-980796/config.json ...
	I0720 00:31:21.571202  701657 cache.go:107] acquiring lock: {Name:mkf20baed3e4afac67b34542c82a1a670bbf20b4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571290  701657 cache.go:115] /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0720 00:31:21.571299  701657 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 103.195µs
	I0720 00:31:21.571308  701657 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0720 00:31:21.571316  701657 cache.go:195] Successfully downloaded all kic artifacts
	I0720 00:31:21.571318  701657 cache.go:107] acquiring lock: {Name:mk74ffbc41b70eb7ba5d3d5be7e4b467bc63f5e8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571348  701657 cache.go:115] /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.20.2 exists
	I0720 00:31:21.571355  701657 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.20.2" -> "/home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.20.2" took 37.054µs
	I0720 00:31:21.571361  701657 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.20.2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.20.2 succeeded
	I0720 00:31:21.571356  701657 start.go:365] acquiring machines lock for running-upgrade-980796: {Name:mkf15397598e7fd3f670a1a861e1b88b3063c1ad Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571370  701657 cache.go:107] acquiring lock: {Name:mk39a61ce1731c60a69b4b65c98f8f9ace6e6ac1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571393  701657 start.go:369] acquired machines lock for "running-upgrade-980796" in 24.164µs
	I0720 00:31:21.571398  701657 cache.go:115] /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.20.2 exists
	I0720 00:31:21.571403  701657 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.20.2" -> "/home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.20.2" took 34.059µs
	I0720 00:31:21.571407  701657 start.go:96] Skipping create...Using existing machine configuration
	I0720 00:31:21.571409  701657 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.20.2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.20.2 succeeded
	I0720 00:31:21.571413  701657 fix.go:54] fixHost starting: 
	I0720 00:31:21.571418  701657 cache.go:107] acquiring lock: {Name:mke49b23ec85d8d43613a5783bb5decabd08fea9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571443  701657 cache.go:115] /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.20.2 exists
	I0720 00:31:21.571448  701657 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.20.2" -> "/home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.20.2" took 31.023µs
	I0720 00:31:21.571454  701657 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.20.2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.20.2 succeeded
	I0720 00:31:21.571463  701657 cache.go:107] acquiring lock: {Name:mk28716e46dd7572df2ff4d137d94923fa307e60 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571485  701657 cache.go:115] /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.20.2 exists
	I0720 00:31:21.571491  701657 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.20.2" -> "/home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.20.2" took 29.538µs
	I0720 00:31:21.571502  701657 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.20.2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.20.2 succeeded
	I0720 00:31:21.571510  701657 cache.go:107] acquiring lock: {Name:mk7006ebc23036ee4e0de406c4ab0854b17b28ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571534  701657 cache.go:115] /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2 exists
	I0720 00:31:21.571538  701657 cache.go:96] cache image "registry.k8s.io/pause:3.2" -> "/home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2" took 28.849µs
	I0720 00:31:21.571544  701657 cache.go:80] save to tar file registry.k8s.io/pause:3.2 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2 succeeded
	I0720 00:31:21.571555  701657 cache.go:107] acquiring lock: {Name:mk33765a287ff076b8f19bb73743bcb086640741 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571578  701657 cache.go:115] /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.13-0 exists
	I0720 00:31:21.571582  701657 cache.go:96] cache image "registry.k8s.io/etcd:3.4.13-0" -> "/home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.13-0" took 32.024µs
	I0720 00:31:21.571588  701657 cache.go:80] save to tar file registry.k8s.io/etcd:3.4.13-0 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.13-0 succeeded
	I0720 00:31:21.571595  701657 cache.go:107] acquiring lock: {Name:mk7a95d5dfa9603ffc74a439137666ef830cb898 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0720 00:31:21.571617  701657 cache.go:115] /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.7.0 exists
	I0720 00:31:21.571622  701657 cache.go:96] cache image "registry.k8s.io/coredns:1.7.0" -> "/home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.7.0" took 27.257µs
	I0720 00:31:21.571627  701657 cache.go:80] save to tar file registry.k8s.io/coredns:1.7.0 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.7.0 succeeded
	I0720 00:31:21.571632  701657 cache.go:87] Successfully saved all images to host disk.
	I0720 00:31:21.571693  701657 cli_runner.go:164] Run: docker container inspect running-upgrade-980796 --format={{.State.Status}}
	I0720 00:31:21.589786  701657 fix.go:102] recreateIfNeeded on running-upgrade-980796: state=Running err=<nil>
	W0720 00:31:21.589816  701657 fix.go:128] unexpected machine state, will restart: <nil>
	I0720 00:31:21.591814  701657 out.go:177] * Updating the running docker "running-upgrade-980796" container ...
	I0720 00:31:21.593304  701657 machine.go:88] provisioning docker machine ...
	I0720 00:31:21.593334  701657 ubuntu.go:169] provisioning hostname "running-upgrade-980796"
	I0720 00:31:21.593404  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:21.616231  701657 main.go:141] libmachine: Using SSH client type: native
	I0720 00:31:21.616755  701657 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33602 <nil> <nil>}
	I0720 00:31:21.616774  701657 main.go:141] libmachine: About to run SSH command:
	sudo hostname running-upgrade-980796 && echo "running-upgrade-980796" | sudo tee /etc/hostname
	I0720 00:31:21.771648  701657 main.go:141] libmachine: SSH cmd err, output: <nil>: running-upgrade-980796
	
	I0720 00:31:21.771774  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:21.791474  701657 main.go:141] libmachine: Using SSH client type: native
	I0720 00:31:21.791930  701657 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33602 <nil> <nil>}
	I0720 00:31:21.791956  701657 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\srunning-upgrade-980796' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 running-upgrade-980796/g' /etc/hosts;
				else 
					echo '127.0.1.1 running-upgrade-980796' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0720 00:31:21.931455  701657 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0720 00:31:21.931480  701657 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/15585-475114/.minikube CaCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/15585-475114/.minikube}
	I0720 00:31:21.931522  701657 ubuntu.go:177] setting up certificates
	I0720 00:31:21.931535  701657 provision.go:83] configureAuth start
	I0720 00:31:21.931599  701657 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" running-upgrade-980796
	I0720 00:31:21.951366  701657 provision.go:138] copyHostCerts
	I0720 00:31:21.951468  701657 exec_runner.go:144] found /home/jenkins/minikube-integration/15585-475114/.minikube/ca.pem, removing ...
	I0720 00:31:21.951502  701657 exec_runner.go:203] rm: /home/jenkins/minikube-integration/15585-475114/.minikube/ca.pem
	I0720 00:31:21.951589  701657 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/ca.pem (1082 bytes)
	I0720 00:31:21.951748  701657 exec_runner.go:144] found /home/jenkins/minikube-integration/15585-475114/.minikube/cert.pem, removing ...
	I0720 00:31:21.951759  701657 exec_runner.go:203] rm: /home/jenkins/minikube-integration/15585-475114/.minikube/cert.pem
	I0720 00:31:21.951792  701657 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/cert.pem (1123 bytes)
	I0720 00:31:21.951868  701657 exec_runner.go:144] found /home/jenkins/minikube-integration/15585-475114/.minikube/key.pem, removing ...
	I0720 00:31:21.951881  701657 exec_runner.go:203] rm: /home/jenkins/minikube-integration/15585-475114/.minikube/key.pem
	I0720 00:31:21.951908  701657 exec_runner.go:151] cp: /home/jenkins/minikube-integration/15585-475114/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/15585-475114/.minikube/key.pem (1679 bytes)
	I0720 00:31:21.951966  701657 provision.go:112] generating server cert: /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca-key.pem org=jenkins.running-upgrade-980796 san=[192.168.70.61 127.0.0.1 localhost 127.0.0.1 minikube running-upgrade-980796]
	I0720 00:31:22.545354  701657 provision.go:172] copyRemoteCerts
	I0720 00:31:22.545457  701657 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0720 00:31:22.545931  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:22.569932  701657 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33602 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/running-upgrade-980796/id_rsa Username:docker}
	I0720 00:31:22.668496  701657 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0720 00:31:22.691391  701657 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0720 00:31:22.713999  701657 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0720 00:31:22.735944  701657 provision.go:86] duration metric: configureAuth took 804.395014ms
	I0720 00:31:22.735968  701657 ubuntu.go:193] setting minikube options for container-runtime
	I0720 00:31:22.736142  701657 config.go:182] Loaded profile config "running-upgrade-980796": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.2
	I0720 00:31:22.736203  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:22.757907  701657 main.go:141] libmachine: Using SSH client type: native
	I0720 00:31:22.758349  701657 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33602 <nil> <nil>}
	I0720 00:31:22.758377  701657 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0720 00:31:22.904942  701657 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0720 00:31:22.904962  701657 ubuntu.go:71] root file system type: overlay
	I0720 00:31:22.905094  701657 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0720 00:31:22.905179  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:22.924058  701657 main.go:141] libmachine: Using SSH client type: native
	I0720 00:31:22.924484  701657 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33602 <nil> <nil>}
	I0720 00:31:22.924576  701657 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0720 00:31:23.097910  701657 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0720 00:31:23.097998  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:23.128455  701657 main.go:141] libmachine: Using SSH client type: native
	I0720 00:31:23.128909  701657 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 33602 <nil> <nil>}
	I0720 00:31:23.128947  701657 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0720 00:31:24.997775  701657 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-07-20 00:30:22.288791091 +0000
	+++ /lib/systemd/system/docker.service.new	2023-07-20 00:31:23.092156875 +0000
	@@ -5,12 +5,12 @@
	 After=network-online.target firewalld.service containerd.service
	 Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	 Restart=on-failure
	-StartLimitBurst=3
	-StartLimitIntervalSec=60
	 
	 
	 
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0720 00:31:24.997795  701657 machine.go:91] provisioned docker machine in 3.404473386s
	I0720 00:31:24.997806  701657 start.go:300] post-start starting for "running-upgrade-980796" (driver="docker")
	I0720 00:31:24.997816  701657 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0720 00:31:24.997878  701657 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0720 00:31:24.997917  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:25.021291  701657 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33602 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/running-upgrade-980796/id_rsa Username:docker}
	I0720 00:31:25.127945  701657 ssh_runner.go:195] Run: cat /etc/os-release
	I0720 00:31:25.131762  701657 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0720 00:31:25.131789  701657 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0720 00:31:25.131800  701657 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0720 00:31:25.131807  701657 info.go:137] Remote host: Ubuntu 20.04.1 LTS
	I0720 00:31:25.131815  701657 filesync.go:126] Scanning /home/jenkins/minikube-integration/15585-475114/.minikube/addons for local assets ...
	I0720 00:31:25.131873  701657 filesync.go:126] Scanning /home/jenkins/minikube-integration/15585-475114/.minikube/files for local assets ...
	I0720 00:31:25.131967  701657 filesync.go:149] local asset: /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/4805052.pem -> 4805052.pem in /etc/ssl/certs
	I0720 00:31:25.132076  701657 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0720 00:31:25.141664  701657 ssh_runner.go:362] scp /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/ssl/certs/4805052.pem --> /etc/ssl/certs/4805052.pem (1708 bytes)
	I0720 00:31:25.164759  701657 start.go:303] post-start completed in 166.93728ms
	I0720 00:31:25.164841  701657 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0720 00:31:25.164891  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:25.183983  701657 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33602 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/running-upgrade-980796/id_rsa Username:docker}
	I0720 00:31:25.285378  701657 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0720 00:31:25.290917  701657 fix.go:56] fixHost completed within 3.719495252s
	I0720 00:31:25.290939  701657 start.go:83] releasing machines lock for "running-upgrade-980796", held for 3.719538336s
	I0720 00:31:25.291037  701657 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" running-upgrade-980796
	I0720 00:31:25.309070  701657 ssh_runner.go:195] Run: cat /version.json
	I0720 00:31:25.309132  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:25.309394  701657 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0720 00:31:25.309449  701657 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-980796
	I0720 00:31:25.333015  701657 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33602 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/running-upgrade-980796/id_rsa Username:docker}
	I0720 00:31:25.343955  701657 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33602 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/running-upgrade-980796/id_rsa Username:docker}
	W0720 00:31:25.439196  701657 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0720 00:31:25.439295  701657 ssh_runner.go:195] Run: systemctl --version
	I0720 00:31:25.597676  701657 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0720 00:31:25.603701  701657 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0720 00:31:25.633462  701657 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0720 00:31:25.633553  701657 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0720 00:31:25.652974  701657 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0720 00:31:25.678409  701657 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0720 00:31:25.678431  701657 start.go:466] detecting cgroup driver to use...
	I0720 00:31:25.678461  701657 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0720 00:31:25.678595  701657 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0720 00:31:25.708181  701657 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0720 00:31:25.719744  701657 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0720 00:31:25.730191  701657 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0720 00:31:25.730263  701657 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0720 00:31:25.749953  701657 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0720 00:31:25.765426  701657 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0720 00:31:25.777570  701657 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0720 00:31:25.789353  701657 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0720 00:31:25.800348  701657 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0720 00:31:25.821793  701657 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0720 00:31:25.847789  701657 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0720 00:31:25.858335  701657 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0720 00:31:26.092938  701657 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0720 00:33:07.724734  701657 ssh_runner.go:235] Completed: sudo systemctl restart containerd: (1m41.631718291s)
	W0720 00:33:07.724763  701657 start.go:433] cannot ensure containerd is configured properly and reloaded for docker - cluster might be unstable: sudo systemctl restart containerd: Process exited with status 1
	stdout:
	
	stderr:
	Job for containerd.service failed because a timeout was exceeded.
	See "systemctl status containerd.service" and "journalctl -xe" for details.
	I0720 00:33:07.724772  701657 start.go:466] detecting cgroup driver to use...
	I0720 00:33:07.724802  701657 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0720 00:33:07.724846  701657 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0720 00:33:07.739625  701657 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0720 00:33:07.739691  701657 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0720 00:33:07.756903  701657 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
	" | sudo tee /etc/crictl.yaml"
	I0720 00:33:07.784782  701657 ssh_runner.go:195] Run: which cri-dockerd
	I0720 00:33:07.789289  701657 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0720 00:33:07.800101  701657 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0720 00:33:07.821481  701657 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0720 00:33:07.939057  701657 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0720 00:33:08.062653  701657 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0720 00:33:08.062680  701657 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0720 00:33:08.080391  701657 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0720 00:33:08.191546  701657 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0720 00:34:52.947635  701657 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m44.756050512s)
	I0720 00:34:52.949452  701657 out.go:177] 
	W0720 00:34:52.951136  701657 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1
	stdout:
	
	stderr:
	A dependency job for docker.service failed. See 'journalctl -xe' for details.
	
	X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1
	stdout:
	
	stderr:
	A dependency job for docker.service failed. See 'journalctl -xe' for details.
	
	W0720 00:34:52.951160  701657 out.go:239] * 
	* 
	W0720 00:34:52.952184  701657 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0720 00:34:52.954357  701657 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:144: upgrade from v1.17.0 to HEAD failed: out/minikube-linux-arm64 start -p running-upgrade-980796 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: exit status 90
panic.go:522: *** TestRunningBinaryUpgrade FAILED at 2023-07-20 00:34:52.986481149 +0000 UTC m=+2769.154706386
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestRunningBinaryUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect running-upgrade-980796
helpers_test.go:235: (dbg) docker inspect running-upgrade-980796:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "56bc0e0226741d1f2b1132e196a1b69eba1989f4b44e421b11007f5806f5b1c9",
	        "Created": "2023-07-20T00:30:19.013723656Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 696557,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-20T00:30:19.627196438Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:9b79b8263a5873a7b57b8bb7698df1f71e90108b3174dea92dc6c576c0a9dbf9",
	        "ResolvConfPath": "/var/lib/docker/containers/56bc0e0226741d1f2b1132e196a1b69eba1989f4b44e421b11007f5806f5b1c9/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/56bc0e0226741d1f2b1132e196a1b69eba1989f4b44e421b11007f5806f5b1c9/hostname",
	        "HostsPath": "/var/lib/docker/containers/56bc0e0226741d1f2b1132e196a1b69eba1989f4b44e421b11007f5806f5b1c9/hosts",
	        "LogPath": "/var/lib/docker/containers/56bc0e0226741d1f2b1132e196a1b69eba1989f4b44e421b11007f5806f5b1c9/56bc0e0226741d1f2b1132e196a1b69eba1989f4b44e421b11007f5806f5b1c9-json.log",
	        "Name": "/running-upgrade-980796",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "running-upgrade-980796:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "running-upgrade-980796",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 2306867200,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/7d16c85724e307fad523ef21e35f620e7d9935458792aa355861d9f70b5fdf5e-init/diff:/var/lib/docker/overlay2/0e9bd02f4921db4bb2c6c62702a272d1349aea05d08e713bde972e7fa0629b27/diff:/var/lib/docker/overlay2/7abb42f15f691ec3fc8c0bb21eb8aa8e969c785c6cdedee416ad4a62ec2fc5f9/diff:/var/lib/docker/overlay2/eb1842d79275503ce2da261435b23c6049c7704aa06690e56bf5d0ec5a464581/diff:/var/lib/docker/overlay2/ffc4c3c3eca2c46c5611e51b9b71c8aa1f89313b6fe208745e0da15d4e7d3a31/diff:/var/lib/docker/overlay2/a492b8f4673151cb3bf2bed90df89d5cdd02bfdd697d31776a66b1ca0c2ab202/diff:/var/lib/docker/overlay2/75ab8a69ea634356be96e38b0c7da4e2bcc5038e7a22fdcbe9240739f734f299/diff:/var/lib/docker/overlay2/9425abbe6e8f61ebff1e7983fe89a10986b1bd64f6f8594fbe098bc431ee0a1d/diff:/var/lib/docker/overlay2/6fcefe25dcaa46311e394da6df3553d71fe4ad550c5fd140620f1820295f2d99/diff:/var/lib/docker/overlay2/d15086fb22131d06459df6171bb6196833324a2e56db0b7eb731e4c11d75776e/diff:/var/lib/docker/overlay2/93bad9
06223aea42f5782a2c22dc9697ab93bd5f3a8dc0cb5803b6605ddf87a1/diff:/var/lib/docker/overlay2/9ae7f315d74362454417968c5d5984abf4b88dc4f629359eb9dd25f6a518eb5a/diff:/var/lib/docker/overlay2/06cd9ce4af9d00e80e6d3f2531c24495c816e85c6c50703031e557af26cb31ca/diff:/var/lib/docker/overlay2/a73264abb5bd4f7085b09b153cddc96912ebe7e24ba255a0a0bf3fe9bac419ed/diff:/var/lib/docker/overlay2/6b514019515418bb8676ea652b0edb80082d9a82b22810421f988051e822d620/diff:/var/lib/docker/overlay2/06a0d575eaf81b6c7c63c2d8fcbfa66233c020a1ae7291dababc0f5d922c2e86/diff:/var/lib/docker/overlay2/43cc4e8e406e30920b02900c935d1d969c8dbbd5c922557cda3cc5d367f01021/diff:/var/lib/docker/overlay2/03db14b81670416ba2234563bda3a4b70877087149457e445317b13afa846a8d/diff:/var/lib/docker/overlay2/72a3935bba554b879a8d3202e5fac8c8da0f27f48be4feb04d669611ea50623c/diff:/var/lib/docker/overlay2/3be570d25d69c24a6e57548a2ef77b3b55b4eb5615a00392daae096ccabc9ec5/diff:/var/lib/docker/overlay2/3609dc41ac5f897bcdfc1e457259e72f47b623890ea1dc40376abcfed916a460/diff:/var/lib/d
ocker/overlay2/ad876d9f6310ccb850afccbcd623e71e9b9ca00c74169307a9d24bc731df9719/diff:/var/lib/docker/overlay2/377db4580153ad9ebb91a9c68f60241d0daaf6ffdf9cde2a2b7a9cf9659e4a3a/diff:/var/lib/docker/overlay2/3b108d81a8f4eabe7ac5af20517d40e2cb7c4c81c1a0c65e1b84e4fa069a7c33/diff:/var/lib/docker/overlay2/3087f291c828eb80c923ce165495916aa28e02fb01576b521f1dd58323b0146c/diff:/var/lib/docker/overlay2/142ea28585489b99f52bb8e4a7923d6744346449c7bc0fb9ecb04555f4c12bfd/diff:/var/lib/docker/overlay2/0158cfd215edcd13f631769e11c34d204c80ca94ac5dbe1763d31361381f0c85/diff:/var/lib/docker/overlay2/0266553bd9fd09502d768f97d449c2ffee6fdfc9913c47ce4565b3c3bd3699a7/diff:/var/lib/docker/overlay2/963cdfde267622bdc5ad36f839e4b865d153e06317a787eba838d4b52da41bb7/diff:/var/lib/docker/overlay2/058df9a6096f9710249ec1a776dd1631758b3de3587783b40ffb87c26bcd0f9a/diff:/var/lib/docker/overlay2/134ed60930eb64d53e02c74901c8fe40a241468b757e8539632817cc6997077b/diff:/var/lib/docker/overlay2/7593e2d5b0fb2c1fc6a1144d008ce3187a9354b487a30000cbe38ef0ad1
6e49e/diff:/var/lib/docker/overlay2/dfdcfca821b0bc08c3fa216e25713133d76022a1457b5d76a8c618d0ec2f5e4c/diff:/var/lib/docker/overlay2/50af387bda08789ee85eaf91cf964c58b0b9e20bff80d82b69a07ecf3c3dec13/diff:/var/lib/docker/overlay2/fe9fac37123ea1298641833e2bebbb982590957a732316fad0e71110a81b1c52/diff",
	                "MergedDir": "/var/lib/docker/overlay2/7d16c85724e307fad523ef21e35f620e7d9935458792aa355861d9f70b5fdf5e/merged",
	                "UpperDir": "/var/lib/docker/overlay2/7d16c85724e307fad523ef21e35f620e7d9935458792aa355861d9f70b5fdf5e/diff",
	                "WorkDir": "/var/lib/docker/overlay2/7d16c85724e307fad523ef21e35f620e7d9935458792aa355861d9f70b5fdf5e/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "running-upgrade-980796",
	                "Source": "/var/lib/docker/volumes/running-upgrade-980796/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "running-upgrade-980796",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "running-upgrade-980796",
	                "name.minikube.sigs.k8s.io": "running-upgrade-980796",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "c296437bc6608fbe53978b2b2a102e9434d1e6d6b96fc90cc7385709d90385b1",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33602"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33601"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33600"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33599"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/c296437bc660",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "running-upgrade-980796": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.70.61"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "56bc0e022674",
	                        "running-upgrade-980796"
	                    ],
	                    "NetworkID": "72e962d616c8fd006ec8504cbe1124d5b8cd51a5215e9590dd41c5b7acc5472b",
	                    "EndpointID": "6ab537c4378991613fbcf139985f6650ad4bc3f87acf7a03ab56d7ad87b28652",
	                    "Gateway": "192.168.70.1",
	                    "IPAddress": "192.168.70.61",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:46:3d",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p running-upgrade-980796 -n running-upgrade-980796
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p running-upgrade-980796 -n running-upgrade-980796: exit status 6 (340.166399ms)

                                                
                                                
-- stdout --
	Running
	WARNING: Your kubectl is pointing to stale minikube-vm.
	To fix the kubectl context, run `minikube update-context`

                                                
                                                
-- /stdout --
** stderr ** 
	E0720 00:34:53.333678  719100 status.go:415] kubeconfig endpoint: extract IP: "running-upgrade-980796" does not appear in /home/jenkins/minikube-integration/15585-475114/kubeconfig

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "running-upgrade-980796" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
helpers_test.go:175: Cleaning up "running-upgrade-980796" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-980796
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-980796: (1.891268047s)
--- FAIL: TestRunningBinaryUpgrade (296.61s)

                                                
                                    

Test pass (292/319)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 11.6
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.14
10 TestDownloadOnly/v1.27.3/json-events 9.88
11 TestDownloadOnly/v1.27.3/preload-exists 0
15 TestDownloadOnly/v1.27.3/LogsDuration 0.07
16 TestDownloadOnly/DeleteAll 0.23
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.14
19 TestBinaryMirror 0.59
20 TestOffline 98.57
22 TestAddons/Setup 174.45
24 TestAddons/parallel/Registry 15.1
26 TestAddons/parallel/InspektorGadget 10.76
27 TestAddons/parallel/MetricsServer 5.77
30 TestAddons/parallel/CSI 44.22
31 TestAddons/parallel/Headlamp 12.63
32 TestAddons/parallel/CloudSpanner 5.59
35 TestAddons/serial/GCPAuth/Namespaces 0.19
36 TestAddons/StoppedEnableDisable 11.29
37 TestCertOptions 43.32
38 TestCertExpiration 261.91
39 TestDockerFlags 48.48
40 TestForceSystemdFlag 48.98
41 TestForceSystemdEnv 42.4
47 TestErrorSpam/setup 31.57
48 TestErrorSpam/start 0.85
49 TestErrorSpam/status 1.1
50 TestErrorSpam/pause 1.41
51 TestErrorSpam/unpause 1.53
52 TestErrorSpam/stop 12.02
55 TestFunctional/serial/CopySyncFile 0
56 TestFunctional/serial/StartWithProxy 57.79
57 TestFunctional/serial/AuditLog 0
58 TestFunctional/serial/SoftStart 34.58
59 TestFunctional/serial/KubeContext 0.08
60 TestFunctional/serial/KubectlGetPods 0.12
63 TestFunctional/serial/CacheCmd/cache/add_remote 3.26
64 TestFunctional/serial/CacheCmd/cache/add_local 1
65 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
66 TestFunctional/serial/CacheCmd/cache/list 0.06
67 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.34
68 TestFunctional/serial/CacheCmd/cache/cache_reload 1.76
69 TestFunctional/serial/CacheCmd/cache/delete 0.12
70 TestFunctional/serial/MinikubeKubectlCmd 0.14
71 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.14
72 TestFunctional/serial/ExtraConfig 37.59
73 TestFunctional/serial/ComponentHealth 0.11
74 TestFunctional/serial/LogsCmd 1.28
75 TestFunctional/serial/LogsFileCmd 1.4
76 TestFunctional/serial/InvalidService 4.92
78 TestFunctional/parallel/ConfigCmd 0.48
79 TestFunctional/parallel/DashboardCmd 15.77
80 TestFunctional/parallel/DryRun 0.67
81 TestFunctional/parallel/InternationalLanguage 0.29
82 TestFunctional/parallel/StatusCmd 1.3
86 TestFunctional/parallel/ServiceCmdConnect 7.74
87 TestFunctional/parallel/AddonsCmd 0.18
88 TestFunctional/parallel/PersistentVolumeClaim 26.41
90 TestFunctional/parallel/SSHCmd 0.78
91 TestFunctional/parallel/CpCmd 1.49
93 TestFunctional/parallel/FileSync 0.39
94 TestFunctional/parallel/CertSync 2.32
98 TestFunctional/parallel/NodeLabels 0.1
100 TestFunctional/parallel/NonActiveRuntimeDisabled 0.37
102 TestFunctional/parallel/License 0.41
103 TestFunctional/parallel/Version/short 0.08
104 TestFunctional/parallel/Version/components 0.82
105 TestFunctional/parallel/ImageCommands/ImageListShort 0.26
106 TestFunctional/parallel/ImageCommands/ImageListTable 0.23
107 TestFunctional/parallel/ImageCommands/ImageListJson 0.26
108 TestFunctional/parallel/ImageCommands/ImageListYaml 0.27
109 TestFunctional/parallel/ImageCommands/ImageBuild 3.45
110 TestFunctional/parallel/ImageCommands/Setup 2.78
111 TestFunctional/parallel/DockerEnv/bash 1.61
112 TestFunctional/parallel/UpdateContextCmd/no_changes 0.22
113 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.22
114 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.27
115 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 4.22
116 TestFunctional/parallel/ServiceCmd/DeployApp 12.33
117 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 2.9
118 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 5.21
119 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.87
120 TestFunctional/parallel/ImageCommands/ImageRemove 0.47
121 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 1.38
122 TestFunctional/parallel/ServiceCmd/List 0.47
123 TestFunctional/parallel/ServiceCmd/JSONOutput 0.49
124 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 3.8
125 TestFunctional/parallel/ServiceCmd/HTTPS 0.53
126 TestFunctional/parallel/ServiceCmd/Format 0.6
127 TestFunctional/parallel/ServiceCmd/URL 0.5
129 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.67
130 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
132 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.57
133 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.13
134 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0.01
138 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
139 TestFunctional/parallel/ProfileCmd/profile_not_create 0.56
140 TestFunctional/parallel/ProfileCmd/profile_list 0.45
141 TestFunctional/parallel/ProfileCmd/profile_json_output 0.51
142 TestFunctional/parallel/MountCmd/any-port 7.31
143 TestFunctional/parallel/MountCmd/specific-port 2.5
144 TestFunctional/parallel/MountCmd/VerifyCleanup 3.14
145 TestFunctional/delete_addon-resizer_images 0.08
146 TestFunctional/delete_my-image_image 0.02
147 TestFunctional/delete_minikube_cached_images 0.02
151 TestImageBuild/serial/Setup 30.93
152 TestImageBuild/serial/NormalBuild 1.81
153 TestImageBuild/serial/BuildWithBuildArg 0.93
154 TestImageBuild/serial/BuildWithDockerIgnore 0.77
155 TestImageBuild/serial/BuildWithSpecifiedDockerfile 0.76
158 TestIngressAddonLegacy/StartLegacyK8sCluster 74.4
160 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 11.07
161 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.58
165 TestJSONOutput/start/Command 84.02
166 TestJSONOutput/start/Audit 0
168 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
169 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
171 TestJSONOutput/pause/Command 0.61
172 TestJSONOutput/pause/Audit 0
174 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
175 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
177 TestJSONOutput/unpause/Command 0.57
178 TestJSONOutput/unpause/Audit 0
180 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
181 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
183 TestJSONOutput/stop/Command 5.99
184 TestJSONOutput/stop/Audit 0
186 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
187 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
188 TestErrorJSONOutput 0.23
190 TestKicCustomNetwork/create_custom_network 34.7
191 TestKicCustomNetwork/use_default_bridge_network 33.65
192 TestKicExistingNetwork 33.43
193 TestKicCustomSubnet 34.56
194 TestKicStaticIP 36.51
195 TestMainNoArgs 0.06
196 TestMinikubeProfile 76.01
199 TestMountStart/serial/StartWithMountFirst 8.24
200 TestMountStart/serial/VerifyMountFirst 0.28
201 TestMountStart/serial/StartWithMountSecond 10.39
202 TestMountStart/serial/VerifyMountSecond 0.28
203 TestMountStart/serial/DeleteFirst 1.5
204 TestMountStart/serial/VerifyMountPostDelete 0.27
205 TestMountStart/serial/Stop 1.22
206 TestMountStart/serial/RestartStopped 8.51
207 TestMountStart/serial/VerifyMountPostStop 0.3
210 TestMultiNode/serial/FreshStart2Nodes 83.26
211 TestMultiNode/serial/DeployApp2Nodes 40.33
212 TestMultiNode/serial/PingHostFrom2Pods 1.15
213 TestMultiNode/serial/AddNode 21.04
214 TestMultiNode/serial/ProfileList 0.37
215 TestMultiNode/serial/CopyFile 11.08
216 TestMultiNode/serial/StopNode 2.36
217 TestMultiNode/serial/StartAfterStop 14.37
218 TestMultiNode/serial/RestartKeepsNodes 125.91
219 TestMultiNode/serial/DeleteNode 5.05
220 TestMultiNode/serial/StopMultiNode 21.68
221 TestMultiNode/serial/RestartMultiNode 84.39
222 TestMultiNode/serial/ValidateNameConflict 36.76
227 TestPreload 193.45
229 TestScheduledStopUnix 103.56
230 TestSkaffold 110.07
232 TestInsufficientStorage 11
235 TestKubernetesUpgrade 222.82
236 TestMissingContainerUpgrade 127.45
238 TestNoKubernetes/serial/StartNoK8sWithVersion 0.09
239 TestNoKubernetes/serial/StartWithK8s 45.93
240 TestNoKubernetes/serial/StartWithStopK8s 16.67
241 TestNoKubernetes/serial/Start 7.37
242 TestNoKubernetes/serial/VerifyK8sNotRunning 0.29
243 TestNoKubernetes/serial/ProfileList 0.98
244 TestNoKubernetes/serial/Stop 1.24
245 TestNoKubernetes/serial/StartNoArgs 7.3
246 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.3
258 TestStoppedBinaryUpgrade/Setup 1.01
259 TestStoppedBinaryUpgrade/Upgrade 127.54
260 TestStoppedBinaryUpgrade/MinikubeLogs 1.72
269 TestPause/serial/Start 57.47
270 TestPause/serial/SecondStartNoReconfiguration 33.06
271 TestPause/serial/Pause 0.74
272 TestPause/serial/VerifyStatus 0.35
273 TestPause/serial/Unpause 0.58
274 TestPause/serial/PauseAgain 0.82
275 TestPause/serial/DeletePaused 2.11
276 TestPause/serial/VerifyDeletedResources 0.38
277 TestNetworkPlugins/group/auto/Start 83.03
278 TestNetworkPlugins/group/kindnet/Start 65.68
279 TestNetworkPlugins/group/auto/KubeletFlags 0.44
280 TestNetworkPlugins/group/auto/NetCatPod 10.55
281 TestNetworkPlugins/group/auto/DNS 0.26
282 TestNetworkPlugins/group/auto/Localhost 0.2
283 TestNetworkPlugins/group/auto/HairPin 0.21
284 TestNetworkPlugins/group/kindnet/ControllerPod 5.03
285 TestNetworkPlugins/group/calico/Start 96.65
286 TestNetworkPlugins/group/kindnet/KubeletFlags 0.46
287 TestNetworkPlugins/group/kindnet/NetCatPod 12.57
288 TestNetworkPlugins/group/kindnet/DNS 0.24
289 TestNetworkPlugins/group/kindnet/Localhost 0.27
290 TestNetworkPlugins/group/kindnet/HairPin 0.27
291 TestNetworkPlugins/group/custom-flannel/Start 71.08
292 TestNetworkPlugins/group/calico/ControllerPod 5.04
293 TestNetworkPlugins/group/calico/KubeletFlags 0.49
294 TestNetworkPlugins/group/calico/NetCatPod 12.68
295 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.35
296 TestNetworkPlugins/group/custom-flannel/NetCatPod 11.4
297 TestNetworkPlugins/group/calico/DNS 0.43
298 TestNetworkPlugins/group/calico/Localhost 0.3
299 TestNetworkPlugins/group/calico/HairPin 0.24
300 TestNetworkPlugins/group/custom-flannel/DNS 0.3
301 TestNetworkPlugins/group/custom-flannel/Localhost 0.27
302 TestNetworkPlugins/group/custom-flannel/HairPin 0.31
303 TestNetworkPlugins/group/false/Start 97.64
304 TestNetworkPlugins/group/enable-default-cni/Start 90.83
305 TestNetworkPlugins/group/false/KubeletFlags 0.32
306 TestNetworkPlugins/group/false/NetCatPod 10.42
307 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.43
308 TestNetworkPlugins/group/enable-default-cni/NetCatPod 9.4
309 TestNetworkPlugins/group/false/DNS 0.24
310 TestNetworkPlugins/group/false/Localhost 0.2
311 TestNetworkPlugins/group/false/HairPin 0.21
312 TestNetworkPlugins/group/enable-default-cni/DNS 0.23
313 TestNetworkPlugins/group/enable-default-cni/Localhost 0.22
314 TestNetworkPlugins/group/enable-default-cni/HairPin 0.2
315 TestNetworkPlugins/group/flannel/Start 71.12
316 TestNetworkPlugins/group/bridge/Start 57
317 TestNetworkPlugins/group/bridge/KubeletFlags 0.5
318 TestNetworkPlugins/group/bridge/NetCatPod 13.64
319 TestNetworkPlugins/group/flannel/ControllerPod 5.03
320 TestNetworkPlugins/group/bridge/DNS 0.24
321 TestNetworkPlugins/group/bridge/Localhost 0.2
322 TestNetworkPlugins/group/bridge/HairPin 0.21
323 TestNetworkPlugins/group/flannel/KubeletFlags 0.4
324 TestNetworkPlugins/group/flannel/NetCatPod 9.45
325 TestNetworkPlugins/group/flannel/DNS 0.29
326 TestNetworkPlugins/group/flannel/Localhost 0.3
327 TestNetworkPlugins/group/flannel/HairPin 0.32
328 TestNetworkPlugins/group/kubenet/Start 94.08
330 TestStartStop/group/old-k8s-version/serial/FirstStart 129.61
331 TestNetworkPlugins/group/kubenet/KubeletFlags 0.32
332 TestNetworkPlugins/group/kubenet/NetCatPod 9.36
333 TestNetworkPlugins/group/kubenet/DNS 0.21
334 TestNetworkPlugins/group/kubenet/Localhost 0.18
335 TestNetworkPlugins/group/kubenet/HairPin 0.18
337 TestStartStop/group/embed-certs/serial/FirstStart 88.8
338 TestStartStop/group/old-k8s-version/serial/DeployApp 9.7
339 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.86
340 TestStartStop/group/old-k8s-version/serial/Stop 10.94
341 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.29
342 TestStartStop/group/old-k8s-version/serial/SecondStart 446.2
343 TestStartStop/group/embed-certs/serial/DeployApp 9.55
344 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.21
345 TestStartStop/group/embed-certs/serial/Stop 10.83
346 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.19
347 TestStartStop/group/embed-certs/serial/SecondStart 598.93
348 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.03
349 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.11
350 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.37
351 TestStartStop/group/old-k8s-version/serial/Pause 3.21
353 TestStartStop/group/no-preload/serial/FirstStart 59.61
354 TestStartStop/group/no-preload/serial/DeployApp 9.55
355 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.28
356 TestStartStop/group/no-preload/serial/Stop 10.9
357 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.19
358 TestStartStop/group/no-preload/serial/SecondStart 340.24
359 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 5.02
360 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.13
361 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.4
362 TestStartStop/group/embed-certs/serial/Pause 3.22
364 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 57.4
365 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 8.52
366 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.2
367 TestStartStop/group/default-k8s-diff-port/serial/Stop 10.89
368 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.2
369 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 340.89
370 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 11.03
371 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.11
372 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.41
373 TestStartStop/group/no-preload/serial/Pause 3.2
375 TestStartStop/group/newest-cni/serial/FirstStart 50.16
376 TestStartStop/group/newest-cni/serial/DeployApp 0
377 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.2
378 TestStartStop/group/newest-cni/serial/Stop 11.07
379 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.2
380 TestStartStop/group/newest-cni/serial/SecondStart 32.68
381 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
382 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
383 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.38
384 TestStartStop/group/newest-cni/serial/Pause 3.28
385 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 17.02
386 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.1
387 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.36
388 TestStartStop/group/default-k8s-diff-port/serial/Pause 2.95
x
+
TestDownloadOnly/v1.16.0/json-events (11.6s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-705089 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-705089 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker: (11.601324753s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (11.60s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.14s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-705089
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-705089: exit status 85 (140.577137ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-705089 | jenkins | v1.31.0 | 19 Jul 23 23:48 UTC |          |
	|         | -p download-only-705089        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/19 23:48:43
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0719 23:48:43.927790  480510 out.go:296] Setting OutFile to fd 1 ...
	I0719 23:48:43.927972  480510 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:48:43.927982  480510 out.go:309] Setting ErrFile to fd 2...
	I0719 23:48:43.927988  480510 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:48:43.928253  480510 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	W0719 23:48:43.928402  480510 root.go:314] Error reading config file at /home/jenkins/minikube-integration/15585-475114/.minikube/config/config.json: open /home/jenkins/minikube-integration/15585-475114/.minikube/config/config.json: no such file or directory
	I0719 23:48:43.928830  480510 out.go:303] Setting JSON to true
	I0719 23:48:43.929739  480510 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":12669,"bootTime":1689797855,"procs":247,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0719 23:48:43.929804  480510 start.go:138] virtualization:  
	I0719 23:48:43.932695  480510 out.go:97] [download-only-705089] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0719 23:48:43.934446  480510 out.go:169] MINIKUBE_LOCATION=15585
	W0719 23:48:43.932973  480510 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball: no such file or directory
	I0719 23:48:43.933025  480510 notify.go:220] Checking for updates...
	I0719 23:48:43.936170  480510 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0719 23:48:43.937835  480510 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0719 23:48:43.939479  480510 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	I0719 23:48:43.941198  480510 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0719 23:48:43.944399  480510 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0719 23:48:43.944717  480510 driver.go:373] Setting default libvirt URI to qemu:///system
	I0719 23:48:43.969476  480510 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0719 23:48:43.969555  480510 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:48:44.069616  480510 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-07-19 23:48:44.058884501 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:48:44.069727  480510 docker.go:294] overlay module found
	I0719 23:48:44.071443  480510 out.go:97] Using the docker driver based on user configuration
	I0719 23:48:44.071469  480510 start.go:298] selected driver: docker
	I0719 23:48:44.071476  480510 start.go:880] validating driver "docker" against <nil>
	I0719 23:48:44.071592  480510 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:48:44.136633  480510 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-07-19 23:48:44.126938569 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:48:44.136802  480510 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0719 23:48:44.137075  480510 start_flags.go:382] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0719 23:48:44.137244  480510 start_flags.go:901] Wait components to verify : map[apiserver:true system_pods:true]
	I0719 23:48:44.139372  480510 out.go:169] Using Docker driver with root privileges
	I0719 23:48:44.140848  480510 cni.go:84] Creating CNI manager for ""
	I0719 23:48:44.140869  480510 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0719 23:48:44.140888  480510 start_flags.go:319] config:
	{Name:download-only-705089 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-705089 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:48:44.142677  480510 out.go:97] Starting control plane node download-only-705089 in cluster download-only-705089
	I0719 23:48:44.142699  480510 cache.go:122] Beginning downloading kic base image for docker with docker
	I0719 23:48:44.144260  480510 out.go:97] Pulling base image ...
	I0719 23:48:44.144289  480510 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0719 23:48:44.144371  480510 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0719 23:48:44.161177  480510 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0719 23:48:44.161364  480510 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0719 23:48:44.161457  480510 image.go:118] Writing gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0719 23:48:44.217801  480510 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I0719 23:48:44.217828  480510 cache.go:57] Caching tarball of preloaded images
	I0719 23:48:44.217967  480510 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0719 23:48:44.219998  480510 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0719 23:48:44.220023  480510 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0719 23:48:44.340331  480510 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I0719 23:48:51.760948  480510 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0719 23:48:52.016037  480510 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0719 23:48:52.016147  480510 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0719 23:48:52.917708  480510 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I0719 23:48:52.918063  480510 profile.go:148] Saving config to /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/download-only-705089/config.json ...
	I0719 23:48:52.918096  480510 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/download-only-705089/config.json: {Name:mk11707d5b9e1610594d9142c9422b6b0a2a28a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0719 23:48:52.918271  480510 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0719 23:48:52.918450  480510 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl.sha1 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/linux/arm64/v1.16.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-705089"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.14s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/json-events (9.88s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-705089 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-705089 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=docker --driver=docker  --container-runtime=docker: (9.876856607s)
--- PASS: TestDownloadOnly/v1.27.3/json-events (9.88s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/preload-exists
--- PASS: TestDownloadOnly/v1.27.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-705089
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-705089: exit status 85 (72.065137ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-705089 | jenkins | v1.31.0 | 19 Jul 23 23:48 UTC |          |
	|         | -p download-only-705089        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-705089 | jenkins | v1.31.0 | 19 Jul 23 23:48 UTC |          |
	|         | -p download-only-705089        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.27.3   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/19 23:48:55
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0719 23:48:55.671715  480584 out.go:296] Setting OutFile to fd 1 ...
	I0719 23:48:55.671859  480584 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:48:55.671870  480584 out.go:309] Setting ErrFile to fd 2...
	I0719 23:48:55.671876  480584 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:48:55.672144  480584 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	W0719 23:48:55.672265  480584 root.go:314] Error reading config file at /home/jenkins/minikube-integration/15585-475114/.minikube/config/config.json: open /home/jenkins/minikube-integration/15585-475114/.minikube/config/config.json: no such file or directory
	I0719 23:48:55.672485  480584 out.go:303] Setting JSON to true
	I0719 23:48:55.673391  480584 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":12681,"bootTime":1689797855,"procs":244,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0719 23:48:55.673457  480584 start.go:138] virtualization:  
	I0719 23:48:55.675530  480584 out.go:97] [download-only-705089] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0719 23:48:55.677169  480584 out.go:169] MINIKUBE_LOCATION=15585
	I0719 23:48:55.675846  480584 notify.go:220] Checking for updates...
	I0719 23:48:55.679144  480584 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0719 23:48:55.680858  480584 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0719 23:48:55.682574  480584 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	I0719 23:48:55.684285  480584 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0719 23:48:55.687524  480584 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0719 23:48:55.688005  480584 config.go:182] Loaded profile config "download-only-705089": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W0719 23:48:55.688104  480584 start.go:788] api.Load failed for download-only-705089: filestore "download-only-705089": Docker machine "download-only-705089" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0719 23:48:55.688248  480584 driver.go:373] Setting default libvirt URI to qemu:///system
	W0719 23:48:55.688273  480584 start.go:788] api.Load failed for download-only-705089: filestore "download-only-705089": Docker machine "download-only-705089" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0719 23:48:55.713608  480584 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0719 23:48:55.713688  480584 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:48:55.800054  480584 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-19 23:48:55.790334485 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:48:55.800161  480584 docker.go:294] overlay module found
	I0719 23:48:55.801830  480584 out.go:97] Using the docker driver based on existing profile
	I0719 23:48:55.801850  480584 start.go:298] selected driver: docker
	I0719 23:48:55.801856  480584 start.go:880] validating driver "docker" against &{Name:download-only-705089 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-705089 Namespace:default APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:48:55.802029  480584 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:48:55.877413  480584 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-19 23:48:55.867676844 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:48:55.877879  480584 cni.go:84] Creating CNI manager for ""
	I0719 23:48:55.877897  480584 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0719 23:48:55.877910  480584 start_flags.go:319] config:
	{Name:download-only-705089 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:download-only-705089 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:48:55.879860  480584 out.go:97] Starting control plane node download-only-705089 in cluster download-only-705089
	I0719 23:48:55.879885  480584 cache.go:122] Beginning downloading kic base image for docker with docker
	I0719 23:48:55.881644  480584 out.go:97] Pulling base image ...
	I0719 23:48:55.881668  480584 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0719 23:48:55.881838  480584 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0719 23:48:55.900182  480584 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0719 23:48:55.900286  480584 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0719 23:48:55.900309  480584 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory, skipping pull
	I0719 23:48:55.900317  480584 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in cache, skipping pull
	I0719 23:48:55.900328  480584 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0719 23:48:55.954853  480584 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	I0719 23:48:55.954890  480584 cache.go:57] Caching tarball of preloaded images
	I0719 23:48:55.955035  480584 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0719 23:48:55.956880  480584 out.go:97] Downloading Kubernetes v1.27.3 preload ...
	I0719 23:48:55.956904  480584 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4 ...
	I0719 23:48:56.082665  480584 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4?checksum=md5:e061b1178966dc348ac19219444153f4 -> /home/jenkins/minikube-integration/15585-475114/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-705089"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.27.3/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.23s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:187: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.23s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.14s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:199: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-705089
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.14s)

                                                
                                    
x
+
TestBinaryMirror (0.59s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:304: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-800167 --alsologtostderr --binary-mirror http://127.0.0.1:46523 --driver=docker  --container-runtime=docker
helpers_test.go:175: Cleaning up "binary-mirror-800167" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-800167
--- PASS: TestBinaryMirror (0.59s)

                                                
                                    
x
+
TestOffline (98.57s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-arm64 start -p offline-docker-936942 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-arm64 start -p offline-docker-936942 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker: (1m36.277155738s)
helpers_test.go:175: Cleaning up "offline-docker-936942" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p offline-docker-936942
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p offline-docker-936942: (2.295771185s)
--- PASS: TestOffline (98.57s)

                                                
                                    
x
+
TestAddons/Setup (174.45s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:88: (dbg) Run:  out/minikube-linux-arm64 start -p addons-634197 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns
addons_test.go:88: (dbg) Done: out/minikube-linux-arm64 start -p addons-634197 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns: (2m54.446736775s)
--- PASS: TestAddons/Setup (174.45s)

                                                
                                    
x
+
TestAddons/parallel/Registry (15.1s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:306: registry stabilized in 37.832107ms
addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-fdb5g" [2f3cf29a-3316-4f44-bd79-b9d19b97deae] Running
addons_test.go:308: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.010464037s
addons_test.go:311: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-zqrlw" [b7df39f3-7ae3-415b-a7a5-14dd17240780] Running
addons_test.go:311: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.017639365s
addons_test.go:316: (dbg) Run:  kubectl --context addons-634197 delete po -l run=registry-test --now
addons_test.go:321: (dbg) Run:  kubectl --context addons-634197 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:321: (dbg) Done: kubectl --context addons-634197 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.967713272s)
addons_test.go:335: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 ip
2023/07/19 23:52:16 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (15.10s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.76s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-rqfzn" [0972a257-1e7d-4d79-a151-05f26979deb8] Running
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.008208267s
addons_test.go:817: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-634197
addons_test.go:817: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-634197: (5.754854738s)
--- PASS: TestAddons/parallel/InspektorGadget (10.76s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.77s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:383: metrics-server stabilized in 4.430379ms
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-844d8db974-fbw76" [e435d8bd-667d-48eb-867e-b6d7e8615954] Running
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.010421651s
addons_test.go:391: (dbg) Run:  kubectl --context addons-634197 top pods -n kube-system
addons_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.77s)

                                                
                                    
x
+
TestAddons/parallel/CSI (44.22s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:537: csi-hostpath-driver pods stabilized in 6.93744ms
addons_test.go:540: (dbg) Run:  kubectl --context addons-634197 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:550: (dbg) Run:  kubectl --context addons-634197 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [7af7b50e-f768-4077-ace6-825151060d2f] Pending
helpers_test.go:344: "task-pv-pod" [7af7b50e-f768-4077-ace6-825151060d2f] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [7af7b50e-f768-4077-ace6-825151060d2f] Running
addons_test.go:555: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.009727674s
addons_test.go:560: (dbg) Run:  kubectl --context addons-634197 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-634197 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-634197 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:570: (dbg) Run:  kubectl --context addons-634197 delete pod task-pv-pod
addons_test.go:576: (dbg) Run:  kubectl --context addons-634197 delete pvc hpvc
addons_test.go:582: (dbg) Run:  kubectl --context addons-634197 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:587: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-634197 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:592: (dbg) Run:  kubectl --context addons-634197 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:597: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [04fb09ff-5501-42fc-8f3d-ad7c61d0ea26] Pending
helpers_test.go:344: "task-pv-pod-restore" [04fb09ff-5501-42fc-8f3d-ad7c61d0ea26] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [04fb09ff-5501-42fc-8f3d-ad7c61d0ea26] Running
addons_test.go:597: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.013211044s
addons_test.go:602: (dbg) Run:  kubectl --context addons-634197 delete pod task-pv-pod-restore
addons_test.go:602: (dbg) Done: kubectl --context addons-634197 delete pod task-pv-pod-restore: (1.349695719s)
addons_test.go:606: (dbg) Run:  kubectl --context addons-634197 delete pvc hpvc-restore
addons_test.go:610: (dbg) Run:  kubectl --context addons-634197 delete volumesnapshot new-snapshot-demo
addons_test.go:614: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:614: (dbg) Done: out/minikube-linux-arm64 -p addons-634197 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.749369098s)
addons_test.go:618: (dbg) Run:  out/minikube-linux-arm64 -p addons-634197 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (44.22s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (12.63s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:800: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-634197 --alsologtostderr -v=1
addons_test.go:800: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-634197 --alsologtostderr -v=1: (1.610204444s)
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-66f6498c69-c75fn" [89173637-3ceb-44a1-bf9c-46a55fe5f27f] Pending
helpers_test.go:344: "headlamp-66f6498c69-c75fn" [89173637-3ceb-44a1-bf9c-46a55fe5f27f] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-66f6498c69-c75fn" [89173637-3ceb-44a1-bf9c-46a55fe5f27f] Running / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-66f6498c69-c75fn" [89173637-3ceb-44a1-bf9c-46a55fe5f27f] Running
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 11.017610205s
--- PASS: TestAddons/parallel/Headlamp (12.63s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.59s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-88647b4cb-wsfr8" [dc077df6-03c8-4c7d-9cb6-790139f581ee] Running
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.009925269s
addons_test.go:836: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-634197
--- PASS: TestAddons/parallel/CloudSpanner (5.59s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.19s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:626: (dbg) Run:  kubectl --context addons-634197 create ns new-namespace
addons_test.go:640: (dbg) Run:  kubectl --context addons-634197 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.19s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (11.29s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:148: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-634197
addons_test.go:148: (dbg) Done: out/minikube-linux-arm64 stop -p addons-634197: (11.019125897s)
addons_test.go:152: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-634197
addons_test.go:156: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-634197
addons_test.go:161: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-634197
--- PASS: TestAddons/StoppedEnableDisable (11.29s)

                                                
                                    
x
+
TestCertOptions (43.32s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-156542 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-156542 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker: (40.445631639s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-156542 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-156542 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-156542 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-156542" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-156542
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-156542: (2.177246418s)
--- PASS: TestCertOptions (43.32s)

                                                
                                    
x
+
TestCertExpiration (261.91s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-204818 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-204818 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker: (46.284244621s)
E0720 00:25:14.359730  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-204818 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-204818 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker: (33.197365094s)
helpers_test.go:175: Cleaning up "cert-expiration-204818" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-204818
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-204818: (2.42385719s)
--- PASS: TestCertExpiration (261.91s)

                                                
                                    
x
+
TestDockerFlags (48.48s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-linux-arm64 start -p docker-flags-336126 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:51: (dbg) Done: out/minikube-linux-arm64 start -p docker-flags-336126 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (45.369990525s)
docker_test.go:56: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-336126 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:67: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-336126 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
helpers_test.go:175: Cleaning up "docker-flags-336126" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-flags-336126
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-flags-336126: (2.300698561s)
--- PASS: TestDockerFlags (48.48s)

                                                
                                    
x
+
TestForceSystemdFlag (48.98s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-103017 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-103017 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (46.2396166s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-103017 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-flag-103017" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-103017
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-103017: (2.189660099s)
--- PASS: TestForceSystemdFlag (48.98s)

                                                
                                    
x
+
TestForceSystemdEnv (42.4s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-820957 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-820957 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (39.577358644s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-820957 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-env-820957" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-820957
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-820957: (2.332335922s)
--- PASS: TestForceSystemdEnv (42.40s)

                                                
                                    
x
+
TestErrorSpam/setup (31.57s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-480184 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-480184 --driver=docker  --container-runtime=docker
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-480184 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-480184 --driver=docker  --container-runtime=docker: (31.570444011s)
--- PASS: TestErrorSpam/setup (31.57s)

                                                
                                    
x
+
TestErrorSpam/start (0.85s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 start --dry-run
--- PASS: TestErrorSpam/start (0.85s)

                                                
                                    
x
+
TestErrorSpam/status (1.1s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 status
--- PASS: TestErrorSpam/status (1.10s)

                                                
                                    
x
+
TestErrorSpam/pause (1.41s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 pause
--- PASS: TestErrorSpam/pause (1.41s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.53s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 unpause
--- PASS: TestErrorSpam/unpause (1.53s)

                                                
                                    
x
+
TestErrorSpam/stop (12.02s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 stop: (11.828551627s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-480184 --log_dir /tmp/nospam-480184 stop
--- PASS: TestErrorSpam/stop (12.02s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/15585-475114/.minikube/files/etc/test/nested/copy/480505/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (57.79s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-275751 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-275751 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker: (57.785747656s)
--- PASS: TestFunctional/serial/StartWithProxy (57.79s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (34.58s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-275751 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-275751 --alsologtostderr -v=8: (34.582332484s)
functional_test.go:659: soft start took 34.582851124s for "functional-275751" cluster.
--- PASS: TestFunctional/serial/SoftStart (34.58s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.08s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-275751 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.12s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.26s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 cache add registry.k8s.io/pause:3.1: (1.14133072s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 cache add registry.k8s.io/pause:3.3: (1.186986665s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.26s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-275751 /tmp/TestFunctionalserialCacheCmdcacheadd_local1543982202/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 cache add minikube-local-cache-test:functional-275751
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 cache delete minikube-local-cache-test:functional-275751
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-275751
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.00s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.34s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.34s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.76s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (352.522344ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.76s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 kubectl -- --context functional-275751 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-275751 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (37.59s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-275751 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-275751 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (37.587485951s)
functional_test.go:757: restart took 37.587576765s for "functional-275751" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (37.59s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-275751 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.28s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 logs: (1.279899927s)
--- PASS: TestFunctional/serial/LogsCmd (1.28s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.4s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 logs --file /tmp/TestFunctionalserialLogsFileCmd1450237342/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 logs --file /tmp/TestFunctionalserialLogsFileCmd1450237342/001/logs.txt: (1.395339704s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.40s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.92s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-275751 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-275751
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-275751: exit status 115 (558.21512ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:32058 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-275751 delete -f testdata/invalidsvc.yaml
E0719 23:57:01.682771  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0719 23:57:01.688602  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0719 23:57:01.698936  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0719 23:57:01.719183  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0719 23:57:01.759418  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0719 23:57:01.839694  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0719 23:57:02.000202  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
functional_test.go:2323: (dbg) Done: kubectl --context functional-275751 delete -f testdata/invalidsvc.yaml: (1.008420975s)
--- PASS: TestFunctional/serial/InvalidService (4.92s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 config get cpus: exit status 14 (73.547404ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 config set cpus 2
E0719 23:57:02.320521  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 config get cpus: exit status 14 (65.564109ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (15.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-275751 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-275751 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 520254: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (15.77s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-275751 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-275751 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (372.566974ms)

                                                
                                                
-- stdout --
	* [functional-275751] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=15585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0719 23:57:51.569496  519405 out.go:296] Setting OutFile to fd 1 ...
	I0719 23:57:51.571633  519405 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:57:51.571649  519405 out.go:309] Setting ErrFile to fd 2...
	I0719 23:57:51.571656  519405 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:57:51.572076  519405 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	I0719 23:57:51.573391  519405 out.go:303] Setting JSON to false
	I0719 23:57:51.575306  519405 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":13217,"bootTime":1689797855,"procs":254,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0719 23:57:51.575382  519405 start.go:138] virtualization:  
	I0719 23:57:51.582223  519405 out.go:177] * [functional-275751] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0719 23:57:51.584222  519405 out.go:177]   - MINIKUBE_LOCATION=15585
	I0719 23:57:51.586889  519405 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0719 23:57:51.584328  519405 notify.go:220] Checking for updates...
	I0719 23:57:51.596489  519405 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0719 23:57:51.598442  519405 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	I0719 23:57:51.600155  519405 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0719 23:57:51.601968  519405 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0719 23:57:51.604089  519405 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0719 23:57:51.604865  519405 driver.go:373] Setting default libvirt URI to qemu:///system
	I0719 23:57:51.638508  519405 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0719 23:57:51.638634  519405 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:57:51.803502  519405 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-07-19 23:57:51.789487669 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:57:51.803601  519405 docker.go:294] overlay module found
	I0719 23:57:51.805540  519405 out.go:177] * Using the docker driver based on existing profile
	I0719 23:57:51.807299  519405 start.go:298] selected driver: docker
	I0719 23:57:51.807317  519405 start.go:880] validating driver "docker" against &{Name:functional-275751 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-275751 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:57:51.807434  519405 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0719 23:57:51.812265  519405 out.go:177] 
	W0719 23:57:51.813964  519405 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0719 23:57:51.815552  519405 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-275751 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
--- PASS: TestFunctional/parallel/DryRun (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-275751 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-275751 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (286.120765ms)

                                                
                                                
-- stdout --
	* [functional-275751] minikube v1.31.0 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=15585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0719 23:57:52.188226  519620 out.go:296] Setting OutFile to fd 1 ...
	I0719 23:57:52.188422  519620 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:57:52.188428  519620 out.go:309] Setting ErrFile to fd 2...
	I0719 23:57:52.188433  519620 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0719 23:57:52.188843  519620 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	I0719 23:57:52.189213  519620 out.go:303] Setting JSON to false
	I0719 23:57:52.190333  519620 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":13218,"bootTime":1689797855,"procs":255,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0719 23:57:52.190403  519620 start.go:138] virtualization:  
	I0719 23:57:52.193069  519620 out.go:177] * [functional-275751] minikube v1.31.0 sur Ubuntu 20.04 (arm64)
	I0719 23:57:52.196375  519620 out.go:177]   - MINIKUBE_LOCATION=15585
	I0719 23:57:52.198094  519620 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0719 23:57:52.196614  519620 notify.go:220] Checking for updates...
	I0719 23:57:52.203966  519620 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	I0719 23:57:52.205489  519620 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	I0719 23:57:52.206902  519620 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0719 23:57:52.208439  519620 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0719 23:57:52.210540  519620 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0719 23:57:52.211063  519620 driver.go:373] Setting default libvirt URI to qemu:///system
	I0719 23:57:52.243119  519620 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0719 23:57:52.243213  519620 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0719 23:57:52.390849  519620 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-07-19 23:57:52.378256997 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0719 23:57:52.390962  519620 docker.go:294] overlay module found
	I0719 23:57:52.394679  519620 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0719 23:57:52.396705  519620 start.go:298] selected driver: docker
	I0719 23:57:52.396723  519620 start.go:880] validating driver "docker" against &{Name:functional-275751 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-275751 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0719 23:57:52.396944  519620 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0719 23:57:52.399325  519620 out.go:177] 
	W0719 23:57:52.400901  519620 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0719 23:57:52.402510  519620 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (7.74s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-275751 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-275751 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-58d66798bb-67g74" [03addecb-21bc-4ce5-b5a0-0136553fb308] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-58d66798bb-67g74" [03addecb-21bc-4ce5-b5a0-0136553fb308] Running
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 7.015002494s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:32554
functional_test.go:1674: http://192.168.49.2:32554: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-58d66798bb-67g74

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:32554
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (7.74s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (26.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [594371de-e579-4e62-81ae-9d28d5e33cd8] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.014791259s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-275751 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-275751 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-275751 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-275751 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [b1dc9ab1-c8ae-4616-93e4-e7f150a90280] Pending
helpers_test.go:344: "sp-pod" [b1dc9ab1-c8ae-4616-93e4-e7f150a90280] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [b1dc9ab1-c8ae-4616-93e4-e7f150a90280] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.012334428s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-275751 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-275751 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-275751 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [397f65d2-c9b8-4302-a15e-5d6e5ffddf06] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [397f65d2-c9b8-4302-a15e-5d6e5ffddf06] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 8.012930777s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-275751 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (26.41s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.78s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.78s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh -n functional-275751 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 cp functional-275751:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd956816849/001/cp-test.txt
E0719 23:57:02.961892  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh -n functional-275751 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.49s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/480505/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo cat /etc/test/nested/copy/480505/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/480505.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo cat /etc/ssl/certs/480505.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/480505.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo cat /usr/share/ca-certificates/480505.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/4805052.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo cat /etc/ssl/certs/4805052.pem"
E0719 23:57:06.802660  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/4805052.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo cat /usr/share/ca-certificates/4805052.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.32s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-275751 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 ssh "sudo systemctl is-active crio": exit status 1 (371.107108ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 version --short
--- PASS: TestFunctional/parallel/Version/short (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.82s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.82s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-275751 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.27.3
registry.k8s.io/kube-proxy:v1.27.3
registry.k8s.io/kube-controller-manager:v1.27.3
registry.k8s.io/kube-apiserver:v1.27.3
registry.k8s.io/etcd:3.5.7-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-275751
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-275751
docker.io/kubernetesui/metrics-scraper:<none>
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-275751 image ls --format short --alsologtostderr:
I0719 23:57:58.603449  520911 out.go:296] Setting OutFile to fd 1 ...
I0719 23:57:58.603619  520911 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:57:58.603625  520911 out.go:309] Setting ErrFile to fd 2...
I0719 23:57:58.603630  520911 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:57:58.603899  520911 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
I0719 23:57:58.604537  520911 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:57:58.604645  520911 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:57:58.605234  520911 cli_runner.go:164] Run: docker container inspect functional-275751 --format={{.State.Status}}
I0719 23:57:58.628526  520911 ssh_runner.go:195] Run: systemctl --version
I0719 23:57:58.628588  520911 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-275751
I0719 23:57:58.653572  520911 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33386 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/functional-275751/id_rsa Username:docker}
I0719 23:57:58.753860  520911 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-275751 image ls --format table --alsologtostderr:
|---------------------------------------------|-------------------|---------------|--------|
|                    Image                    |        Tag        |   Image ID    |  Size  |
|---------------------------------------------|-------------------|---------------|--------|
| registry.k8s.io/kube-controller-manager     | v1.27.3           | ab3683b584ae5 | 107MB  |
| registry.k8s.io/kube-proxy                  | v1.27.3           | fb73e92641fd5 | 66.5MB |
| registry.k8s.io/pause                       | latest            | 8cb2091f603e7 | 240kB  |
| docker.io/library/nginx                     | alpine            | 66bf2c914bf4d | 41MB   |
| registry.k8s.io/kube-apiserver              | v1.27.3           | 39dfb036b0986 | 115MB  |
| registry.k8s.io/coredns/coredns             | v1.10.1           | 97e04611ad434 | 51.4MB |
| registry.k8s.io/etcd                        | 3.5.7-0           | 24bc64e911039 | 181MB  |
| registry.k8s.io/pause                       | 3.9               | 829e9de338bd5 | 514kB  |
| docker.io/kubernetesui/metrics-scraper      | <none>            | a422e0e982356 | 42.3MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                | ba04bb24b9575 | 29MB   |
| gcr.io/google-containers/addon-resizer      | functional-275751 | ffd4cfbbe753e | 32.9MB |
| docker.io/localhost/my-image                | functional-275751 | 0f372d559063b | 1.41MB |
| docker.io/library/minikube-local-cache-test | functional-275751 | 11746741b30d9 | 30B    |
| registry.k8s.io/pause                       | 3.3               | 3d18732f8686c | 484kB  |
| registry.k8s.io/echoserver-arm              | 1.8               | 72565bf5bbedf | 85MB   |
| registry.k8s.io/pause                       | 3.1               | 8057e0500773a | 525kB  |
| registry.k8s.io/kube-scheduler              | v1.27.3           | bcb9e554eaab6 | 56.2MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc      | 1611cd07b61d5 | 3.55MB |
| docker.io/library/nginx                     | latest            | 2002d33a54f72 | 192MB  |
| docker.io/kubernetesui/dashboard            | <none>            | 20b332c9a70d8 | 244MB  |
|---------------------------------------------|-------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-275751 image ls --format table --alsologtostderr:
I0719 23:58:02.844088  521278 out.go:296] Setting OutFile to fd 1 ...
I0719 23:58:02.847507  521278 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:58:02.847530  521278 out.go:309] Setting ErrFile to fd 2...
I0719 23:58:02.847537  521278 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:58:02.847992  521278 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
I0719 23:58:02.849066  521278 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:58:02.849264  521278 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:58:02.850352  521278 cli_runner.go:164] Run: docker container inspect functional-275751 --format={{.State.Status}}
I0719 23:58:02.868151  521278 ssh_runner.go:195] Run: systemctl --version
I0719 23:58:02.868205  521278 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-275751
I0719 23:58:02.888415  521278 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33386 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/functional-275751/id_rsa Username:docker}
I0719 23:58:02.984560  521278 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
2023/07/19 23:58:07 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-275751 image ls --format json --alsologtostderr:
[{"id":"fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a","repoDigests":[],"repoTags":["registry.k8s.io/kube-proxy:v1.27.3"],"size":"66500000"},{"id":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":[],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"51400000"},{"id":"11746741b30d9e15a354d5fb71385c33b09f49aa1f840d559ee1916bc5444b38","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-275751"],"size":"30"},{"id":"66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea","repoDigests":[],"repoTags":["docker.io/library/nginx:alpine"],"size":"41000000"},{"id":"39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473","repoDigests":[],"repoTags":["registry.k8s.io/kube-apiserver:v1.27.3"],"size":"115000000"},{"id":"20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":[],"repoTags":["docker.io/kubernetesui/dashboard:\u003cnone\u003e"],"size":"244000000"},{"id":"3d18732f868
6cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"484000"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3550000"},{"id":"0f372d559063b08e4289da0a46c35ced9f7c34efcc78811980c80e366b6ad66e","repoDigests":[],"repoTags":["docker.io/localhost/my-image:functional-275751"],"size":"1410000"},{"id":"2002d33a54f72d1333751d4d1b4793a60a635eac6e94a98daf0acea501580c4f","repoDigests":[],"repoTags":["docker.io/library/nginx:latest"],"size":"192000000"},{"id":"24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737","repoDigests":[],"repoTags":["registry.k8s.io/etcd:3.5.7-0"],"size":"181000000"},{"id":"bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540","repoDigests":[],"repoTags":["registry.k8s.io/kube-scheduler:v1.27.3"],"size":"56200000"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":
[],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29000000"},{"id":"8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"240000"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-275751"],"size":"32900000"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"525000"},{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":[],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"85000000"},{"id":"ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8","repoDigests":[],"repoTags":["registry.k8s.io/kube-controller-manager:v1.27.3"],"size":"107000000"},{"id":"829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.9"],"
size":"514000"},{"id":"a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":[],"repoTags":["docker.io/kubernetesui/metrics-scraper:\u003cnone\u003e"],"size":"42300000"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-275751 image ls --format json --alsologtostderr:
I0719 23:58:02.591782  521245 out.go:296] Setting OutFile to fd 1 ...
I0719 23:58:02.591971  521245 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:58:02.591978  521245 out.go:309] Setting ErrFile to fd 2...
I0719 23:58:02.591983  521245 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:58:02.592262  521245 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
I0719 23:58:02.592836  521245 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:58:02.592942  521245 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:58:02.593396  521245 cli_runner.go:164] Run: docker container inspect functional-275751 --format={{.State.Status}}
I0719 23:58:02.621839  521245 ssh_runner.go:195] Run: systemctl --version
I0719 23:58:02.621894  521245 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-275751
I0719 23:58:02.662677  521245 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33386 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/functional-275751/id_rsa Username:docker}
I0719 23:58:02.756455  521245 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-275751 image ls --format yaml --alsologtostderr:
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "525000"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests: []
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "85000000"
- id: 11746741b30d9e15a354d5fb71385c33b09f49aa1f840d559ee1916bc5444b38
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-275751
size: "30"
- id: 2002d33a54f72d1333751d4d1b4793a60a635eac6e94a98daf0acea501580c4f
repoDigests: []
repoTags:
- docker.io/library/nginx:latest
size: "192000000"
- id: 24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737
repoDigests: []
repoTags:
- registry.k8s.io/etcd:3.5.7-0
size: "181000000"
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-275751
size: "32900000"
- id: 829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.9
size: "514000"
- id: a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests: []
repoTags:
- docker.io/kubernetesui/metrics-scraper:<none>
size: "42300000"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29000000"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "240000"
- id: fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a
repoDigests: []
repoTags:
- registry.k8s.io/kube-proxy:v1.27.3
size: "66500000"
- id: ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8
repoDigests: []
repoTags:
- registry.k8s.io/kube-controller-manager:v1.27.3
size: "107000000"
- id: bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540
repoDigests: []
repoTags:
- registry.k8s.io/kube-scheduler:v1.27.3
size: "56200000"
- id: 97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests: []
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "51400000"
- id: 39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473
repoDigests: []
repoTags:
- registry.k8s.io/kube-apiserver:v1.27.3
size: "115000000"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "484000"
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3550000"
- id: 66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea
repoDigests: []
repoTags:
- docker.io/library/nginx:alpine
size: "41000000"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-275751 image ls --format yaml --alsologtostderr:
I0719 23:57:58.868228  520937 out.go:296] Setting OutFile to fd 1 ...
I0719 23:57:58.868615  520937 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:57:58.868639  520937 out.go:309] Setting ErrFile to fd 2...
I0719 23:57:58.868646  520937 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:57:58.868958  520937 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
I0719 23:57:58.872102  520937 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:57:58.872216  520937 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:57:58.872654  520937 cli_runner.go:164] Run: docker container inspect functional-275751 --format={{.State.Status}}
I0719 23:57:58.894746  520937 ssh_runner.go:195] Run: systemctl --version
I0719 23:57:58.894799  520937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-275751
I0719 23:57:58.922046  520937 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33386 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/functional-275751/id_rsa Username:docker}
I0719 23:57:59.020858  520937 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 ssh pgrep buildkitd: exit status 1 (383.980503ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image build -t localhost/my-image:functional-275751 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 image build -t localhost/my-image:functional-275751 testdata/build --alsologtostderr: (2.819800541s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-275751 image build -t localhost/my-image:functional-275751 testdata/build --alsologtostderr:
I0719 23:57:59.535901  521014 out.go:296] Setting OutFile to fd 1 ...
I0719 23:57:59.536579  521014 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:57:59.536619  521014 out.go:309] Setting ErrFile to fd 2...
I0719 23:57:59.536642  521014 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0719 23:57:59.536947  521014 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
I0719 23:57:59.537584  521014 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:57:59.538192  521014 config.go:182] Loaded profile config "functional-275751": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0719 23:57:59.538745  521014 cli_runner.go:164] Run: docker container inspect functional-275751 --format={{.State.Status}}
I0719 23:57:59.557993  521014 ssh_runner.go:195] Run: systemctl --version
I0719 23:57:59.558044  521014 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-275751
I0719 23:57:59.578559  521014 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33386 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/functional-275751/id_rsa Username:docker}
I0719 23:57:59.668922  521014 build_images.go:151] Building image from path: /tmp/build.3200349043.tar
I0719 23:57:59.668990  521014 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0719 23:57:59.681786  521014 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.3200349043.tar
I0719 23:57:59.688648  521014 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.3200349043.tar: stat -c "%s %y" /var/lib/minikube/build/build.3200349043.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.3200349043.tar': No such file or directory
I0719 23:57:59.688724  521014 ssh_runner.go:362] scp /tmp/build.3200349043.tar --> /var/lib/minikube/build/build.3200349043.tar (3072 bytes)
I0719 23:57:59.738104  521014 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.3200349043
I0719 23:57:59.750080  521014 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.3200349043 -xf /var/lib/minikube/build/build.3200349043.tar
I0719 23:57:59.764045  521014 docker.go:339] Building image: /var/lib/minikube/build/build.3200349043
I0719 23:57:59.764123  521014 ssh_runner.go:195] Run: docker build -t localhost/my-image:functional-275751 /var/lib/minikube/build/build.3200349043
#0 building with "default" instance using docker driver

                                                
                                                
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 97B done
#2 DONE 0.0s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.8s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 770B / 770B done
#5 sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9 527B / 527B done
#5 sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02 1.47kB / 1.47kB done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.1s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.0s done
#5 DONE 0.4s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.7s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.0s done
#8 writing image sha256:0f372d559063b08e4289da0a46c35ced9f7c34efcc78811980c80e366b6ad66e done
#8 naming to localhost/my-image:functional-275751 done
#8 DONE 0.0s
I0719 23:58:02.205547  521014 ssh_runner.go:235] Completed: docker build -t localhost/my-image:functional-275751 /var/lib/minikube/build/build.3200349043: (2.44139731s)
I0719 23:58:02.205628  521014 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.3200349043
I0719 23:58:02.229647  521014 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.3200349043.tar
I0719 23:58:02.269943  521014 build_images.go:207] Built localhost/my-image:functional-275751 from /tmp/build.3200349043.tar
I0719 23:58:02.269971  521014 build_images.go:123] succeeded building to: functional-275751
I0719 23:58:02.269975  521014 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.45s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (2.78s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.751746717s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-275751
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.78s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (1.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-275751 docker-env) && out/minikube-linux-arm64 status -p functional-275751"
E0719 23:57:04.242430  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
functional_test.go:518: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-275751 docker-env) && docker images"
--- PASS: TestFunctional/parallel/DockerEnv/bash (1.61s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image load --daemon gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 image load --daemon gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr: (3.981908567s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.22s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (12.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-275751 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-275751 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-7b684b55f9-6p458" [146bf8da-e445-4b23-b984-4c8b0c1b8dea] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-7b684b55f9-6p458" [146bf8da-e445-4b23-b984-4c8b0c1b8dea] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 12.034491369s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (12.33s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.9s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image load --daemon gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr
E0719 23:57:11.923552  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 image load --daemon gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr: (2.63154708s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.90s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.814857618s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-275751
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image load --daemon gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 image load --daemon gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr: (3.145670513s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.21s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image save gcr.io/google-containers/addon-resizer:functional-275751 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.87s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image rm gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:408: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.104297571s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.38s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 service list -o json
functional_test.go:1493: Took "488.869864ms" to run "out/minikube-linux-arm64 -p functional-275751 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.49s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (3.8s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-275751
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 image save --daemon gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr
functional_test.go:423: (dbg) Done: out/minikube-linux-arm64 -p functional-275751 image save --daemon gcr.io/google-containers/addon-resizer:functional-275751 --alsologtostderr: (3.742587064s)
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-275751
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (3.80s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.49.2:30970
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.6s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 service hello-node --url --format={{.IP}}
E0719 23:57:22.164279  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.60s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:30970
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-275751 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-275751 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-275751 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 516939: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-275751 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-275751 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-275751 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [f15972b0-4ec5-47c6-ab41-493b321fd194] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [f15972b0-4ec5-47c6-ab41-493b321fd194] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.00847373s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.57s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-275751 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.98.52.188 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-275751 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.56s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
E0719 23:57:42.644765  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.56s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1314: Took "390.752586ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1328: Took "61.55034ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1365: Took "448.618171ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1378: Took "60.07961ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdany-port1802598696/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1689811063980841756" to /tmp/TestFunctionalparallelMountCmdany-port1802598696/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1689811063980841756" to /tmp/TestFunctionalparallelMountCmdany-port1802598696/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1689811063980841756" to /tmp/TestFunctionalparallelMountCmdany-port1802598696/001/test-1689811063980841756
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (469.548273ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jul 19 23:57 created-by-test
-rw-r--r-- 1 docker docker 24 Jul 19 23:57 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jul 19 23:57 test-1689811063980841756
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh cat /mount-9p/test-1689811063980841756
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-275751 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [4a69dbf3-059c-47e7-8fd6-b218e6ebca40] Pending
helpers_test.go:344: "busybox-mount" [4a69dbf3-059c-47e7-8fd6-b218e6ebca40] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [4a69dbf3-059c-47e7-8fd6-b218e6ebca40] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [4a69dbf3-059c-47e7-8fd6-b218e6ebca40] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.0155285s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-275751 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdany-port1802598696/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.31s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdspecific-port1746072867/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (550.349215ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdspecific-port1746072867/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 ssh "sudo umount -f /mount-9p": exit status 1 (460.014888ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-275751 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdspecific-port1746072867/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.50s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (3.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdVerifyCleanup4055726994/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdVerifyCleanup4055726994/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdVerifyCleanup4055726994/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T" /mount1: exit status 1 (1.331678864s)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-275751 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-275751 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdVerifyCleanup4055726994/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdVerifyCleanup4055726994/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-275751 /tmp/TestFunctionalparallelMountCmdVerifyCleanup4055726994/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (3.14s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.08s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-275751
--- PASS: TestFunctional/delete_addon-resizer_images (0.08s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-275751
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-275751
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (30.93s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -p image-127799 --driver=docker  --container-runtime=docker
E0719 23:58:23.604975  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
image_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -p image-127799 --driver=docker  --container-runtime=docker: (30.927901252s)
--- PASS: TestImageBuild/serial/Setup (30.93s)

                                                
                                    
x
+
TestImageBuild/serial/NormalBuild (1.81s)

                                                
                                                
=== RUN   TestImageBuild/serial/NormalBuild
image_test.go:78: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-127799
image_test.go:78: (dbg) Done: out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-127799: (1.809968142s)
--- PASS: TestImageBuild/serial/NormalBuild (1.81s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithBuildArg (0.93s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithBuildArg
image_test.go:99: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-127799
--- PASS: TestImageBuild/serial/BuildWithBuildArg (0.93s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithDockerIgnore (0.77s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithDockerIgnore
image_test.go:133: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal --build-opt=no-cache -p image-127799
--- PASS: TestImageBuild/serial/BuildWithDockerIgnore (0.77s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.76s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithSpecifiedDockerfile
image_test.go:88: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest -f inner/Dockerfile ./testdata/image-build/test-f -p image-127799
--- PASS: TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.76s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (74.4s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-arm64 start -p ingress-addon-legacy-520951 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E0719 23:59:45.526058  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-arm64 start -p ingress-addon-legacy-520951 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (1m14.395983175s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (74.40s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (11.07s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-520951 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-520951 addons enable ingress --alsologtostderr -v=5: (11.073801323s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (11.07s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.58s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-520951 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.58s)

                                                
                                    
x
+
TestJSONOutput/start/Command (84.02s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-295293 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker
E0720 00:02:01.682906  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:02:08.349285  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:08.354634  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:08.364880  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:08.385224  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:08.425540  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:08.505952  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:08.666385  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:08.986765  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:09.627742  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:10.907901  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:13.469264  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:18.589467  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:28.830002  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:02:29.366252  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-295293 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker: (1m24.015991525s)
--- PASS: TestJSONOutput/start/Command (84.02s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.61s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-295293 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.61s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.57s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-295293 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.57s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.99s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-295293 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-295293 --output=json --user=testUser: (5.992508128s)
--- PASS: TestJSONOutput/stop/Command (5.99s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.23s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-342413 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-342413 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (78.701821ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"1a692df2-a139-4e1d-a91f-b828be774de0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-342413] minikube v1.31.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"c4957477-ea18-4830-9c2f-96f27d5d7b1f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=15585"}}
	{"specversion":"1.0","id":"a4f3a2ec-be9a-432d-a2db-6b21ff8089ab","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"2a72b712-45f6-4295-9c7f-f1a6ab1e3c15","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig"}}
	{"specversion":"1.0","id":"66f2fbbd-c12a-4e97-aa76-ba08caa6b2c9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube"}}
	{"specversion":"1.0","id":"e2eecd61-2b33-4349-a618-3558c294a2ce","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"6e627729-66e4-4a77-8868-6fb2308da2fc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"da27ec6f-2423-4755-897a-84b67b1c54c1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-342413" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-342413
--- PASS: TestErrorJSONOutput (0.23s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (34.7s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-013490 --network=
E0720 00:02:49.310225  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-013490 --network=: (32.523463478s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-013490" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-013490
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-013490: (2.158299246s)
--- PASS: TestKicCustomNetwork/create_custom_network (34.70s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (33.65s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-874207 --network=bridge
E0720 00:03:30.270695  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-874207 --network=bridge: (31.653774969s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-874207" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-874207
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-874207: (1.978120599s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (33.65s)

                                                
                                    
x
+
TestKicExistingNetwork (33.43s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-127808 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-127808 --network=existing-network: (31.261762393s)
helpers_test.go:175: Cleaning up "existing-network-127808" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-127808
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-127808: (2.00785057s)
--- PASS: TestKicExistingNetwork (33.43s)

                                                
                                    
x
+
TestKicCustomSubnet (34.56s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-857294 --subnet=192.168.60.0/24
E0720 00:04:52.190920  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-857294 --subnet=192.168.60.0/24: (32.362758997s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-857294 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-857294" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-857294
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-857294: (2.174720495s)
--- PASS: TestKicCustomSubnet (34.56s)

                                                
                                    
x
+
TestKicStaticIP (36.51s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-702710 --static-ip=192.168.200.200
E0720 00:05:14.359346  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:14.364682  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:14.374919  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:14.395158  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:14.435392  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:14.515672  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:14.676010  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:14.996578  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:15.637397  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:16.917827  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:19.478031  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:24.598613  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:05:34.839677  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-702710 --static-ip=192.168.200.200: (34.286298533s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-702710 ip
helpers_test.go:175: Cleaning up "static-ip-702710" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-702710
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-702710: (2.063503312s)
--- PASS: TestKicStaticIP (36.51s)

                                                
                                    
x
+
TestMainNoArgs (0.06s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.06s)

                                                
                                    
x
+
TestMinikubeProfile (76.01s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-289516 --driver=docker  --container-runtime=docker
E0720 00:05:55.319867  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-289516 --driver=docker  --container-runtime=docker: (36.157589971s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-292207 --driver=docker  --container-runtime=docker
E0720 00:06:36.280085  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-292207 --driver=docker  --container-runtime=docker: (34.376049265s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-289516
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-292207
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-292207" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-292207
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-292207: (2.182139373s)
helpers_test.go:175: Cleaning up "first-289516" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-289516
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-289516: (2.093644225s)
--- PASS: TestMinikubeProfile (76.01s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (8.24s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-135100 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
E0720 00:07:01.682799  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-135100 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (7.23851673s)
--- PASS: TestMountStart/serial/StartWithMountFirst (8.24s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-135100 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.28s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (10.39s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-136914 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
E0720 00:07:08.349282  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-136914 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (9.385312668s)
--- PASS: TestMountStart/serial/StartWithMountSecond (10.39s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-136914 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.28s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.5s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-135100 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-135100 --alsologtostderr -v=5: (1.503536736s)
--- PASS: TestMountStart/serial/DeleteFirst (1.50s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-136914 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.27s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.22s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-136914
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-136914: (1.222115574s)
--- PASS: TestMountStart/serial/Stop (1.22s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (8.51s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-136914
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-136914: (7.513694065s)
--- PASS: TestMountStart/serial/RestartStopped (8.51s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.3s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-136914 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.30s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (83.26s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-986741 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E0720 00:07:36.031181  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:07:58.202471  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p multinode-986741 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m22.693480056s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (83.26s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (40.33s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-986741 -- rollout status deployment/busybox: (3.519016809s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-5sbft -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-rv9tz -- nslookup kubernetes.io
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-5sbft -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-rv9tz -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-5sbft -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-rv9tz -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (40.33s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.15s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-5sbft -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-5sbft -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-rv9tz -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-986741 -- exec busybox-67b7f59bb-rv9tz -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.15s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (21.04s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-986741 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-986741 -v 3 --alsologtostderr: (20.292832959s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (21.04s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.37s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.37s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (11.08s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp testdata/cp-test.txt multinode-986741:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1510639025/001/cp-test_multinode-986741.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741:/home/docker/cp-test.txt multinode-986741-m02:/home/docker/cp-test_multinode-986741_multinode-986741-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m02 "sudo cat /home/docker/cp-test_multinode-986741_multinode-986741-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741:/home/docker/cp-test.txt multinode-986741-m03:/home/docker/cp-test_multinode-986741_multinode-986741-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m03 "sudo cat /home/docker/cp-test_multinode-986741_multinode-986741-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp testdata/cp-test.txt multinode-986741-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1510639025/001/cp-test_multinode-986741-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741-m02:/home/docker/cp-test.txt multinode-986741:/home/docker/cp-test_multinode-986741-m02_multinode-986741.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741 "sudo cat /home/docker/cp-test_multinode-986741-m02_multinode-986741.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741-m02:/home/docker/cp-test.txt multinode-986741-m03:/home/docker/cp-test_multinode-986741-m02_multinode-986741-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m03 "sudo cat /home/docker/cp-test_multinode-986741-m02_multinode-986741-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp testdata/cp-test.txt multinode-986741-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1510639025/001/cp-test_multinode-986741-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741-m03:/home/docker/cp-test.txt multinode-986741:/home/docker/cp-test_multinode-986741-m03_multinode-986741.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741 "sudo cat /home/docker/cp-test_multinode-986741-m03_multinode-986741.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 cp multinode-986741-m03:/home/docker/cp-test.txt multinode-986741-m02:/home/docker/cp-test_multinode-986741-m03_multinode-986741-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 ssh -n multinode-986741-m02 "sudo cat /home/docker/cp-test_multinode-986741-m03_multinode-986741-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (11.08s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.36s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-arm64 -p multinode-986741 node stop m03: (1.242883863s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-986741 status: exit status 7 (557.475986ms)

                                                
                                                
-- stdout --
	multinode-986741
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-986741-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-986741-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-986741 status --alsologtostderr: exit status 7 (564.094773ms)

                                                
                                                
-- stdout --
	multinode-986741
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-986741-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-986741-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0720 00:10:08.039402  586059 out.go:296] Setting OutFile to fd 1 ...
	I0720 00:10:08.039600  586059 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0720 00:10:08.039629  586059 out.go:309] Setting ErrFile to fd 2...
	I0720 00:10:08.039649  586059 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0720 00:10:08.039946  586059 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	I0720 00:10:08.040152  586059 out.go:303] Setting JSON to false
	I0720 00:10:08.040297  586059 mustload.go:65] Loading cluster: multinode-986741
	I0720 00:10:08.040383  586059 notify.go:220] Checking for updates...
	I0720 00:10:08.041842  586059 config.go:182] Loaded profile config "multinode-986741": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0720 00:10:08.041880  586059 status.go:255] checking status of multinode-986741 ...
	I0720 00:10:08.043276  586059 cli_runner.go:164] Run: docker container inspect multinode-986741 --format={{.State.Status}}
	I0720 00:10:08.068100  586059 status.go:330] multinode-986741 host status = "Running" (err=<nil>)
	I0720 00:10:08.068126  586059 host.go:66] Checking if "multinode-986741" exists ...
	I0720 00:10:08.068494  586059 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-986741
	I0720 00:10:08.086841  586059 host.go:66] Checking if "multinode-986741" exists ...
	I0720 00:10:08.087185  586059 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0720 00:10:08.087238  586059 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-986741
	I0720 00:10:08.111881  586059 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33456 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/multinode-986741/id_rsa Username:docker}
	I0720 00:10:08.216452  586059 ssh_runner.go:195] Run: systemctl --version
	I0720 00:10:08.223224  586059 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0720 00:10:08.238557  586059 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0720 00:10:08.317633  586059 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:55 SystemTime:2023-07-20 00:10:08.308345318 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0720 00:10:08.318270  586059 kubeconfig.go:92] found "multinode-986741" server: "https://192.168.58.2:8443"
	I0720 00:10:08.318301  586059 api_server.go:166] Checking apiserver status ...
	I0720 00:10:08.318346  586059 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0720 00:10:08.331939  586059 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/2168/cgroup
	I0720 00:10:08.344975  586059 api_server.go:182] apiserver freezer: "13:freezer:/docker/0d2248a81a83b932a33540b50a296781676ff1599961a053d1b4777f02055d65/kubepods/burstable/pod14836352e7946030d48f0ed8dd1e7cdc/fe3be4fb6649ca1afc694ac5c598590bcc14e48fbaf9afe148bbbd30224f1b72"
	I0720 00:10:08.345044  586059 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/0d2248a81a83b932a33540b50a296781676ff1599961a053d1b4777f02055d65/kubepods/burstable/pod14836352e7946030d48f0ed8dd1e7cdc/fe3be4fb6649ca1afc694ac5c598590bcc14e48fbaf9afe148bbbd30224f1b72/freezer.state
	I0720 00:10:08.356867  586059 api_server.go:204] freezer state: "THAWED"
	I0720 00:10:08.356891  586059 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0720 00:10:08.366274  586059 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0720 00:10:08.366301  586059 status.go:421] multinode-986741 apiserver status = Running (err=<nil>)
	I0720 00:10:08.366312  586059 status.go:257] multinode-986741 status: &{Name:multinode-986741 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0720 00:10:08.366329  586059 status.go:255] checking status of multinode-986741-m02 ...
	I0720 00:10:08.366725  586059 cli_runner.go:164] Run: docker container inspect multinode-986741-m02 --format={{.State.Status}}
	I0720 00:10:08.383880  586059 status.go:330] multinode-986741-m02 host status = "Running" (err=<nil>)
	I0720 00:10:08.383900  586059 host.go:66] Checking if "multinode-986741-m02" exists ...
	I0720 00:10:08.384195  586059 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-986741-m02
	I0720 00:10:08.401681  586059 host.go:66] Checking if "multinode-986741-m02" exists ...
	I0720 00:10:08.401983  586059 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0720 00:10:08.402031  586059 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-986741-m02
	I0720 00:10:08.419344  586059 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33461 SSHKeyPath:/home/jenkins/minikube-integration/15585-475114/.minikube/machines/multinode-986741-m02/id_rsa Username:docker}
	I0720 00:10:08.513178  586059 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0720 00:10:08.526966  586059 status.go:257] multinode-986741-m02 status: &{Name:multinode-986741-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0720 00:10:08.526999  586059 status.go:255] checking status of multinode-986741-m03 ...
	I0720 00:10:08.527321  586059 cli_runner.go:164] Run: docker container inspect multinode-986741-m03 --format={{.State.Status}}
	I0720 00:10:08.545471  586059 status.go:330] multinode-986741-m03 host status = "Stopped" (err=<nil>)
	I0720 00:10:08.545496  586059 status.go:343] host is not running, skipping remaining checks
	I0720 00:10:08.545503  586059 status.go:257] multinode-986741-m03 status: &{Name:multinode-986741-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.36s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (14.37s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 node start m03 --alsologtostderr
E0720 00:10:14.359925  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
multinode_test.go:254: (dbg) Done: out/minikube-linux-arm64 -p multinode-986741 node start m03 --alsologtostderr: (13.520345153s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (14.37s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (125.91s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-986741
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-986741
E0720 00:10:42.042722  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
multinode_test.go:290: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-986741: (22.747683085s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-986741 --wait=true -v=8 --alsologtostderr
E0720 00:12:01.682213  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:12:08.348816  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-arm64 start -p multinode-986741 --wait=true -v=8 --alsologtostderr: (1m43.013357849s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-986741
--- PASS: TestMultiNode/serial/RestartKeepsNodes (125.91s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.05s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 node delete m03
multinode_test.go:394: (dbg) Done: out/minikube-linux-arm64 -p multinode-986741 node delete m03: (4.324837444s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.05s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (21.68s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 stop
multinode_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p multinode-986741 stop: (21.491385373s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-986741 status: exit status 7 (91.225476ms)

                                                
                                                
-- stdout --
	multinode-986741
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-986741-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-986741 status --alsologtostderr: exit status 7 (95.190425ms)

                                                
                                                
-- stdout --
	multinode-986741
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-986741-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0720 00:12:55.514308  601847 out.go:296] Setting OutFile to fd 1 ...
	I0720 00:12:55.514554  601847 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0720 00:12:55.514581  601847 out.go:309] Setting ErrFile to fd 2...
	I0720 00:12:55.514599  601847 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0720 00:12:55.520117  601847 root.go:338] Updating PATH: /home/jenkins/minikube-integration/15585-475114/.minikube/bin
	I0720 00:12:55.520518  601847 out.go:303] Setting JSON to false
	I0720 00:12:55.520686  601847 mustload.go:65] Loading cluster: multinode-986741
	I0720 00:12:55.521445  601847 notify.go:220] Checking for updates...
	I0720 00:12:55.521684  601847 config.go:182] Loaded profile config "multinode-986741": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0720 00:12:55.521728  601847 status.go:255] checking status of multinode-986741 ...
	I0720 00:12:55.522710  601847 cli_runner.go:164] Run: docker container inspect multinode-986741 --format={{.State.Status}}
	I0720 00:12:55.542986  601847 status.go:330] multinode-986741 host status = "Stopped" (err=<nil>)
	I0720 00:12:55.543008  601847 status.go:343] host is not running, skipping remaining checks
	I0720 00:12:55.543015  601847 status.go:257] multinode-986741 status: &{Name:multinode-986741 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0720 00:12:55.543041  601847 status.go:255] checking status of multinode-986741-m02 ...
	I0720 00:12:55.543375  601847 cli_runner.go:164] Run: docker container inspect multinode-986741-m02 --format={{.State.Status}}
	I0720 00:12:55.561697  601847 status.go:330] multinode-986741-m02 host status = "Stopped" (err=<nil>)
	I0720 00:12:55.561718  601847 status.go:343] host is not running, skipping remaining checks
	I0720 00:12:55.561725  601847 status.go:257] multinode-986741-m02 status: &{Name:multinode-986741-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (21.68s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (84.39s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-986741 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E0720 00:13:24.727350  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
multinode_test.go:354: (dbg) Done: out/minikube-linux-arm64 start -p multinode-986741 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m23.635101675s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-arm64 -p multinode-986741 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (84.39s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (36.76s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-986741
multinode_test.go:452: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-986741-m02 --driver=docker  --container-runtime=docker
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-986741-m02 --driver=docker  --container-runtime=docker: exit status 14 (87.055517ms)

                                                
                                                
-- stdout --
	* [multinode-986741-m02] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=15585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-986741-m02' is duplicated with machine name 'multinode-986741-m02' in profile 'multinode-986741'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-986741-m03 --driver=docker  --container-runtime=docker
multinode_test.go:460: (dbg) Done: out/minikube-linux-arm64 start -p multinode-986741-m03 --driver=docker  --container-runtime=docker: (34.11469173s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-986741
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-986741: exit status 80 (360.474462ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-986741
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-986741-m03 already exists in multinode-986741-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-986741-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-986741-m03: (2.140451471s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (36.76s)

                                                
                                    
x
+
TestPreload (193.45s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-699094 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4
E0720 00:15:14.359736  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-699094 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4: (1m43.214871244s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-699094 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-699094 image pull gcr.io/k8s-minikube/busybox: (1.613886325s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-699094
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-699094: (10.833860199s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-699094 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker
E0720 00:17:01.682685  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:17:08.349199  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-699094 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker: (1m15.376876606s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-699094 image list
helpers_test.go:175: Cleaning up "test-preload-699094" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-699094
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-699094: (2.179963037s)
--- PASS: TestPreload (193.45s)

                                                
                                    
x
+
TestScheduledStopUnix (103.56s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-996133 --memory=2048 --driver=docker  --container-runtime=docker
E0720 00:18:31.391448  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-996133 --memory=2048 --driver=docker  --container-runtime=docker: (30.263340508s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-996133 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-996133 -n scheduled-stop-996133
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-996133 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-996133 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-996133 -n scheduled-stop-996133
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-996133
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-996133 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-996133
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-996133: exit status 7 (69.077996ms)

                                                
                                                
-- stdout --
	scheduled-stop-996133
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-996133 -n scheduled-stop-996133
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-996133 -n scheduled-stop-996133: exit status 7 (68.154281ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-996133" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-996133
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-996133: (1.666090643s)
--- PASS: TestScheduledStopUnix (103.56s)

                                                
                                    
x
+
TestSkaffold (110.07s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /tmp/skaffold.exe352938538 version
skaffold_test.go:63: skaffold version: v2.6.0
skaffold_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p skaffold-371576 --memory=2600 --driver=docker  --container-runtime=docker
E0720 00:20:14.360293  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
skaffold_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p skaffold-371576 --memory=2600 --driver=docker  --container-runtime=docker: (34.295662854s)
skaffold_test.go:86: copying out/minikube-linux-arm64 to /home/jenkins/workspace/Docker_Linux_docker_arm64/out/minikube
skaffold_test.go:105: (dbg) Run:  /tmp/skaffold.exe352938538 run --minikube-profile skaffold-371576 --kube-context skaffold-371576 --status-check=true --port-forward=false --interactive=false
skaffold_test.go:105: (dbg) Done: /tmp/skaffold.exe352938538 run --minikube-profile skaffold-371576 --kube-context skaffold-371576 --status-check=true --port-forward=false --interactive=false: (1m0.921041627s)
skaffold_test.go:111: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-app" in namespace "default" ...
helpers_test.go:344: "leeroy-app-5b68c564dd-t9xl9" [d34f08d5-ba0b-424c-a09e-b5d8dcf387e5] Running
E0720 00:21:37.403663  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
skaffold_test.go:111: (dbg) TestSkaffold: app=leeroy-app healthy within 5.023389416s
skaffold_test.go:114: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-web" in namespace "default" ...
helpers_test.go:344: "leeroy-web-6c47589c5d-zcct6" [4e354559-e443-4f0d-826e-c59023efc700] Running
skaffold_test.go:114: (dbg) TestSkaffold: app=leeroy-web healthy within 5.006809317s
helpers_test.go:175: Cleaning up "skaffold-371576" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p skaffold-371576
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p skaffold-371576: (2.965445525s)
--- PASS: TestSkaffold (110.07s)

                                                
                                    
x
+
TestInsufficientStorage (11s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-904800 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-904800 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker: exit status 26 (8.669533414s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"ffb7da6e-23fa-44bd-a17d-3f6120fcd1e3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-904800] minikube v1.31.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"9495d17f-5888-41d0-97a3-19acdc1a9fb7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=15585"}}
	{"specversion":"1.0","id":"423e3743-7ebe-4fe7-b8bc-d18f3a68be27","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"5240e441-2d5b-4794-a936-b3d73ec9ea3f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig"}}
	{"specversion":"1.0","id":"48b7483e-14d4-4ca0-b175-5ceaa8605772","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube"}}
	{"specversion":"1.0","id":"84c2340f-2fb5-4b70-af76-3d892b149290","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"03441c38-e140-42b7-8399-0c4799db4c61","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"aa43b2e1-047d-46c4-a2f5-d7d3ada403e6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"0825fd9e-72b1-4a27-9994-29a4cf7db452","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"32d9e358-3b73-4457-b3fd-2a235e1a92ba","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"20c022cf-73bb-44ce-be13-7880750a9d26","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"68d6deaa-0324-4c88-aa57-4473a54d29a0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-904800 in cluster insufficient-storage-904800","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"26b01e0c-4dfb-4d93-b74f-26ec7500022b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"5e8943ed-63a9-4c48-9d2f-e1f9618d6d82","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"21c693b0-de59-4e48-8666-98212cc935b7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-904800 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-904800 --output=json --layout=cluster: exit status 7 (303.268446ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-904800","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.31.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-904800","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0720 00:21:56.730964  637954 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-904800" does not appear in /home/jenkins/minikube-integration/15585-475114/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-904800 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-904800 --output=json --layout=cluster: exit status 7 (314.369233ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-904800","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.31.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-904800","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0720 00:21:57.042696  638009 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-904800" does not appear in /home/jenkins/minikube-integration/15585-475114/kubeconfig
	E0720 00:21:57.056104  638009 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/insufficient-storage-904800/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-904800" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-904800
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-904800: (1.710967987s)
--- PASS: TestInsufficientStorage (11.00s)

                                                
                                    
x
+
TestKubernetesUpgrade (222.82s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-337851 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-337851 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m1.67372912s)
version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-337851
version_upgrade_test.go:239: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-337851: (12.184564396s)
version_upgrade_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-337851 status --format={{.Host}}
version_upgrade_test.go:244: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-337851 status --format={{.Host}}: exit status 7 (78.826451ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:246: status error: exit status 7 (may be ok)
version_upgrade_test.go:255: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-337851 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0720 00:30:04.727637  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:30:14.359379  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
version_upgrade_test.go:255: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-337851 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m46.970162738s)
version_upgrade_test.go:260: (dbg) Run:  kubectl --context kubernetes-upgrade-337851 version --output=json
version_upgrade_test.go:279: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:281: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-337851 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker
version_upgrade_test.go:281: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-337851 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker: exit status 106 (90.018459ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-337851] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=15585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.27.3 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-337851
	    minikube start -p kubernetes-upgrade-337851 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-3378512 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.27.3, by running:
	    
	    minikube start -p kubernetes-upgrade-337851 --kubernetes-version=v1.27.3
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:285: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:287: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-337851 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0720 00:32:01.682831  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:32:02.461655  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:32:08.349068  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
version_upgrade_test.go:287: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-337851 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (39.312061042s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-337851" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-337851
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-337851: (2.374442127s)
--- PASS: TestKubernetesUpgrade (222.82s)

                                                
                                    
x
+
TestMissingContainerUpgrade (127.45s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:321: (dbg) Run:  /tmp/minikube-v1.17.0.1391918618.exe start -p missing-upgrade-303282 --memory=2200 --driver=docker  --container-runtime=docker
E0720 00:27:56.697407  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
version_upgrade_test.go:321: (dbg) Done: /tmp/minikube-v1.17.0.1391918618.exe start -p missing-upgrade-303282 --memory=2200 --driver=docker  --container-runtime=docker: (1m4.857745882s)
version_upgrade_test.go:330: (dbg) Run:  docker stop missing-upgrade-303282
version_upgrade_test.go:330: (dbg) Done: docker stop missing-upgrade-303282: (1.368936708s)
version_upgrade_test.go:335: (dbg) Run:  docker rm missing-upgrade-303282
version_upgrade_test.go:341: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-303282 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0720 00:29:18.621202  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
version_upgrade_test.go:341: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-303282 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (57.51867871s)
helpers_test.go:175: Cleaning up "missing-upgrade-303282" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-303282
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-303282: (2.338098649s)
--- PASS: TestMissingContainerUpgrade (127.45s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-443169 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-443169 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker: exit status 14 (91.321589ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-443169] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=15585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/15585-475114/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/15585-475114/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (45.93s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-443169 --driver=docker  --container-runtime=docker
E0720 00:22:01.682798  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:22:08.348577  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-443169 --driver=docker  --container-runtime=docker: (45.523101346s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-443169 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (45.93s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (16.67s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-443169 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-443169 --no-kubernetes --driver=docker  --container-runtime=docker: (14.563120807s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-443169 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-443169 status -o json: exit status 2 (343.395016ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-443169","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-443169
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-443169: (1.759673818s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (16.67s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (7.37s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-443169 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-443169 --no-kubernetes --driver=docker  --container-runtime=docker: (7.373332282s)
--- PASS: TestNoKubernetes/serial/Start (7.37s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.29s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-443169 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-443169 "sudo systemctl is-active --quiet service kubelet": exit status 1 (290.038902ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.29s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.98s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.98s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.24s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-443169
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-443169: (1.240855411s)
--- PASS: TestNoKubernetes/serial/Stop (1.24s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.3s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-443169 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-443169 --driver=docker  --container-runtime=docker: (7.302935982s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.30s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.3s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-443169 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-443169 "sudo systemctl is-active --quiet service kubelet": exit status 1 (299.199275ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.30s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.01s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.01s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (127.54s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:195: (dbg) Run:  /tmp/minikube-v1.17.0.3453379870.exe start -p stopped-upgrade-347219 --memory=2200 --vm-driver=docker  --container-runtime=docker
E0720 00:26:34.763459  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:34.769365  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:34.779622  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:34.799881  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:34.840108  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:34.920608  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:35.080858  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:35.401280  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:36.042139  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:37.322663  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:39.883639  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:45.015222  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:26:55.256024  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:27:01.682410  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
version_upgrade_test.go:195: (dbg) Done: /tmp/minikube-v1.17.0.3453379870.exe start -p stopped-upgrade-347219 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m24.485058455s)
version_upgrade_test.go:204: (dbg) Run:  /tmp/minikube-v1.17.0.3453379870.exe -p stopped-upgrade-347219 stop
version_upgrade_test.go:204: (dbg) Done: /tmp/minikube-v1.17.0.3453379870.exe -p stopped-upgrade-347219 stop: (1.309675111s)
version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-347219 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0720 00:27:08.349512  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:27:15.736383  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
version_upgrade_test.go:210: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-347219 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (41.747501399s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (127.54s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.72s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:218: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-347219
version_upgrade_test.go:218: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-347219: (1.7210608s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.72s)

                                                
                                    
x
+
TestPause/serial/Start (57.47s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-491760 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-491760 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker: (57.468899847s)
--- PASS: TestPause/serial/Start (57.47s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (33.06s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-491760 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-491760 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (33.036320633s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (33.06s)

                                                
                                    
x
+
TestPause/serial/Pause (0.74s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-491760 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.74s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.35s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-491760 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-491760 --output=json --layout=cluster: exit status 2 (354.159006ms)

                                                
                                                
-- stdout --
	{"Name":"pause-491760","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 12 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.31.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-491760","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.35s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.58s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-491760 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.58s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (0.82s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-491760 --alsologtostderr -v=5
--- PASS: TestPause/serial/PauseAgain (0.82s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.11s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-491760 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-491760 --alsologtostderr -v=5: (2.110771678s)
--- PASS: TestPause/serial/DeletePaused (2.11s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.38s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-491760
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-491760: exit status 1 (17.478752ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-491760: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (83.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker: (1m23.028354317s)
--- PASS: TestNetworkPlugins/group/auto/Start (83.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (65.68s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker
E0720 00:35:11.391782  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:35:14.359259  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker: (1m5.680045228s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (65.68s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.44s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.44s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (10.55s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-9pdt7" [818922cd-254a-4060-8651-695259fa3ca7] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-9pdt7" [818922cd-254a-4060-8651-695259fa3ca7] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 10.012892971s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (10.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-zkdwl" [69c6349d-eb89-43d8-94ab-9d8de175e53e] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.027872859s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (96.65s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker: (1m36.651614426s)
--- PASS: TestNetworkPlugins/group/calico/Start (96.65s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.46s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (12.57s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-5lppl" [55d1e0a8-d76f-4dc0-baab-bae6e1a857af] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-5lppl" [55d1e0a8-d76f-4dc0-baab-bae6e1a857af] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 12.010790902s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (12.57s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (71.08s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker
E0720 00:37:01.682499  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:37:08.349281  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker: (1m11.075496003s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (71.08s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-jrgg2" [7ce7bf94-7d57-4528-8e77-9bfa80e5cf1e] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.035630705s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.49s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.49s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (12.68s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-7wh6j" [dc5bc402-f4b8-483c-ae9f-cabd11630c0f] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-7wh6j" [dc5bc402-f4b8-483c-ae9f-cabd11630c0f] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 12.017420222s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (12.68s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (11.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-gcmwp" [e58f8ba3-554e-4ac5-9e79-a6628ee64939] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-gcmwp" [e58f8ba3-554e-4ac5-9e79-a6628ee64939] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 11.008845808s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (11.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (97.64s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p false-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p false-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker: (1m37.635182872s)
--- PASS: TestNetworkPlugins/group/false/Start (97.64s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (90.83s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker: (1m30.834622805s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (90.83s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p false-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/false/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/NetCatPod (10.42s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context false-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-q58ww" [6971cdb0-6029-4540-8732-f0ebf3ab130a] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-q58ww" [6971cdb0-6029-4540-8732-f0ebf3ab130a] Running
E0720 00:40:14.359253  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: app=netcat healthy within 10.008782691s
--- PASS: TestNetworkPlugins/group/false/NetCatPod (10.42s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-z8kkn" [3bb2d50b-05ed-42ad-a0be-429f7332191c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-z8kkn" [3bb2d50b-05ed-42ad-a0be-429f7332191c] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.00906583s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/DNS
net_test.go:175: (dbg) Run:  kubectl --context false-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/false/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Localhost
net_test.go:194: (dbg) Run:  kubectl --context false-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/false/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/HairPin
net_test.go:264: (dbg) Run:  kubectl --context false-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/false/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (71.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker: (1m11.123991135s)
--- PASS: TestNetworkPlugins/group/flannel/Start (71.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (57s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker
E0720 00:40:51.176650  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 00:41:00.928156  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:00.933422  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:00.943702  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:00.963906  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:01.004123  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:01.084342  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:01.245313  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:01.566356  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:02.206622  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:03.487375  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:06.048232  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:11.168565  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:11.657327  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 00:41:21.408846  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:41:34.763585  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:41:41.889251  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker: (56.998119275s)
--- PASS: TestNetworkPlugins/group/bridge/Start (57.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.5s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.50s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (13.64s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-jdf5c" [99d5dd52-fe24-441e-966f-9f6529963246] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-jdf5c" [99d5dd52-fe24-441e-966f-9f6529963246] Running
E0720 00:41:52.617972  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 13.019020858s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (13.64s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-f5r9g" [2adf27dd-3f13-4a03-a3e7-25b927b14ea0] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.027646907s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (9.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-6qsww" [f47371ad-ab9d-4c7d-a26d-93a8a9f5d029] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0720 00:42:01.683119  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-6qsww" [f47371ad-ab9d-4c7d-a26d-93a8a9f5d029] Running
E0720 00:42:08.348830  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.011835154s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (94.08s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kubenet-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker
E0720 00:42:22.849388  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kubenet-010184 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker: (1m34.08252608s)
--- PASS: TestNetworkPlugins/group/kubenet/Start (94.08s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (129.61s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-409469 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E0720 00:42:41.920131  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:41.925458  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:41.935682  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:41.955919  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:41.996158  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:42.076415  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:42.236784  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:42.557281  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:43.197448  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:44.478283  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:47.039309  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:52.159969  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:42:57.822625  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:42:58.425652  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:42:58.430859  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:42:58.441092  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:42:58.461295  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:42:58.501532  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:42:58.581757  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:42:58.742076  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:42:59.062563  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:42:59.702845  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:43:00.983641  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:43:02.400581  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:43:03.544662  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:43:08.665092  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:43:14.539343  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 00:43:18.905656  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:43:22.880796  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:43:39.386446  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:43:44.770393  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-409469 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (2m9.612678161s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (129.61s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kubenet-010184 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kubenet/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/NetCatPod (9.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kubenet-010184 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-qw4gq" [a70cd2b7-edb7-4ce8-8cf1-192f07907c82] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-qw4gq" [a70cd2b7-edb7-4ce8-8cf1-192f07907c82] Running
E0720 00:44:03.841810  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: app=netcat healthy within 9.00968098s
--- PASS: TestNetworkPlugins/group/kubenet/NetCatPod (9.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/DNS (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kubenet-010184 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kubenet/DNS (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kubenet-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kubenet/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kubenet-010184 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kubenet/HairPin (0.18s)
E0720 01:02:01.682563  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 01:02:08.349434  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 01:02:41.919855  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 01:02:58.424871  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 01:03:08.266629  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 01:03:17.221486  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 01:03:24.728845  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (88.8s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-564758 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-564758 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m28.802654349s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (88.80s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.7s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-409469 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [39ae7c8d-9e8a-4aaa-b13a-d496b8bda4c9] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [39ae7c8d-9e8a-4aaa-b13a-d496b8bda4c9] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.041919864s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-409469 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.70s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.86s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-409469 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-409469 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.734489859s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-409469 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.86s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (10.94s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-409469 --alsologtostderr -v=3
E0720 00:45:06.608966  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:06.614356  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:06.624697  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:06.645027  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:06.685377  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:06.765738  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:06.926661  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:07.247214  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:07.888374  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:09.169113  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-409469 --alsologtostderr -v=3: (10.94207286s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (10.94s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-409469 -n old-k8s-version-409469
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-409469 -n old-k8s-version-409469: exit status 7 (105.265ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-409469 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.29s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (446.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-409469 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E0720 00:45:10.688590  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:10.693838  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:10.704057  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:10.724274  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:10.765341  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:10.845487  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:11.005965  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:11.327036  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:11.729787  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:11.967725  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:13.247998  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:14.361473  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:45:15.809060  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:16.850210  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:20.929305  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:25.761940  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:45:27.090793  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:30.684718  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 00:45:31.170184  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:45:42.268318  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:45:47.571361  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:45:51.650399  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-409469 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (7m25.795098766s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-409469 -n old-k8s-version-409469
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (446.20s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.55s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-564758 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [c266f1be-2b88-4d15-ae34-828a1e74c575] Pending
helpers_test.go:344: "busybox" [c266f1be-2b88-4d15-ae34-828a1e74c575] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
E0720 00:45:58.380112  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 00:46:00.928783  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
helpers_test.go:344: "busybox" [c266f1be-2b88-4d15-ae34-828a1e74c575] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.03029958s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-564758 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.55s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.21s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-564758 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-564758 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.058960463s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-564758 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (10.83s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-564758 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-564758 --alsologtostderr -v=3: (10.832430222s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (10.83s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-564758 -n embed-certs-564758
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-564758 -n embed-certs-564758: exit status 7 (75.7738ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-564758 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (598.93s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-564758 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0720 00:46:28.532480  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:46:28.611351  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:46:32.610647  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:46:34.763038  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:46:44.728645  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:46:45.221362  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:45.227498  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:45.237752  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:45.257989  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:45.298223  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:45.378453  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:45.539055  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:45.859195  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:46.500351  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:47.780806  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:50.341761  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:54.177051  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:54.182317  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:54.192571  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:54.212830  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:54.253085  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:54.333793  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:54.494259  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:54.814657  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:55.455529  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:55.462681  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:46:56.736615  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:46:59.296807  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:47:01.682839  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:47:04.417247  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:47:05.703126  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:47:08.348663  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:47:14.658257  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:47:26.184116  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:47:35.139084  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:47:41.919683  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:47:50.453836  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:47:54.531026  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:47:58.425760  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:48:07.145016  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:48:09.602921  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:48:16.099723  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:48:26.109191  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:48:57.367314  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:57.372589  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:57.382928  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:57.403255  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:57.443429  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:57.523756  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:57.684095  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:58.004795  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:58.645935  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:48:59.926971  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:49:02.487206  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:49:07.608147  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:49:17.848428  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:49:29.065819  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:49:38.020369  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:49:38.328634  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:50:06.609631  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:50:10.687876  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:50:14.359779  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:50:19.289043  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:50:30.684559  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 00:50:34.294304  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:50:38.371461  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:51:00.928364  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:51:34.764077  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:51:41.210074  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:51:45.221384  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:51:51.392161  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:51:54.176890  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:52:01.682627  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:52:08.349425  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:52:12.906006  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:52:21.861003  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-564758 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (9m58.503432028s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-564758 -n embed-certs-564758
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (598.93s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-hjsts" [593d1d00-7489-4c96-9978-1bafb4ba224d] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.025139747s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-hjsts" [593d1d00-7489-4c96-9978-1bafb4ba224d] Running
E0720 00:52:41.919184  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.006395762s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-409469 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.37s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p old-k8s-version-409469 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.37s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.21s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-409469 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-409469 -n old-k8s-version-409469
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-409469 -n old-k8s-version-409469: exit status 2 (360.48987ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-409469 -n old-k8s-version-409469
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-409469 -n old-k8s-version-409469: exit status 2 (361.481137ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-409469 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-409469 -n old-k8s-version-409469
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-409469 -n old-k8s-version-409469
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.21s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (59.61s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-888436 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0720 00:52:58.424894  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-888436 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (59.60149869s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (59.61s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (9.55s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-888436 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [0098442b-b61b-4e90-805a-7aa27a5c9fd3] Pending
helpers_test.go:344: "busybox" [0098442b-b61b-4e90-805a-7aa27a5c9fd3] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [0098442b-b61b-4e90-805a-7aa27a5c9fd3] Running
E0720 00:53:57.366483  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.028707942s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-888436 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.55s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.28s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-888436 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-888436 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.168761746s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-888436 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.28s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (10.9s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-888436 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-888436 --alsologtostderr -v=3: (10.900777194s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (10.90s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-888436 -n no-preload-888436
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-888436 -n no-preload-888436: exit status 7 (68.704487ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-888436 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (340.24s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-888436 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0720 00:54:25.051090  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:54:47.986809  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:47.992132  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:48.002393  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:48.022684  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:48.063072  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:48.143340  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:48.303480  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:48.624138  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:49.264511  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:50.544915  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:53.105990  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:54:57.404827  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:54:58.226822  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:55:06.609642  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 00:55:08.468037  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:55:10.688117  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 00:55:14.360112  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
E0720 00:55:28.948245  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
E0720 00:55:30.684220  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 00:56:00.928779  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
E0720 00:56:09.909299  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-888436 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m39.701239331s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-888436 -n no-preload-888436
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (340.24s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.02s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-ljjf6" [2998c62d-dc59-447d-bdc9-0830898f1db0] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.022907657s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.02s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.13s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-ljjf6" [2998c62d-dc59-447d-bdc9-0830898f1db0] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007411425s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-564758 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.13s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.4s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p embed-certs-564758 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.40s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.22s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-564758 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-564758 -n embed-certs-564758
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-564758 -n embed-certs-564758: exit status 2 (356.611964ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-564758 -n embed-certs-564758
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-564758 -n embed-certs-564758: exit status 2 (360.178982ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-564758 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-564758 -n embed-certs-564758
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-564758 -n embed-certs-564758
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.22s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (57.4s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-636033 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0720 00:56:34.763378  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:56:45.220783  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
E0720 00:56:53.740341  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 00:56:54.176975  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
E0720 00:57:01.682096  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/addons-634197/client.crt: no such file or directory
E0720 00:57:08.349236  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/functional-275751/client.crt: no such file or directory
E0720 00:57:23.972515  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-636033 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (57.39539765s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (57.40s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.52s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-636033 create -f testdata/busybox.yaml
E0720 00:57:31.829791  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [0919105f-786a-4634-9f20-5438b396ea44] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [0919105f-786a-4634-9f20-5438b396ea44] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.028150077s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-636033 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.52s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-636033 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-636033 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.076960897s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-636033 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (10.89s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-636033 --alsologtostderr -v=3
E0720 00:57:41.919327  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-636033 --alsologtostderr -v=3: (10.893073157s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (10.89s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033: exit status 7 (79.242164ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-636033 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (340.89s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-636033 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0720 00:57:58.424861  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:58:57.366939  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
E0720 00:59:04.963524  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/calico-010184/client.crt: no such file or directory
E0720 00:59:21.470159  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/custom-flannel-010184/client.crt: no such file or directory
E0720 00:59:37.823190  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 00:59:47.986816  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/old-k8s-version-409469/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-636033 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m40.481181047s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (340.89s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (11.03s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-gp225" [0d1f8f20-7d52-427d-ab08-c401cd7be350] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-gp225" [0d1f8f20-7d52-427d-ab08-c401cd7be350] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 11.02704575s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (11.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-gp225" [0d1f8f20-7d52-427d-ab08-c401cd7be350] Running
E0720 01:00:06.609997  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 01:00:10.688620  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.008411729s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-888436 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.41s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p no-preload-888436 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.41s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.2s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-888436 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-888436 -n no-preload-888436
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-888436 -n no-preload-888436: exit status 2 (365.727904ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-888436 -n no-preload-888436
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-888436 -n no-preload-888436: exit status 2 (335.661456ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-888436 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-888436 -n no-preload-888436
E0720 01:00:14.359442  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/ingress-addon-legacy-520951/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-888436 -n no-preload-888436
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.20s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (50.16s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-913894 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0720 01:00:30.684805  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/auto-010184/client.crt: no such file or directory
E0720 01:01:00.928553  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kindnet-010184/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-913894 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (50.155631477s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (50.16s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.2s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-913894 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-913894 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.200036484s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.20s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (11.07s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-913894 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-913894 --alsologtostderr -v=3: (11.070280357s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (11.07s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-913894 -n newest-cni-913894
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-913894 -n newest-cni-913894: exit status 7 (80.592194ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-913894 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (32.68s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-913894 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0720 01:01:29.654715  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/false-010184/client.crt: no such file or directory
E0720 01:01:33.732654  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/enable-default-cni-010184/client.crt: no such file or directory
E0720 01:01:34.763032  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/skaffold-371576/client.crt: no such file or directory
E0720 01:01:45.220807  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/bridge-010184/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-913894 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (32.234287939s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-913894 -n newest-cni-913894
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (32.68s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.38s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p newest-cni-913894 "sudo crictl images -o json"
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.38s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.28s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-913894 --alsologtostderr -v=1
E0720 01:01:54.177295  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/flannel-010184/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-913894 -n newest-cni-913894
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-913894 -n newest-cni-913894: exit status 2 (374.458983ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-913894 -n newest-cni-913894
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-913894 -n newest-cni-913894: exit status 2 (375.327355ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-913894 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-913894 -n newest-cni-913894
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-913894 -n newest-cni-913894
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.28s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (17.02s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-dsgbd" [5211e40e-7e3f-43e3-aa74-1b94b5e55906] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-dsgbd" [5211e40e-7e3f-43e3-aa74-1b94b5e55906] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 17.023030086s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (17.02s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-dsgbd" [5211e40e-7e3f-43e3-aa74-1b94b5e55906] Running
E0720 01:03:53.397877  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
E0720 01:03:53.403161  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
E0720 01:03:53.413409  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
E0720 01:03:53.433650  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
E0720 01:03:53.473983  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
E0720 01:03:53.554774  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
E0720 01:03:53.715162  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
E0720 01:03:54.035793  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
E0720 01:03:54.676255  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.008172187s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-636033 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.36s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p default-k8s-diff-port-636033 "sudo crictl images -o json"
E0720 01:03:55.956914  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.36s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (2.95s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-636033 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033: exit status 2 (331.328582ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033: exit status 2 (363.566816ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-636033 --alsologtostderr -v=1
E0720 01:03:57.367297  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/kubenet-010184/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-636033 -n default-k8s-diff-port-636033
E0720 01:03:58.517050  480505 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/no-preload-888436/client.crt: no such file or directory
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (2.95s)

                                                
                                    

Test skip (24/319)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.27.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.27.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.27.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.54s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-591100 --alsologtostderr --driver=docker  --container-runtime=docker
aaa_download_only_test.go:234: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-591100" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-591100
--- SKIP: TestDownloadOnlyKic (0.54s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:420: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:474: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker true linux arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild/serial/validateImageBuildWithBuildEnv (0s)

                                                
                                                
=== RUN   TestImageBuild/serial/validateImageBuildWithBuildEnv
image_test.go:114: skipping due to https://github.com/kubernetes/minikube/issues/12431
--- SKIP: TestImageBuild/serial/validateImageBuildWithBuildEnv (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (4.05s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:522: 
----------------------- debugLogs start: cilium-010184 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-010184" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/15585-475114/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 20 Jul 2023 00:22:53 UTC
provider: minikube.sigs.k8s.io
version: v1.31.0
name: cluster_info
server: https://192.168.67.2:8443
name: offline-docker-936942
contexts:
- context:
cluster: offline-docker-936942
extensions:
- extension:
last-update: Thu, 20 Jul 2023 00:22:53 UTC
provider: minikube.sigs.k8s.io
version: v1.31.0
name: context_info
namespace: default
user: offline-docker-936942
name: offline-docker-936942
current-context: offline-docker-936942
kind: Config
preferences: {}
users:
- name: offline-docker-936942
user:
client-certificate: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/offline-docker-936942/client.crt
client-key: /home/jenkins/minikube-integration/15585-475114/.minikube/profiles/offline-docker-936942/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-010184

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-010184" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-010184"

                                                
                                                
----------------------- debugLogs end: cilium-010184 [took: 3.876539534s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-010184" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-010184
--- SKIP: TestNetworkPlugins/group/cilium (4.05s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.16s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-509737" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-509737
--- SKIP: TestStartStop/group/disable-driver-mounts (0.16s)

                                                
                                    
Copied to clipboard