Test Report: Docker_Linux_docker_arm64 16761

                    
                      ca7e0fd59d4571f4bf5c8ef52ccb5634a88f3699:2023-06-26:29886
                    
                

Test fail (4/318)

Order failed test Duration
25 TestAddons/parallel/Ingress 40.64
142 TestFunctional/parallel/MountCmd/specific-port 13.81
161 TestIngressAddonLegacy/serial/ValidateIngressAddons 54.38
232 TestRunningBinaryUpgrade 406.73
x
+
TestAddons/parallel/Ingress (40.64s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:183: (dbg) Run:  kubectl --context addons-963360 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:208: (dbg) Run:  kubectl --context addons-963360 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context addons-963360 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [4bed5a20-356e-4833-ac69-e0c6ba6cc24c] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [4bed5a20-356e-4833-ac69-e0c6ba6cc24c] Running
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 12.013008696s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context addons-963360 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.04959427s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p addons-963360 addons disable ingress --alsologtostderr -v=1: (7.54260795s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-963360
helpers_test.go:235: (dbg) docker inspect addons-963360:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "3c4c571f0312a8556bdc2bd0f0e2185e3c8736b8c7fe787c789dc0931f074095",
	        "Created": "2023-06-26T18:55:43.463039576Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 245455,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-06-26T18:55:43.792688421Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:2c464eebc1b5db387e6fe116f67b8b9ca6006abbd75d6a2cb15f70a6643ad6d2",
	        "ResolvConfPath": "/var/lib/docker/containers/3c4c571f0312a8556bdc2bd0f0e2185e3c8736b8c7fe787c789dc0931f074095/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/3c4c571f0312a8556bdc2bd0f0e2185e3c8736b8c7fe787c789dc0931f074095/hostname",
	        "HostsPath": "/var/lib/docker/containers/3c4c571f0312a8556bdc2bd0f0e2185e3c8736b8c7fe787c789dc0931f074095/hosts",
	        "LogPath": "/var/lib/docker/containers/3c4c571f0312a8556bdc2bd0f0e2185e3c8736b8c7fe787c789dc0931f074095/3c4c571f0312a8556bdc2bd0f0e2185e3c8736b8c7fe787c789dc0931f074095-json.log",
	        "Name": "/addons-963360",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-963360:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-963360",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/2adafde48e88e0f53433c03b947c491ea8ac73bd5974cf8d1368201d6ac6d0b0-init/diff:/var/lib/docker/overlay2/c2f9a8b71b8f9533db4f212b0c66f022ed4e6bbaf97d5981202d537184ed81b1/diff",
	                "MergedDir": "/var/lib/docker/overlay2/2adafde48e88e0f53433c03b947c491ea8ac73bd5974cf8d1368201d6ac6d0b0/merged",
	                "UpperDir": "/var/lib/docker/overlay2/2adafde48e88e0f53433c03b947c491ea8ac73bd5974cf8d1368201d6ac6d0b0/diff",
	                "WorkDir": "/var/lib/docker/overlay2/2adafde48e88e0f53433c03b947c491ea8ac73bd5974cf8d1368201d6ac6d0b0/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-963360",
	                "Source": "/var/lib/docker/volumes/addons-963360/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-963360",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-963360",
	                "name.minikube.sigs.k8s.io": "addons-963360",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "f6cd3b1f4f8e977658f83bb5fd16826044c065e181bdeb0dac0756d612ac18a7",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33073"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33072"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33069"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33071"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33070"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/f6cd3b1f4f8e",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-963360": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "3c4c571f0312",
	                        "addons-963360"
	                    ],
	                    "NetworkID": "6d58581b3234cd1209fdf79425067eb83de6f88f9d09d715a1770c4963f8a97b",
	                    "EndpointID": "5a8baf64b851b56454ce0c3f9c7fcdba407b7550ed2c197b0ad66c418f6ebe6b",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-963360 -n addons-963360
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-963360 logs -n 25: (1.390681468s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-515212   | jenkins | v1.30.1 | 26 Jun 23 18:54 UTC |                     |
	|         | -p download-only-515212        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0   |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| start   | -o=json --download-only        | download-only-515212   | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC |                     |
	|         | -p download-only-515212        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.27.3   |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | --all                          | minikube               | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC | 26 Jun 23 18:55 UTC |
	| delete  | -p download-only-515212        | download-only-515212   | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC | 26 Jun 23 18:55 UTC |
	| delete  | -p download-only-515212        | download-only-515212   | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC | 26 Jun 23 18:55 UTC |
	| start   | --download-only -p             | download-docker-262509 | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC |                     |
	|         | download-docker-262509         |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | -p download-docker-262509      | download-docker-262509 | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC | 26 Jun 23 18:55 UTC |
	| start   | --download-only -p             | binary-mirror-790182   | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC |                     |
	|         | binary-mirror-790182           |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --binary-mirror                |                        |         |         |                     |                     |
	|         | http://127.0.0.1:45983         |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-790182        | binary-mirror-790182   | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC | 26 Jun 23 18:55 UTC |
	| start   | -p addons-963360               | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC | 26 Jun 23 18:57 UTC |
	|         | --wait=true --memory=4000      |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --addons=registry              |                        |         |         |                     |                     |
	|         | --addons=metrics-server        |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots       |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver   |                        |         |         |                     |                     |
	|         | --addons=gcp-auth              |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner         |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget      |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --addons=ingress               |                        |         |         |                     |                     |
	|         | --addons=ingress-dns           |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p       | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:57 UTC | 26 Jun 23 18:57 UTC |
	|         | addons-963360                  |                        |         |         |                     |                     |
	| addons  | enable headlamp                | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:57 UTC | 26 Jun 23 18:57 UTC |
	|         | -p addons-963360               |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| ip      | addons-963360 ip               | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:57 UTC | 26 Jun 23 18:57 UTC |
	| addons  | addons-963360 addons disable   | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:57 UTC | 26 Jun 23 18:57 UTC |
	|         | registry --alsologtostderr     |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | addons-963360 addons           | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:58 UTC | 26 Jun 23 18:58 UTC |
	|         | disable metrics-server         |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p    | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:58 UTC | 26 Jun 23 18:58 UTC |
	|         | addons-963360                  |                        |         |         |                     |                     |
	| ssh     | addons-963360 ssh curl -s      | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:58 UTC | 26 Jun 23 18:58 UTC |
	|         | http://127.0.0.1/ -H 'Host:    |                        |         |         |                     |                     |
	|         | nginx.example.com'             |                        |         |         |                     |                     |
	| ip      | addons-963360 ip               | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:58 UTC | 26 Jun 23 18:58 UTC |
	| addons  | addons-963360 addons disable   | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:58 UTC | 26 Jun 23 18:58 UTC |
	|         | ingress-dns --alsologtostderr  |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | addons-963360 addons disable   | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:58 UTC | 26 Jun 23 18:58 UTC |
	|         | ingress --alsologtostderr -v=1 |                        |         |         |                     |                     |
	| addons  | addons-963360 addons           | addons-963360          | jenkins | v1.30.1 | 26 Jun 23 18:58 UTC |                     |
	|         | disable csi-hostpath-driver    |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/06/26 18:55:20
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0626 18:55:20.652580  244980 out.go:296] Setting OutFile to fd 1 ...
	I0626 18:55:20.652715  244980 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 18:55:20.652723  244980 out.go:309] Setting ErrFile to fd 2...
	I0626 18:55:20.652729  244980 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 18:55:20.652883  244980 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
	I0626 18:55:20.653318  244980 out.go:303] Setting JSON to false
	I0626 18:55:20.654269  244980 start.go:127] hostinfo: {"hostname":"ip-172-31-21-244","uptime":5869,"bootTime":1687799852,"procs":351,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1038-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0626 18:55:20.654331  244980 start.go:137] virtualization:  
	I0626 18:55:20.656608  244980 out.go:177] * [addons-963360] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0626 18:55:20.658664  244980 out.go:177]   - MINIKUBE_LOCATION=16761
	I0626 18:55:20.660191  244980 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0626 18:55:20.658801  244980 notify.go:220] Checking for updates...
	I0626 18:55:20.663613  244980 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	I0626 18:55:20.665230  244980 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	I0626 18:55:20.666816  244980 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0626 18:55:20.668360  244980 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0626 18:55:20.670144  244980 driver.go:373] Setting default libvirt URI to qemu:///system
	I0626 18:55:20.693665  244980 docker.go:121] docker version: linux-24.0.2:Docker Engine - Community
	I0626 18:55:20.693764  244980 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 18:55:20.764475  244980 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-06-26 18:55:20.754339717 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 18:55:20.764576  244980 docker.go:294] overlay module found
	I0626 18:55:20.766467  244980 out.go:177] * Using the docker driver based on user configuration
	I0626 18:55:20.768056  244980 start.go:297] selected driver: docker
	I0626 18:55:20.768070  244980 start.go:954] validating driver "docker" against <nil>
	I0626 18:55:20.768082  244980 start.go:965] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0626 18:55:20.768683  244980 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 18:55:20.831748  244980 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-06-26 18:55:20.821969566 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 18:55:20.831915  244980 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0626 18:55:20.832134  244980 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0626 18:55:20.833763  244980 out.go:177] * Using Docker driver with root privileges
	I0626 18:55:20.835349  244980 cni.go:84] Creating CNI manager for ""
	I0626 18:55:20.835367  244980 cni.go:149] "docker" driver + "docker" runtime found, recommending kindnet
	I0626 18:55:20.835388  244980 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni
	I0626 18:55:20.835405  244980 start_flags.go:319] config:
	{Name:addons-963360 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-963360 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker C
RISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 18:55:20.838344  244980 out.go:177] * Starting control plane node addons-963360 in cluster addons-963360
	I0626 18:55:20.840063  244980 cache.go:122] Beginning downloading kic base image for docker with docker
	I0626 18:55:20.841795  244980 out.go:177] * Pulling base image ...
	I0626 18:55:20.843264  244980 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0626 18:55:20.843323  244980 preload.go:148] Found local preload: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	I0626 18:55:20.843337  244980 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local docker daemon
	I0626 18:55:20.843344  244980 cache.go:57] Caching tarball of preloaded images
	I0626 18:55:20.843420  244980 preload.go:174] Found /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0626 18:55:20.843431  244980 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.3 on docker
	I0626 18:55:20.843856  244980 profile.go:148] Saving config to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/config.json ...
	I0626 18:55:20.843881  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/config.json: {Name:mk9bf75e77bab226d06ebfc19ee7bf5026ae8cdf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:20.865076  244980 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 to local cache
	I0626 18:55:20.865177  244980 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local cache directory
	I0626 18:55:20.865199  244980 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local cache directory, skipping pull
	I0626 18:55:20.865205  244980 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 exists in cache, skipping pull
	I0626 18:55:20.865212  244980 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 as a tarball
	I0626 18:55:20.865221  244980 cache.go:163] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 from local cache
	I0626 18:55:36.076972  244980 cache.go:165] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 from cached tarball
	I0626 18:55:36.077034  244980 cache.go:195] Successfully downloaded all kic artifacts
	I0626 18:55:36.077075  244980 start.go:365] acquiring machines lock for addons-963360: {Name:mkb0355b932c2122b37155bb15783d315eebb3a7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0626 18:55:36.077204  244980 start.go:369] acquired machines lock for "addons-963360" in 101.357µs
	I0626 18:55:36.077235  244980 start.go:93] Provisioning new machine with config: &{Name:addons-963360 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-963360 Namespace:default APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Di
sableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0626 18:55:36.077335  244980 start.go:125] createHost starting for "" (driver="docker")
	I0626 18:55:36.079315  244980 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0626 18:55:36.079563  244980 start.go:159] libmachine.API.Create for "addons-963360" (driver="docker")
	I0626 18:55:36.079616  244980 client.go:168] LocalClient.Create starting
	I0626 18:55:36.079751  244980 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem
	I0626 18:55:36.954030  244980 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem
	I0626 18:55:37.172727  244980 cli_runner.go:164] Run: docker network inspect addons-963360 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0626 18:55:37.190430  244980 cli_runner.go:211] docker network inspect addons-963360 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0626 18:55:37.190511  244980 network_create.go:281] running [docker network inspect addons-963360] to gather additional debugging logs...
	I0626 18:55:37.190531  244980 cli_runner.go:164] Run: docker network inspect addons-963360
	W0626 18:55:37.208889  244980 cli_runner.go:211] docker network inspect addons-963360 returned with exit code 1
	I0626 18:55:37.208924  244980 network_create.go:284] error running [docker network inspect addons-963360]: docker network inspect addons-963360: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-963360 not found
	I0626 18:55:37.208936  244980 network_create.go:286] output of [docker network inspect addons-963360]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-963360 not found
	
	** /stderr **
	I0626 18:55:37.209015  244980 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0626 18:55:37.226693  244980 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000bdd1c0}
	I0626 18:55:37.226735  244980 network_create.go:123] attempt to create docker network addons-963360 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0626 18:55:37.226791  244980 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-963360 addons-963360
	I0626 18:55:37.297280  244980 network_create.go:107] docker network addons-963360 192.168.49.0/24 created
	I0626 18:55:37.297309  244980 kic.go:117] calculated static IP "192.168.49.2" for the "addons-963360" container
	I0626 18:55:37.297386  244980 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0626 18:55:37.314390  244980 cli_runner.go:164] Run: docker volume create addons-963360 --label name.minikube.sigs.k8s.io=addons-963360 --label created_by.minikube.sigs.k8s.io=true
	I0626 18:55:37.332802  244980 oci.go:103] Successfully created a docker volume addons-963360
	I0626 18:55:37.332899  244980 cli_runner.go:164] Run: docker run --rm --name addons-963360-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-963360 --entrypoint /usr/bin/test -v addons-963360:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 -d /var/lib
	I0626 18:55:39.515022  244980 cli_runner.go:217] Completed: docker run --rm --name addons-963360-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-963360 --entrypoint /usr/bin/test -v addons-963360:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 -d /var/lib: (2.182082011s)
	I0626 18:55:39.515067  244980 oci.go:107] Successfully prepared a docker volume addons-963360
	I0626 18:55:39.515084  244980 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0626 18:55:39.515102  244980 kic.go:190] Starting extracting preloaded images to volume ...
	I0626 18:55:39.515184  244980 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-963360:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 -I lz4 -xf /preloaded.tar -C /extractDir
	I0626 18:55:43.382567  244980 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-963360:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 -I lz4 -xf /preloaded.tar -C /extractDir: (3.86732981s)
	I0626 18:55:43.382600  244980 kic.go:199] duration metric: took 3.867494 seconds to extract preloaded images to volume
	W0626 18:55:43.382737  244980 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0626 18:55:43.382846  244980 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0626 18:55:43.444778  244980 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-963360 --name addons-963360 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-963360 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-963360 --network addons-963360 --ip 192.168.49.2 --volume addons-963360:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953
	I0626 18:55:43.801626  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Running}}
	I0626 18:55:43.827060  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:55:43.856365  244980 cli_runner.go:164] Run: docker exec addons-963360 stat /var/lib/dpkg/alternatives/iptables
	I0626 18:55:43.951733  244980 oci.go:144] the created container "addons-963360" has a running status.
	I0626 18:55:43.951770  244980 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa...
	I0626 18:55:44.386899  244980 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0626 18:55:44.423011  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:55:44.453992  244980 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0626 18:55:44.454010  244980 kic_runner.go:114] Args: [docker exec --privileged addons-963360 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0626 18:55:44.536401  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:55:44.573009  244980 machine.go:88] provisioning docker machine ...
	I0626 18:55:44.573038  244980 ubuntu.go:169] provisioning hostname "addons-963360"
	I0626 18:55:44.573107  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:44.603224  244980 main.go:141] libmachine: Using SSH client type: native
	I0626 18:55:44.603674  244980 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0626 18:55:44.603686  244980 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-963360 && echo "addons-963360" | sudo tee /etc/hostname
	I0626 18:55:44.798335  244980 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-963360
	
	I0626 18:55:44.798412  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:44.824167  244980 main.go:141] libmachine: Using SSH client type: native
	I0626 18:55:44.824596  244980 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0626 18:55:44.824619  244980 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-963360' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-963360/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-963360' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0626 18:55:44.966716  244980 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0626 18:55:44.966784  244980 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16761-239099/.minikube CaCertPath:/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16761-239099/.minikube}
	I0626 18:55:44.966827  244980 ubuntu.go:177] setting up certificates
	I0626 18:55:44.966858  244980 provision.go:83] configureAuth start
	I0626 18:55:44.966955  244980 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-963360
	I0626 18:55:44.989436  244980 provision.go:138] copyHostCerts
	I0626 18:55:44.989512  244980 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16761-239099/.minikube/ca.pem (1078 bytes)
	I0626 18:55:44.989627  244980 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16761-239099/.minikube/cert.pem (1123 bytes)
	I0626 18:55:44.989691  244980 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16761-239099/.minikube/key.pem (1675 bytes)
	I0626 18:55:44.989741  244980 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16761-239099/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca-key.pem org=jenkins.addons-963360 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-963360]
	I0626 18:55:45.159970  244980 provision.go:172] copyRemoteCerts
	I0626 18:55:45.160051  244980 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0626 18:55:45.160097  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:45.181088  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:55:45.284686  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0626 18:55:45.317516  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I0626 18:55:45.351311  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0626 18:55:45.382870  244980 provision.go:86] duration metric: configureAuth took 415.984078ms
	I0626 18:55:45.382945  244980 ubuntu.go:193] setting minikube options for container-runtime
	I0626 18:55:45.383164  244980 config.go:182] Loaded profile config "addons-963360": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0626 18:55:45.383231  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:45.401216  244980 main.go:141] libmachine: Using SSH client type: native
	I0626 18:55:45.401649  244980 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0626 18:55:45.401665  244980 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0626 18:55:45.538939  244980 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0626 18:55:45.538961  244980 ubuntu.go:71] root file system type: overlay
	I0626 18:55:45.539070  244980 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0626 18:55:45.539139  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:45.557232  244980 main.go:141] libmachine: Using SSH client type: native
	I0626 18:55:45.557668  244980 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0626 18:55:45.557759  244980 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0626 18:55:45.708195  244980 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0626 18:55:45.708281  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:45.727878  244980 main.go:141] libmachine: Using SSH client type: native
	I0626 18:55:45.728326  244980 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}
	I0626 18:55:45.728349  244980 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0626 18:55:46.540364  244980 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-05-25 21:52:53.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-06-26 18:55:45.703060177 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0626 18:55:46.540393  244980 machine.go:91] provisioned docker machine in 1.967364244s
	I0626 18:55:46.540403  244980 client.go:171] LocalClient.Create took 10.460776235s
	I0626 18:55:46.540418  244980 start.go:167] duration metric: libmachine.API.Create for "addons-963360" took 10.460855676s
	I0626 18:55:46.540430  244980 start.go:300] post-start starting for "addons-963360" (driver="docker")
	I0626 18:55:46.540442  244980 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0626 18:55:46.540522  244980 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0626 18:55:46.540571  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:46.558838  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:55:46.663893  244980 ssh_runner.go:195] Run: cat /etc/os-release
	I0626 18:55:46.668168  244980 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0626 18:55:46.668207  244980 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0626 18:55:46.668219  244980 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0626 18:55:46.668225  244980 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0626 18:55:46.668237  244980 filesync.go:126] Scanning /home/jenkins/minikube-integration/16761-239099/.minikube/addons for local assets ...
	I0626 18:55:46.668315  244980 filesync.go:126] Scanning /home/jenkins/minikube-integration/16761-239099/.minikube/files for local assets ...
	I0626 18:55:46.668341  244980 start.go:303] post-start completed in 127.904495ms
	I0626 18:55:46.668682  244980 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-963360
	I0626 18:55:46.690136  244980 profile.go:148] Saving config to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/config.json ...
	I0626 18:55:46.690406  244980 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0626 18:55:46.690456  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:46.707995  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:55:46.802846  244980 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0626 18:55:46.808497  244980 start.go:128] duration metric: createHost completed in 10.731147249s
	I0626 18:55:46.808519  244980 start.go:83] releasing machines lock for "addons-963360", held for 10.731302637s
	I0626 18:55:46.808590  244980 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-963360
	I0626 18:55:46.825804  244980 ssh_runner.go:195] Run: cat /version.json
	I0626 18:55:46.825874  244980 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0626 18:55:46.825891  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:46.825929  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:55:46.854354  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:55:46.862458  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:55:46.949336  244980 ssh_runner.go:195] Run: systemctl --version
	I0626 18:55:47.100025  244980 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0626 18:55:47.105571  244980 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0626 18:55:47.134598  244980 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0626 18:55:47.134700  244980 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0626 18:55:47.166570  244980 cni.go:268] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0626 18:55:47.166596  244980 start.go:466] detecting cgroup driver to use...
	I0626 18:55:47.166628  244980 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0626 18:55:47.166755  244980 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0626 18:55:47.186915  244980 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0626 18:55:47.199419  244980 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0626 18:55:47.211981  244980 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0626 18:55:47.212083  244980 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0626 18:55:47.224066  244980 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0626 18:55:47.236161  244980 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0626 18:55:47.248595  244980 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0626 18:55:47.260749  244980 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0626 18:55:47.272319  244980 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0626 18:55:47.285478  244980 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0626 18:55:47.295970  244980 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0626 18:55:47.305927  244980 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0626 18:55:47.409490  244980 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0626 18:55:47.508203  244980 start.go:466] detecting cgroup driver to use...
	I0626 18:55:47.508297  244980 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0626 18:55:47.508377  244980 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0626 18:55:47.524679  244980 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0626 18:55:47.524751  244980 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0626 18:55:47.542225  244980 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0626 18:55:47.561833  244980 ssh_runner.go:195] Run: which cri-dockerd
	I0626 18:55:47.566433  244980 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0626 18:55:47.576696  244980 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0626 18:55:47.606538  244980 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0626 18:55:47.721804  244980 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0626 18:55:47.833562  244980 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0626 18:55:47.833595  244980 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0626 18:55:47.858063  244980 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0626 18:55:47.960512  244980 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0626 18:55:48.245990  244980 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0626 18:55:48.339020  244980 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I0626 18:55:48.431622  244980 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0626 18:55:48.530961  244980 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0626 18:55:48.626497  244980 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I0626 18:55:48.643019  244980 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0626 18:55:48.735636  244980 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
	I0626 18:55:48.818631  244980 start.go:513] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I0626 18:55:48.818775  244980 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I0626 18:55:48.824287  244980 start.go:534] Will wait 60s for crictl version
	I0626 18:55:48.824371  244980 ssh_runner.go:195] Run: which crictl
	I0626 18:55:48.829630  244980 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0626 18:55:48.890463  244980 start.go:550] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  24.0.2
	RuntimeApiVersion:  v1
	I0626 18:55:48.890579  244980 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0626 18:55:48.918108  244980 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0626 18:55:48.948147  244980 out.go:204] * Preparing Kubernetes v1.27.3 on Docker 24.0.2 ...
	I0626 18:55:48.948250  244980 cli_runner.go:164] Run: docker network inspect addons-963360 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0626 18:55:48.966395  244980 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0626 18:55:48.971412  244980 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0626 18:55:48.987217  244980 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0626 18:55:48.987307  244980 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0626 18:55:49.013224  244980 docker.go:636] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.27.3
	registry.k8s.io/kube-controller-manager:v1.27.3
	registry.k8s.io/kube-scheduler:v1.27.3
	registry.k8s.io/kube-proxy:v1.27.3
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/etcd:3.5.7-0
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0626 18:55:49.013253  244980 docker.go:566] Images already preloaded, skipping extraction
	I0626 18:55:49.013341  244980 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0626 18:55:49.034196  244980 docker.go:636] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.27.3
	registry.k8s.io/kube-controller-manager:v1.27.3
	registry.k8s.io/kube-scheduler:v1.27.3
	registry.k8s.io/kube-proxy:v1.27.3
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/etcd:3.5.7-0
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0626 18:55:49.034222  244980 cache_images.go:84] Images are preloaded, skipping loading
	I0626 18:55:49.034280  244980 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0626 18:55:49.086600  244980 cni.go:84] Creating CNI manager for ""
	I0626 18:55:49.086625  244980 cni.go:149] "docker" driver + "docker" runtime found, recommending kindnet
	I0626 18:55:49.086656  244980 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0626 18:55:49.086677  244980 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.27.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-963360 NodeName:addons-963360 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0626 18:55:49.086821  244980 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "addons-963360"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.27.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0626 18:55:49.086897  244980 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.27.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-963360 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.27.3 ClusterName:addons-963360 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0626 18:55:49.086978  244980 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.3
	I0626 18:55:49.097464  244980 binaries.go:44] Found k8s binaries, skipping transfer
	I0626 18:55:49.097535  244980 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0626 18:55:49.107954  244980 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
	I0626 18:55:49.136140  244980 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0626 18:55:49.156978  244980 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I0626 18:55:49.177532  244980 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0626 18:55:49.181691  244980 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0626 18:55:49.194153  244980 certs.go:56] Setting up /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360 for IP: 192.168.49.2
	I0626 18:55:49.194183  244980 certs.go:190] acquiring lock for shared ca certs: {Name:mk3ca16c3f42222cf5b6a061c3376849045f46b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:49.194388  244980 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/16761-239099/.minikube/ca.key
	I0626 18:55:49.683793  244980 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt ...
	I0626 18:55:49.683820  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt: {Name:mka7ed8fab66aff70483549277808735194c9eb7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:49.684009  244980 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16761-239099/.minikube/ca.key ...
	I0626 18:55:49.684020  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/ca.key: {Name:mkefa47a507f344f784debf4cc416ef1b3a91011 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:49.684106  244980 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.key
	I0626 18:55:50.005824  244980 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.crt ...
	I0626 18:55:50.005856  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.crt: {Name:mkb735f806a62c34d2bd6db6b7b3753fa7f8b168 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:50.006037  244980 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.key ...
	I0626 18:55:50.006048  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.key: {Name:mkd9fa30556a825be8d2914e7412d6b4292ee4f2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:50.006591  244980 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.key
	I0626 18:55:50.006613  244980 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt with IP's: []
	I0626 18:55:50.366502  244980 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt ...
	I0626 18:55:50.366530  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: {Name:mkce758037694e9ad66e0387119014cfed8b67c2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:50.367167  244980 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.key ...
	I0626 18:55:50.367181  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.key: {Name:mk0e00db161e2a37368578b04055c43294a2ddfc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:50.367262  244980 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.key.dd3b5fb2
	I0626 18:55:50.367280  244980 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0626 18:55:50.564743  244980 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.crt.dd3b5fb2 ...
	I0626 18:55:50.564774  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.crt.dd3b5fb2: {Name:mk36437abbcd34b1cbc09244a8011086a7dbd7dc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:50.565501  244980 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.key.dd3b5fb2 ...
	I0626 18:55:50.565517  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.key.dd3b5fb2: {Name:mka7482689c109cc456f5a9199521eb5b399e099 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:50.566000  244980 certs.go:337] copying /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.crt
	I0626 18:55:50.566075  244980 certs.go:341] copying /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.key
	I0626 18:55:50.566124  244980 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/proxy-client.key
	I0626 18:55:50.566143  244980 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/proxy-client.crt with IP's: []
	I0626 18:55:51.238034  244980 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/proxy-client.crt ...
	I0626 18:55:51.238067  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/proxy-client.crt: {Name:mkafd9a3d39f6e35f1fd235cf466f6beef0bbd1f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:51.238262  244980 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/proxy-client.key ...
	I0626 18:55:51.238275  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/proxy-client.key: {Name:mk098d0fa2234dfc36316af2f0088e682bdfe60a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:51.238466  244980 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca-key.pem (1679 bytes)
	I0626 18:55:51.238511  244980 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem (1078 bytes)
	I0626 18:55:51.238541  244980 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem (1123 bytes)
	I0626 18:55:51.238569  244980 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/key.pem (1675 bytes)
	I0626 18:55:51.239187  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0626 18:55:51.271429  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0626 18:55:51.302180  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0626 18:55:51.331611  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0626 18:55:51.360450  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0626 18:55:51.389254  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0626 18:55:51.417061  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0626 18:55:51.446097  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0626 18:55:51.475308  244980 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0626 18:55:51.503931  244980 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0626 18:55:51.525302  244980 ssh_runner.go:195] Run: openssl version
	I0626 18:55:51.532277  244980 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0626 18:55:51.544121  244980 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0626 18:55:51.548806  244980 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jun 26 18:55 /usr/share/ca-certificates/minikubeCA.pem
	I0626 18:55:51.548870  244980 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0626 18:55:51.557547  244980 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0626 18:55:51.568984  244980 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0626 18:55:51.573141  244980 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0626 18:55:51.573184  244980 kubeadm.go:404] StartCluster: {Name:addons-963360 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-963360 Namespace:default APIServerName:minikubeCA APIServerNames:[] APISe
rverIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri
cs:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 18:55:51.573312  244980 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0626 18:55:51.594789  244980 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0626 18:55:51.605187  244980 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0626 18:55:51.615843  244980 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0626 18:55:51.615906  244980 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0626 18:55:51.626783  244980 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0626 18:55:51.626831  244980 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0626 18:55:51.678892  244980 kubeadm.go:322] [init] Using Kubernetes version: v1.27.3
	I0626 18:55:51.679334  244980 kubeadm.go:322] [preflight] Running pre-flight checks
	I0626 18:55:51.743948  244980 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0626 18:55:51.744018  244980 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1038-aws
	I0626 18:55:51.744057  244980 kubeadm.go:322] OS: Linux
	I0626 18:55:51.744107  244980 kubeadm.go:322] CGROUPS_CPU: enabled
	I0626 18:55:51.744157  244980 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0626 18:55:51.744204  244980 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0626 18:55:51.744253  244980 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0626 18:55:51.744305  244980 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0626 18:55:51.744355  244980 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0626 18:55:51.744403  244980 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0626 18:55:51.744452  244980 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0626 18:55:51.744499  244980 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0626 18:55:51.822704  244980 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0626 18:55:51.822849  244980 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0626 18:55:51.822974  244980 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0626 18:55:52.184217  244980 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0626 18:55:52.187494  244980 out.go:204]   - Generating certificates and keys ...
	I0626 18:55:52.187607  244980 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0626 18:55:52.187843  244980 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0626 18:55:52.408718  244980 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0626 18:55:52.961571  244980 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0626 18:55:53.572057  244980 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0626 18:55:53.749889  244980 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0626 18:55:54.672285  244980 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0626 18:55:54.672690  244980 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-963360 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0626 18:55:55.129917  244980 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0626 18:55:55.130298  244980 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-963360 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0626 18:55:55.375636  244980 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0626 18:55:55.826404  244980 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0626 18:55:56.402385  244980 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0626 18:55:56.402724  244980 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0626 18:55:56.914142  244980 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0626 18:55:57.092866  244980 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0626 18:55:57.660860  244980 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0626 18:55:57.876928  244980 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0626 18:55:57.891424  244980 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0626 18:55:57.892268  244980 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0626 18:55:57.892564  244980 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0626 18:55:58.006636  244980 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0626 18:55:58.009086  244980 out.go:204]   - Booting up control plane ...
	I0626 18:55:58.009190  244980 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0626 18:55:58.013532  244980 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0626 18:55:58.015788  244980 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0626 18:55:58.017915  244980 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0626 18:55:58.022088  244980 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0626 18:56:05.526181  244980 kubeadm.go:322] [apiclient] All control plane components are healthy after 7.503436 seconds
	I0626 18:56:05.526300  244980 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0626 18:56:05.540608  244980 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0626 18:56:06.064923  244980 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0626 18:56:06.065138  244980 kubeadm.go:322] [mark-control-plane] Marking the node addons-963360 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0626 18:56:06.576830  244980 kubeadm.go:322] [bootstrap-token] Using token: nyw8k4.bti9lto936gudict
	I0626 18:56:06.578485  244980 out.go:204]   - Configuring RBAC rules ...
	I0626 18:56:06.578603  244980 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0626 18:56:06.586489  244980 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0626 18:56:06.598517  244980 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0626 18:56:06.603348  244980 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0626 18:56:06.607893  244980 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0626 18:56:06.613263  244980 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0626 18:56:06.625637  244980 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0626 18:56:06.880162  244980 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0626 18:56:06.995296  244980 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0626 18:56:06.997282  244980 kubeadm.go:322] 
	I0626 18:56:06.997350  244980 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0626 18:56:06.997356  244980 kubeadm.go:322] 
	I0626 18:56:06.997429  244980 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0626 18:56:06.997434  244980 kubeadm.go:322] 
	I0626 18:56:06.997457  244980 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0626 18:56:06.997721  244980 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0626 18:56:06.997774  244980 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0626 18:56:06.997779  244980 kubeadm.go:322] 
	I0626 18:56:06.997830  244980 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0626 18:56:06.997834  244980 kubeadm.go:322] 
	I0626 18:56:06.997879  244980 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0626 18:56:06.997886  244980 kubeadm.go:322] 
	I0626 18:56:06.997935  244980 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0626 18:56:06.998006  244980 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0626 18:56:06.998071  244980 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0626 18:56:06.998075  244980 kubeadm.go:322] 
	I0626 18:56:06.998154  244980 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0626 18:56:06.998227  244980 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0626 18:56:06.998232  244980 kubeadm.go:322] 
	I0626 18:56:06.998311  244980 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token nyw8k4.bti9lto936gudict \
	I0626 18:56:06.998408  244980 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:064eebff4304b2a386b2747a9246be1651696da5faad8d5a09dfba9d1f0e6ac8 \
	I0626 18:56:06.998428  244980 kubeadm.go:322] 	--control-plane 
	I0626 18:56:06.998432  244980 kubeadm.go:322] 
	I0626 18:56:06.998513  244980 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0626 18:56:06.998518  244980 kubeadm.go:322] 
	I0626 18:56:06.998595  244980 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token nyw8k4.bti9lto936gudict \
	I0626 18:56:06.998691  244980 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:064eebff4304b2a386b2747a9246be1651696da5faad8d5a09dfba9d1f0e6ac8 
	I0626 18:56:07.015457  244980 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1038-aws\n", err: exit status 1
	I0626 18:56:07.015598  244980 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0626 18:56:07.015625  244980 cni.go:84] Creating CNI manager for ""
	I0626 18:56:07.015653  244980 cni.go:149] "docker" driver + "docker" runtime found, recommending kindnet
	I0626 18:56:07.017586  244980 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0626 18:56:07.019243  244980 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0626 18:56:07.025302  244980 cni.go:188] applying CNI manifest using /var/lib/minikube/binaries/v1.27.3/kubectl ...
	I0626 18:56:07.025323  244980 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0626 18:56:07.075007  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0626 18:56:08.045773  244980 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0626 18:56:08.045866  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:08.045892  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=759becbe25e432e7a4042c59713ee144df2072e1 minikube.k8s.io/name=addons-963360 minikube.k8s.io/updated_at=2023_06_26T18_56_08_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:08.218660  244980 ops.go:34] apiserver oom_adj: -16
	I0626 18:56:08.218775  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:08.919652  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:09.419191  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:09.919133  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:10.419745  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:10.919184  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:11.419779  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:11.919805  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:12.419139  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:12.919680  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:13.419770  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:13.919750  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:14.419817  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:14.919665  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:15.419200  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:15.919670  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:16.419078  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:16.919445  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:17.419298  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:17.919911  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:18.419230  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:18.920073  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:19.420060  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:19.919821  244980 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 18:56:20.101412  244980 kubeadm.go:1081] duration metric: took 12.055616775s to wait for elevateKubeSystemPrivileges.
	I0626 18:56:20.101439  244980 kubeadm.go:406] StartCluster complete in 28.528258992s
	I0626 18:56:20.101455  244980 settings.go:142] acquiring lock: {Name:mk17c896443b7e18d0ba93e5cbf58b5d6036ce0e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:56:20.102161  244980 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/16761-239099/kubeconfig
	I0626 18:56:20.102593  244980 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/kubeconfig: {Name:mk0284fcec3b30eb2952ace994009133ac5314fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:56:20.102823  244980 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0626 18:56:20.103171  244980 config.go:182] Loaded profile config "addons-963360": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0626 18:56:20.103330  244980 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]
	I0626 18:56:20.103422  244980 addons.go:66] Setting volumesnapshots=true in profile "addons-963360"
	I0626 18:56:20.103436  244980 addons.go:228] Setting addon volumesnapshots=true in "addons-963360"
	I0626 18:56:20.103493  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.103966  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.104413  244980 addons.go:66] Setting cloud-spanner=true in profile "addons-963360"
	I0626 18:56:20.104435  244980 addons.go:228] Setting addon cloud-spanner=true in "addons-963360"
	I0626 18:56:20.104479  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.104906  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.106425  244980 addons.go:66] Setting inspektor-gadget=true in profile "addons-963360"
	I0626 18:56:20.106499  244980 addons.go:228] Setting addon inspektor-gadget=true in "addons-963360"
	I0626 18:56:20.106582  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.107163  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.107316  244980 addons.go:66] Setting csi-hostpath-driver=true in profile "addons-963360"
	I0626 18:56:20.107379  244980 addons.go:228] Setting addon csi-hostpath-driver=true in "addons-963360"
	I0626 18:56:20.107450  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.107949  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.108071  244980 addons.go:66] Setting default-storageclass=true in profile "addons-963360"
	I0626 18:56:20.108105  244980 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-963360"
	I0626 18:56:20.108416  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.108538  244980 addons.go:66] Setting gcp-auth=true in profile "addons-963360"
	I0626 18:56:20.108586  244980 mustload.go:65] Loading cluster: addons-963360
	I0626 18:56:20.108835  244980 config.go:182] Loaded profile config "addons-963360": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0626 18:56:20.109220  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.110550  244980 addons.go:66] Setting ingress=true in profile "addons-963360"
	I0626 18:56:20.110605  244980 addons.go:228] Setting addon ingress=true in "addons-963360"
	I0626 18:56:20.110686  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.111240  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.113209  244980 addons.go:66] Setting metrics-server=true in profile "addons-963360"
	I0626 18:56:20.113243  244980 addons.go:228] Setting addon metrics-server=true in "addons-963360"
	I0626 18:56:20.113299  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.114074  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.114321  244980 addons.go:66] Setting registry=true in profile "addons-963360"
	I0626 18:56:20.114337  244980 addons.go:228] Setting addon registry=true in "addons-963360"
	I0626 18:56:20.114371  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.114746  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.114814  244980 addons.go:66] Setting storage-provisioner=true in profile "addons-963360"
	I0626 18:56:20.114823  244980 addons.go:228] Setting addon storage-provisioner=true in "addons-963360"
	I0626 18:56:20.114848  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.115341  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.115435  244980 addons.go:66] Setting ingress-dns=true in profile "addons-963360"
	I0626 18:56:20.115447  244980 addons.go:228] Setting addon ingress-dns=true in "addons-963360"
	I0626 18:56:20.116515  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.116959  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.164452  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0626 18:56:20.181277  244980 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0626 18:56:20.181303  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0626 18:56:20.181378  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.261298  244980 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.6
	I0626 18:56:20.264506  244980 addons.go:420] installing /etc/kubernetes/addons/deployment.yaml
	I0626 18:56:20.264526  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1003 bytes)
	I0626 18:56:20.264592  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.277132  244980 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.3
	I0626 18:56:20.284631  244980 addons.go:420] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0626 18:56:20.284661  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0626 18:56:20.288681  244980 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0626 18:56:20.286908  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.306819  244980 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0626 18:56:20.309677  244980 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.8.0
	I0626 18:56:20.319794  244980 addons.go:420] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0626 18:56:20.319818  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16083 bytes)
	I0626 18:56:20.319882  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.376151  244980 addons.go:228] Setting addon default-storageclass=true in "addons-963360"
	I0626 18:56:20.376198  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.379488  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:20.404915  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0626 18:56:20.409618  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0626 18:56:20.411276  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0626 18:56:20.415643  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0626 18:56:20.419474  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0626 18:56:20.421826  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0626 18:56:20.429867  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0626 18:56:20.431465  244980 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0626 18:56:20.438370  244980 addons.go:420] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0626 18:56:20.438396  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0626 18:56:20.438465  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.443595  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:20.505603  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.510668  244980 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.17.0
	I0626 18:56:20.512684  244980 addons.go:420] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0626 18:56:20.512708  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0626 18:56:20.512789  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.519451  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.530744  244980 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I0626 18:56:20.534318  244980 addons.go:420] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0626 18:56:20.534343  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0626 18:56:20.534412  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.537026  244980 out.go:177]   - Using image docker.io/registry:2.8.1
	I0626 18:56:20.538557  244980 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I0626 18:56:20.540470  244980 addons.go:420] installing /etc/kubernetes/addons/registry-rc.yaml
	I0626 18:56:20.540491  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I0626 18:56:20.540551  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.548922  244980 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0626 18:56:20.550839  244980 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0626 18:56:20.550860  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0626 18:56:20.550921  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.593303  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.594450  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.603186  244980 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml
	I0626 18:56:20.603217  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0626 18:56:20.603279  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:20.611971  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.632076  244980 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0626 18:56:20.682200  244980 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-963360" context rescaled to 1 replicas
	I0626 18:56:20.682236  244980 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0626 18:56:20.683883  244980 out.go:177] * Verifying Kubernetes components...
	I0626 18:56:20.689169  244980 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0626 18:56:20.707240  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.736651  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.737780  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.749218  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:20.751595  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:21.482678  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0626 18:56:21.645902  244980 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0626 18:56:21.645973  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0626 18:56:21.729803  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0626 18:56:21.803844  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0626 18:56:21.807102  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0626 18:56:21.811454  244980 addons.go:420] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0626 18:56:21.811522  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0626 18:56:21.832141  244980 addons.go:420] installing /etc/kubernetes/addons/registry-svc.yaml
	I0626 18:56:21.832208  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0626 18:56:21.862739  244980 addons.go:420] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0626 18:56:21.862808  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0626 18:56:21.872285  244980 addons.go:420] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0626 18:56:21.872354  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0626 18:56:21.946564  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0626 18:56:22.077062  244980 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0626 18:56:22.077132  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0626 18:56:22.161295  244980 addons.go:420] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0626 18:56:22.161366  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0626 18:56:22.243298  244980 addons.go:420] installing /etc/kubernetes/addons/ig-role.yaml
	I0626 18:56:22.243365  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0626 18:56:22.245761  244980 addons.go:420] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0626 18:56:22.245811  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0626 18:56:22.269634  244980 addons.go:420] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0626 18:56:22.269695  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0626 18:56:22.436774  244980 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0626 18:56:22.436837  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0626 18:56:22.506545  244980 addons.go:420] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0626 18:56:22.506612  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0626 18:56:22.516609  244980 addons.go:420] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0626 18:56:22.516679  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0626 18:56:22.575337  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0626 18:56:22.594298  244980 addons.go:420] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0626 18:56:22.594364  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0626 18:56:22.712025  244980 addons.go:420] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0626 18:56:22.712090  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0626 18:56:22.757734  244980 addons.go:420] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0626 18:56:22.757800  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0626 18:56:22.777773  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0626 18:56:22.873998  244980 addons.go:420] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0626 18:56:22.874068  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0626 18:56:22.998932  244980 addons.go:420] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0626 18:56:22.999012  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0626 18:56:23.059372  244980 addons.go:420] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0626 18:56:23.059443  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0626 18:56:23.135162  244980 addons.go:420] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0626 18:56:23.135184  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0626 18:56:23.289734  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0626 18:56:23.308218  244980 addons.go:420] installing /etc/kubernetes/addons/ig-crd.yaml
	I0626 18:56:23.308285  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0626 18:56:23.326354  244980 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0626 18:56:23.326423  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0626 18:56:23.521386  244980 addons.go:420] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0626 18:56:23.521456  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I0626 18:56:23.573971  244980 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0626 18:56:23.574040  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0626 18:56:23.652223  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0626 18:56:23.705744  244980 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (3.016540198s)
	I0626 18:56:23.706635  244980 node_ready.go:35] waiting up to 6m0s for node "addons-963360" to be "Ready" ...
	I0626 18:56:23.706896  244980 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.073607189s)
	I0626 18:56:23.706933  244980 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0626 18:56:23.711538  244980 node_ready.go:49] node "addons-963360" has status "Ready":"True"
	I0626 18:56:23.711565  244980 node_ready.go:38] duration metric: took 4.900402ms waiting for node "addons-963360" to be "Ready" ...
	I0626 18:56:23.711580  244980 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0626 18:56:23.722238  244980 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:23.749131  244980 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0626 18:56:23.749157  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0626 18:56:23.896899  244980 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0626 18:56:23.896924  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0626 18:56:24.056466  244980 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0626 18:56:24.056493  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0626 18:56:24.326137  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0626 18:56:24.543082  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.060330148s)
	I0626 18:56:25.303052  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.573161357s)
	I0626 18:56:25.303157  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.499242783s)
	I0626 18:56:25.739504  244980 pod_ready.go:102] pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace has status "Ready":"False"
	I0626 18:56:27.322861  244980 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0626 18:56:27.323000  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:27.350644  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:27.840191  244980 pod_ready.go:102] pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace has status "Ready":"False"
	I0626 18:56:28.410807  244980 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0626 18:56:28.578258  244980 addons.go:228] Setting addon gcp-auth=true in "addons-963360"
	I0626 18:56:28.578362  244980 host.go:66] Checking if "addons-963360" exists ...
	I0626 18:56:28.579121  244980 cli_runner.go:164] Run: docker container inspect addons-963360 --format={{.State.Status}}
	I0626 18:56:28.612658  244980 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0626 18:56:28.612714  244980 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-963360
	I0626 18:56:28.639889  244980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/addons-963360/id_rsa Username:docker}
	I0626 18:56:29.239686  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.432506225s)
	I0626 18:56:29.239713  244980 addons.go:464] Verifying addon ingress=true in "addons-963360"
	I0626 18:56:29.241495  244980 out.go:177] * Verifying ingress addon...
	I0626 18:56:29.239908  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.293279318s)
	I0626 18:56:29.239969  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (6.664537374s)
	I0626 18:56:29.240054  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.462208887s)
	I0626 18:56:29.240151  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (5.950345454s)
	I0626 18:56:29.240307  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (5.588012948s)
	I0626 18:56:29.242845  244980 addons.go:464] Verifying addon registry=true in "addons-963360"
	I0626 18:56:29.245257  244980 out.go:177] * Verifying registry addon...
	I0626 18:56:29.243611  244980 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0626 18:56:29.243633  244980 addons.go:464] Verifying addon metrics-server=true in "addons-963360"
	W0626 18:56:29.243681  244980 addons.go:446] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0626 18:56:29.247533  244980 retry.go:31] will retry after 301.712498ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0626 18:56:29.248293  244980 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0626 18:56:29.270973  244980 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0626 18:56:29.271009  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:29.271763  244980 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0626 18:56:29.271786  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:29.550240  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0626 18:56:29.784200  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:29.786179  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:30.248077  244980 pod_ready.go:102] pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace has status "Ready":"False"
	I0626 18:56:30.278092  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:30.280289  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:30.869099  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:30.870469  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:31.277212  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:31.301341  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:31.818252  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:31.818457  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:32.280102  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:32.281908  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:32.756952  244980 pod_ready.go:102] pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace has status "Ready":"False"
	I0626 18:56:32.785092  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:32.787398  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:33.287454  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:33.288047  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:33.803689  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:33.825345  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:34.125085  244980 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (5.512393739s)
	I0626 18:56:34.127246  244980 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0626 18:56:34.125317  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (9.799103127s)
	I0626 18:56:34.125438  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.575152973s)
	I0626 18:56:34.134185  244980 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I0626 18:56:34.129139  244980 addons.go:464] Verifying addon csi-hostpath-driver=true in "addons-963360"
	I0626 18:56:34.137990  244980 out.go:177] * Verifying csi-hostpath-driver addon...
	I0626 18:56:34.136408  244980 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0626 18:56:34.140366  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0626 18:56:34.141266  244980 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0626 18:56:34.159697  244980 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0626 18:56:34.159768  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:34.252847  244980 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0626 18:56:34.252916  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0626 18:56:34.286093  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:34.297988  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:34.327946  244980 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0626 18:56:34.327969  244980 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)
	I0626 18:56:34.361756  244980 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0626 18:56:34.668234  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:34.796175  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:34.797384  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:35.167406  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:35.240341  244980 pod_ready.go:102] pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace has status "Ready":"False"
	I0626 18:56:35.279809  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:35.281222  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:35.666506  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:35.778211  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:35.782340  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:35.947962  244980 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.586164382s)
	I0626 18:56:35.950078  244980 addons.go:464] Verifying addon gcp-auth=true in "addons-963360"
	I0626 18:56:35.951474  244980 out.go:177] * Verifying gcp-auth addon...
	I0626 18:56:35.954100  244980 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0626 18:56:35.960981  244980 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0626 18:56:35.961068  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:36.167450  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:36.239533  244980 pod_ready.go:97] error getting pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace (skipping!): pods "coredns-5d78c9869d-2ffsz" not found
	I0626 18:56:36.239601  244980 pod_ready.go:81] duration metric: took 12.517328818s waiting for pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace to be "Ready" ...
	E0626 18:56:36.239625  244980 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5d78c9869d-2ffsz" in "kube-system" namespace (skipping!): pods "coredns-5d78c9869d-2ffsz" not found
	I0626 18:56:36.239644  244980 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-prmt6" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:36.279146  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:36.280285  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:36.465726  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:36.671976  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:36.777657  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:36.779676  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:36.965814  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:37.166090  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:37.278000  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:37.279435  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:37.465867  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:37.667697  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:37.755725  244980 pod_ready.go:92] pod "coredns-5d78c9869d-prmt6" in "kube-system" namespace has status "Ready":"True"
	I0626 18:56:37.755796  244980 pod_ready.go:81] duration metric: took 1.516116322s waiting for pod "coredns-5d78c9869d-prmt6" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.755822  244980 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-963360" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.762891  244980 pod_ready.go:92] pod "etcd-addons-963360" in "kube-system" namespace has status "Ready":"True"
	I0626 18:56:37.762972  244980 pod_ready.go:81] duration metric: took 7.129227ms waiting for pod "etcd-addons-963360" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.763003  244980 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-963360" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.770400  244980 pod_ready.go:92] pod "kube-apiserver-addons-963360" in "kube-system" namespace has status "Ready":"True"
	I0626 18:56:37.770471  244980 pod_ready.go:81] duration metric: took 7.445434ms waiting for pod "kube-apiserver-addons-963360" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.770496  244980 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-963360" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.779808  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:37.781259  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:37.784066  244980 pod_ready.go:92] pod "kube-controller-manager-addons-963360" in "kube-system" namespace has status "Ready":"True"
	I0626 18:56:37.784151  244980 pod_ready.go:81] duration metric: took 13.633278ms waiting for pod "kube-controller-manager-addons-963360" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.784291  244980 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-69vf5" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.791482  244980 pod_ready.go:92] pod "kube-proxy-69vf5" in "kube-system" namespace has status "Ready":"True"
	I0626 18:56:37.791544  244980 pod_ready.go:81] duration metric: took 7.235261ms waiting for pod "kube-proxy-69vf5" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.791570  244980 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-963360" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:37.965724  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:38.152497  244980 pod_ready.go:92] pod "kube-scheduler-addons-963360" in "kube-system" namespace has status "Ready":"True"
	I0626 18:56:38.152561  244980 pod_ready.go:81] duration metric: took 360.971147ms waiting for pod "kube-scheduler-addons-963360" in "kube-system" namespace to be "Ready" ...
	I0626 18:56:38.152585  244980 pod_ready.go:38] duration metric: took 14.440933597s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0626 18:56:38.152616  244980 api_server.go:52] waiting for apiserver process to appear ...
	I0626 18:56:38.152694  244980 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0626 18:56:38.166417  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:38.175765  244980 api_server.go:72] duration metric: took 17.493501796s to wait for apiserver process to appear ...
	I0626 18:56:38.175824  244980 api_server.go:88] waiting for apiserver healthz status ...
	I0626 18:56:38.175855  244980 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0626 18:56:38.186729  244980 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0626 18:56:38.188348  244980 api_server.go:141] control plane version: v1.27.3
	I0626 18:56:38.188402  244980 api_server.go:131] duration metric: took 12.558628ms to wait for apiserver health ...
	I0626 18:56:38.188424  244980 system_pods.go:43] waiting for kube-system pods to appear ...
	I0626 18:56:38.280632  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:38.281113  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:38.361765  244980 system_pods.go:59] 17 kube-system pods found
	I0626 18:56:38.361841  244980 system_pods.go:61] "coredns-5d78c9869d-prmt6" [ec8c81fd-4534-44c7-965c-4829270def4b] Running
	I0626 18:56:38.361864  244980 system_pods.go:61] "csi-hostpath-attacher-0" [f5149e56-fedf-4f23-b369-40a7f1c65af7] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0626 18:56:38.361888  244980 system_pods.go:61] "csi-hostpath-resizer-0" [c8af2b4b-da4a-4667-94ba-74193e3cdba9] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0626 18:56:38.361922  244980 system_pods.go:61] "csi-hostpathplugin-7dr46" [9469adbf-cdee-4ab9-95b6-b777a2d6d261] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0626 18:56:38.361949  244980 system_pods.go:61] "etcd-addons-963360" [3aa3128f-523d-40a8-9718-1ae341118a75] Running
	I0626 18:56:38.361969  244980 system_pods.go:61] "kindnet-lmwht" [9c95e242-44d1-4c24-83aa-5e136ff56cd9] Running
	I0626 18:56:38.361996  244980 system_pods.go:61] "kube-apiserver-addons-963360" [d5fa1abb-67d2-4add-bbe8-48ea5eb927b3] Running
	I0626 18:56:38.362025  244980 system_pods.go:61] "kube-controller-manager-addons-963360" [0b536efc-54e2-4f67-980f-725dbac4b6a5] Running
	I0626 18:56:38.362053  244980 system_pods.go:61] "kube-ingress-dns-minikube" [a13f6c82-e719-4c48-aa0a-d700b625647d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0626 18:56:38.362072  244980 system_pods.go:61] "kube-proxy-69vf5" [4c835d59-25ba-40b2-86c7-b610c9239341] Running
	I0626 18:56:38.362092  244980 system_pods.go:61] "kube-scheduler-addons-963360" [77a4aadd-c463-4708-879a-0c674b8682bf] Running
	I0626 18:56:38.362112  244980 system_pods.go:61] "metrics-server-844d8db974-zkzdr" [e7bcd344-88b7-4e24-8fd2-b1fe95144127] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0626 18:56:38.362146  244980 system_pods.go:61] "registry-kcrl6" [ecfe2e2c-43c4-42a9-a979-167fe22f5d47] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0626 18:56:38.362170  244980 system_pods.go:61] "registry-proxy-2n5gs" [da693eb2-5172-48f3-919d-332ab16d60f1] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0626 18:56:38.362196  244980 system_pods.go:61] "snapshot-controller-75bbb956b9-gzl98" [02bdbee1-c911-4a93-abbf-d4635384f58d] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0626 18:56:38.362230  244980 system_pods.go:61] "snapshot-controller-75bbb956b9-xrptg" [1f6b17fe-3aa4-4df3-9faa-6f52dedb7234] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0626 18:56:38.362257  244980 system_pods.go:61] "storage-provisioner" [552fcb00-182a-4068-a51a-45f6956e49de] Running
	I0626 18:56:38.362285  244980 system_pods.go:74] duration metric: took 173.843699ms to wait for pod list to return data ...
	I0626 18:56:38.362305  244980 default_sa.go:34] waiting for default service account to be created ...
	I0626 18:56:38.464805  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:38.551731  244980 default_sa.go:45] found service account: "default"
	I0626 18:56:38.551763  244980 default_sa.go:55] duration metric: took 189.427165ms for default service account to be created ...
	I0626 18:56:38.551773  244980 system_pods.go:116] waiting for k8s-apps to be running ...
	I0626 18:56:38.666203  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:38.780610  244980 system_pods.go:86] 17 kube-system pods found
	I0626 18:56:38.780688  244980 system_pods.go:89] "coredns-5d78c9869d-prmt6" [ec8c81fd-4534-44c7-965c-4829270def4b] Running
	I0626 18:56:38.780715  244980 system_pods.go:89] "csi-hostpath-attacher-0" [f5149e56-fedf-4f23-b369-40a7f1c65af7] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0626 18:56:38.780754  244980 system_pods.go:89] "csi-hostpath-resizer-0" [c8af2b4b-da4a-4667-94ba-74193e3cdba9] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0626 18:56:38.780782  244980 system_pods.go:89] "csi-hostpathplugin-7dr46" [9469adbf-cdee-4ab9-95b6-b777a2d6d261] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0626 18:56:38.780801  244980 system_pods.go:89] "etcd-addons-963360" [3aa3128f-523d-40a8-9718-1ae341118a75] Running
	I0626 18:56:38.780840  244980 system_pods.go:89] "kindnet-lmwht" [9c95e242-44d1-4c24-83aa-5e136ff56cd9] Running
	I0626 18:56:38.780864  244980 system_pods.go:89] "kube-apiserver-addons-963360" [d5fa1abb-67d2-4add-bbe8-48ea5eb927b3] Running
	I0626 18:56:38.780883  244980 system_pods.go:89] "kube-controller-manager-addons-963360" [0b536efc-54e2-4f67-980f-725dbac4b6a5] Running
	I0626 18:56:38.780930  244980 system_pods.go:89] "kube-ingress-dns-minikube" [a13f6c82-e719-4c48-aa0a-d700b625647d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0626 18:56:38.780954  244980 system_pods.go:89] "kube-proxy-69vf5" [4c835d59-25ba-40b2-86c7-b610c9239341] Running
	I0626 18:56:38.780975  244980 system_pods.go:89] "kube-scheduler-addons-963360" [77a4aadd-c463-4708-879a-0c674b8682bf] Running
	I0626 18:56:38.781081  244980 system_pods.go:89] "metrics-server-844d8db974-zkzdr" [e7bcd344-88b7-4e24-8fd2-b1fe95144127] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0626 18:56:38.781125  244980 system_pods.go:89] "registry-kcrl6" [ecfe2e2c-43c4-42a9-a979-167fe22f5d47] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0626 18:56:38.781154  244980 system_pods.go:89] "registry-proxy-2n5gs" [da693eb2-5172-48f3-919d-332ab16d60f1] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0626 18:56:38.781178  244980 system_pods.go:89] "snapshot-controller-75bbb956b9-gzl98" [02bdbee1-c911-4a93-abbf-d4635384f58d] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0626 18:56:38.781214  244980 system_pods.go:89] "snapshot-controller-75bbb956b9-xrptg" [1f6b17fe-3aa4-4df3-9faa-6f52dedb7234] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0626 18:56:38.781237  244980 system_pods.go:89] "storage-provisioner" [552fcb00-182a-4068-a51a-45f6956e49de] Running
	I0626 18:56:38.781259  244980 system_pods.go:126] duration metric: took 229.480949ms to wait for k8s-apps to be running ...
	I0626 18:56:38.781292  244980 system_svc.go:44] waiting for kubelet service to be running ....
	I0626 18:56:38.781379  244980 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0626 18:56:38.780889  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:38.786665  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:38.800930  244980 system_svc.go:56] duration metric: took 19.630214ms WaitForService to wait for kubelet.
	I0626 18:56:38.801065  244980 kubeadm.go:581] duration metric: took 18.118803744s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0626 18:56:38.801104  244980 node_conditions.go:102] verifying NodePressure condition ...
	I0626 18:56:38.951918  244980 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0626 18:56:38.951950  244980 node_conditions.go:123] node cpu capacity is 2
	I0626 18:56:38.951964  244980 node_conditions.go:105] duration metric: took 150.842761ms to run NodePressure ...
	I0626 18:56:38.951975  244980 start.go:228] waiting for startup goroutines ...
	I0626 18:56:38.965111  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:39.166513  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:39.277558  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:39.278315  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:39.465223  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:39.667571  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:39.778428  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:39.779912  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:39.965247  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:40.167425  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:40.276834  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:40.278039  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:40.464839  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:40.666172  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:40.776096  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:40.778697  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:40.965813  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:41.165545  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:41.277592  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:41.277929  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:41.465239  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:41.665789  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:41.777617  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:41.778649  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:41.965628  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:42.166033  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:42.278014  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:42.278831  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:42.465510  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:42.665879  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:42.777894  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:42.781785  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:42.966680  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:43.167327  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:43.278809  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:43.279636  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:43.464650  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:43.666516  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:43.777234  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:43.781395  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:43.965522  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:44.166897  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:44.275936  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:44.279132  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:44.466081  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:44.666000  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:44.778930  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:44.780312  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:44.965132  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:45.166736  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:45.276620  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:45.277620  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:45.466078  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:45.668683  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:45.777084  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:45.778219  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:45.965422  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:46.166326  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:46.278827  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:46.279486  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:46.465206  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:46.666559  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:46.779120  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:46.780518  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:46.964643  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:47.165234  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:47.275564  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:47.277488  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:47.464961  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:47.666129  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:47.778062  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:47.798772  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:47.966207  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:48.166042  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:48.278613  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:48.280312  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:48.465515  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:48.667492  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:48.778614  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:48.779161  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:48.965470  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:49.166520  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:49.276912  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:49.278132  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0626 18:56:49.467028  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:49.667901  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:49.782112  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:49.783062  244980 kapi.go:107] duration metric: took 20.534772364s to wait for kubernetes.io/minikube-addons=registry ...
	I0626 18:56:49.964726  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:50.164964  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:50.275480  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:50.465413  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:50.666707  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:50.776446  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:50.965291  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:51.165575  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:51.276331  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:51.465714  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:51.665741  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:51.784840  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:51.966909  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:52.171509  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:52.276907  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:52.465489  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:52.672728  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:52.782949  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:52.970034  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:53.169542  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:53.280036  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:53.469230  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:53.672730  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:53.781292  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:53.965779  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:54.170586  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:54.277244  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:54.465928  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:54.666311  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:54.776363  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:54.965631  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:55.166543  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:55.275952  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:55.465879  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:55.665605  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:55.775616  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:55.965346  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:56.165741  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:56.276544  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:56.464922  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:56.665974  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:56.776257  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:56.965619  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:57.165767  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:57.276217  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:57.465748  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:57.666470  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:57.776110  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:57.964893  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:58.165618  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:58.276502  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:58.465668  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:58.668323  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:58.775729  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:58.965460  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:59.166773  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:59.275799  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:59.465710  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:56:59.668700  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:56:59.775830  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:56:59.965781  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:00.166209  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:00.276644  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:00.465701  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:00.665917  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:00.775309  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:00.965579  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:01.166598  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:01.279117  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:01.465160  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:01.666765  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:01.776371  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:01.965628  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:02.166612  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:02.277298  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:02.469815  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:02.666462  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:02.776098  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:02.965111  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:03.166540  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:03.276238  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:03.465243  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:03.665262  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:03.775479  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:03.965212  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:04.166639  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:04.276856  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:04.466380  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:04.666550  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:04.776765  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:04.965937  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:05.165686  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:05.275602  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:05.465274  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:05.664867  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:05.776033  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:05.964639  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:06.165459  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:06.275522  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:06.467511  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:06.666750  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:06.776409  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:06.965177  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:07.165710  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:07.276091  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:07.465158  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:07.666043  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:07.776011  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:07.965966  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:08.166106  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:08.276017  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:08.472458  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:08.669739  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:08.775685  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:08.965221  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:09.166157  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:09.275637  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:09.465348  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:09.673335  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:09.776492  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:09.965501  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:10.176457  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:10.276624  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:10.466235  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:10.667335  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:10.775760  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:10.965780  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:11.165756  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:11.275864  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:11.465619  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:11.666131  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:11.781720  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:11.966406  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:12.166615  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:12.276430  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:12.464972  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:12.665812  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:12.776879  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:12.965705  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:13.166430  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:13.276086  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:13.465701  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:13.666458  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:13.776688  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:13.965961  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:14.166831  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:14.276187  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:14.464876  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:14.665975  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:14.775547  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:14.965271  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:15.170483  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:15.276673  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:15.464954  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:15.667504  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:15.775700  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:15.966137  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:16.166223  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:16.276482  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:16.465366  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:16.665361  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:16.775813  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:16.965867  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:17.166137  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:17.275701  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:17.465812  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:17.669655  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:17.775388  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:17.965767  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:18.166349  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:18.277723  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:18.466171  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:18.666209  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:18.777651  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:18.965617  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:19.166938  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:19.277116  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:19.465170  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:19.666128  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:19.776915  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:19.964557  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:20.166305  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:20.276459  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:20.466041  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:20.666079  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:20.776085  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:20.964701  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:21.165993  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:21.276073  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:21.464867  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:21.665470  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:21.776333  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:21.965046  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:22.166142  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:22.276349  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:22.465302  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:22.666255  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:22.775667  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:22.965337  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:23.165962  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:23.275978  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:23.465250  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:23.670504  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:23.776065  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:23.966320  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:24.166539  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0626 18:57:24.275693  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:24.465367  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:24.672292  244980 kapi.go:107] duration metric: took 50.531020421s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0626 18:57:24.775346  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:24.965153  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:25.276044  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:25.465115  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:25.775714  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:25.965476  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:26.276111  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:26.464691  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:26.779712  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:26.965599  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:27.276769  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:27.465490  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:27.775522  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:27.965027  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:28.276222  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:28.466025  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:28.775555  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:28.965198  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:29.275941  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:29.464851  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:29.775155  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:29.964923  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:30.276620  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:30.465118  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:30.775444  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:30.965873  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:31.276029  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:31.464957  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:31.776188  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:31.964857  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:32.275292  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:32.465465  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:32.775697  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:32.968734  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:33.280153  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:33.465190  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:33.776665  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:33.965677  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:34.275871  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:34.465740  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:34.777722  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:34.965366  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:35.276451  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:35.465666  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:35.775735  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:35.966460  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:36.276262  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:36.468231  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:36.776516  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:36.968885  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:37.275772  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:37.465704  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:37.775883  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:37.965191  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:38.276605  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:38.465891  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:38.775753  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:38.965872  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:39.275715  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:39.465921  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:39.777195  244980 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0626 18:57:39.966219  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:40.276180  244980 kapi.go:107] duration metric: took 1m11.032568667s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0626 18:57:40.465035  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:40.964978  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:41.465232  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:41.964664  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:42.465474  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:42.966001  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:43.465172  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:43.964620  244980 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0626 18:57:44.464826  244980 kapi.go:107] duration metric: took 1m8.510722711s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0626 18:57:44.466535  244980 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-963360 cluster.
	I0626 18:57:44.468382  244980 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0626 18:57:44.470142  244980 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0626 18:57:44.471639  244980 out.go:177] * Enabled addons: ingress-dns, storage-provisioner, cloud-spanner, inspektor-gadget, default-storageclass, metrics-server, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I0626 18:57:44.473236  244980 addons.go:499] enable addons completed in 1m24.369903016s: enabled=[ingress-dns storage-provisioner cloud-spanner inspektor-gadget default-storageclass metrics-server volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I0626 18:57:44.473274  244980 start.go:233] waiting for cluster config update ...
	I0626 18:57:44.473290  244980 start.go:242] writing updated cluster config ...
	I0626 18:57:44.473589  244980 ssh_runner.go:195] Run: rm -f paused
	I0626 18:57:44.541706  244980 start.go:652] kubectl: 1.27.3, cluster: 1.27.3 (minor skew: 0)
	I0626 18:57:44.543615  244980 out.go:177] * Done! kubectl is now configured to use "addons-963360" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Jun 26 18:58:31 addons-963360 dockerd[1090]: time="2023-06-26T18:58:31.954731386Z" level=info msg="ignoring event" container=9c6d69789659f61385c0b92eabc16f40a6d85d160ab32d080de0c3b93723d476 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:32 addons-963360 cri-dockerd[1300]: time="2023-06-26T18:58:32Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/6aadab89420673e90c9c454cfd8edbf474a591005b37ca9cdeaccccfea379db1/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	Jun 26 18:58:34 addons-963360 cri-dockerd[1300]: time="2023-06-26T18:58:34Z" level=info msg="Stop pulling image gcr.io/google-samples/hello-app:1.0: Status: Downloaded newer image for gcr.io/google-samples/hello-app:1.0"
	Jun 26 18:58:34 addons-963360 dockerd[1090]: time="2023-06-26T18:58:34.682650322Z" level=info msg="ignoring event" container=47f5d18926a541e0aac71029cd27f092c61dd237d8a5af7983fc83d61fe1872c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:35 addons-963360 dockerd[1090]: time="2023-06-26T18:58:35.095363359Z" level=info msg="ignoring event" container=572722d9f7f23c4ac848d7564f01e18cce54c5db7617f196b6ccafbdb4c72d71 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:43 addons-963360 cri-dockerd[1300]: time="2023-06-26T18:58:43Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/2f96e0e759bebe860bb324336b835adbdf47081951592117472ca806c38db9d2/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	Jun 26 18:58:43 addons-963360 cri-dockerd[1300]: time="2023-06-26T18:58:43Z" level=info msg="Stop pulling image docker.io/nginx:latest: Status: Image is up to date for nginx:latest"
	Jun 26 18:58:47 addons-963360 dockerd[1090]: time="2023-06-26T18:58:47.920289065Z" level=info msg="ignoring event" container=b46c2c1768db0266fbd71a2ec930eab2757443671a0a6eb4be9d21460c92fc8d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:48 addons-963360 dockerd[1090]: time="2023-06-26T18:58:48.202956986Z" level=info msg="ignoring event" container=8ea9ba095094eb9a0b1ec250d093073f2cb65bc9438bfec845588b77ac3ee720 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:49 addons-963360 dockerd[1090]: time="2023-06-26T18:58:49.788651436Z" level=info msg="Container failed to exit within 1s of signal 15 - using the force" container=b21ab9a3ee7ec41918b43c83a7814e136137adaf39c0d57c5088161a0c8c8b64
	Jun 26 18:58:49 addons-963360 dockerd[1090]: time="2023-06-26T18:58:49.849139127Z" level=info msg="ignoring event" container=b21ab9a3ee7ec41918b43c83a7814e136137adaf39c0d57c5088161a0c8c8b64 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:49 addons-963360 dockerd[1090]: time="2023-06-26T18:58:49.982295993Z" level=info msg="ignoring event" container=d646491c9cc44d8bae877d3715297b6f03c8be4392c7a4b3cbf8f1f7d0dd436b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:50 addons-963360 dockerd[1090]: time="2023-06-26T18:58:50.023539858Z" level=info msg="ignoring event" container=09540c64f19b36f5444881f5ce3df260e2c1bba490c46839f58fa31ad7add2dc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:50 addons-963360 dockerd[1090]: time="2023-06-26T18:58:50.096659213Z" level=info msg="ignoring event" container=2f96e0e759bebe860bb324336b835adbdf47081951592117472ca806c38db9d2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.446178116Z" level=info msg="ignoring event" container=d4ea27a521b5c233f918e7c6f528c1e7b98831fbecf647d672607938e09a11d9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.451381960Z" level=info msg="ignoring event" container=abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.469801988Z" level=info msg="ignoring event" container=50ffb9795ecb3f491760ac452f2c46fe2e123f966517dd03b0a3b6707b4c7477 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.489380310Z" level=info msg="ignoring event" container=6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.531835408Z" level=info msg="ignoring event" container=afa201c2e085ca26afb00c171c5f29498c3213fef672c2a13b649678adc0ea23 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.548700838Z" level=info msg="ignoring event" container=38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.554367538Z" level=info msg="ignoring event" container=4ed7385f99dea0ab83c1fd811bc5c48aecd5c13ad10a82a2dbd8b894d9704ebe module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.593430718Z" level=info msg="ignoring event" container=b7cce9ea8eb84fb97d9ac26e9d7f557d0cb06aab5754d2e12f97f4fd49c11921 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.729561758Z" level=info msg="ignoring event" container=571437525aa765510dff5773086310473e1fead9becfa6e662724355bc940020 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.759149050Z" level=info msg="ignoring event" container=40174cb55fa7fe9a5a63cae9a161191455c91cefc6a63e0761b855e484346db7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 18:58:51 addons-963360 dockerd[1090]: time="2023-06-26T18:58:51.782099869Z" level=info msg="ignoring event" container=9645952e61af7dd601f884e75f17dcc18ac4957bab0596ca1b65fc8622d4d361 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                                        CREATED              STATE               NAME                         ATTEMPT             POD ID              POD
	8ea9ba095094e       13753a81eccfd                                                                                                                8 seconds ago        Exited              hello-world-app              2                   6aadab8942067       hello-world-app-65bdb79f98-8jlgn
	8772bf97f2c71       nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6                                                32 seconds ago       Running             nginx                        0                   f345081c24f32       nginx
	3d692ee61a5e4       ghcr.io/headlamp-k8s/headlamp@sha256:67ba87b88218563eec9684525904936609713b02dcbcf4390cd055766217ed45                        About a minute ago   Running             headlamp                     0                   b15fae49d3b73       headlamp-66f6498c69-qp8sm
	1b01a48aca987       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf                 About a minute ago   Running             gcp-auth                     0                   d47448c14ed7a       gcp-auth-58478865f7-qdlsm
	56ab7ca5d6d13       8f2588812ab29                                                                                                                About a minute ago   Exited              patch                        1                   100debd6bce9a       ingress-nginx-admission-patch-f47rq
	ae57eb4ea4e0b       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:543c40fd093964bc9ab509d3e791f9989963021f1e9e4c9c7b6700b02bfb227b   About a minute ago   Exited              create                       0                   4a6717ff64bde       ingress-nginx-admission-create-m8929
	85ad4ebbb8cfa       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280      About a minute ago   Running             volume-snapshot-controller   0                   aa9afb14fa752       snapshot-controller-75bbb956b9-gzl98
	0757366ac382b       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280      About a minute ago   Running             volume-snapshot-controller   0                   50476f3024ce8       snapshot-controller-75bbb956b9-xrptg
	d08d9f19c03d7       97e04611ad434                                                                                                                2 minutes ago        Running             coredns                      1                   50c7aec8580a5       coredns-5d78c9869d-prmt6
	04ade069e63cd       ba04bb24b9575                                                                                                                2 minutes ago        Running             storage-provisioner          0                   6baeb1a8901bb       storage-provisioner
	90e6ce35291dd       kindest/kindnetd@sha256:6c00e28db008c2afa67d9ee085c86184ec9ae5281d5ae1bd15006746fb9a1974                                     2 minutes ago        Running             kindnet-cni                  0                   d9fa53ef67a86       kindnet-lmwht
	85ee625f8eb79       97e04611ad434                                                                                                                2 minutes ago        Exited              coredns                      0                   b118aed91678b       coredns-5d78c9869d-prmt6
	d248e0e35905c       fb73e92641fd5                                                                                                                2 minutes ago        Running             kube-proxy                   0                   51151b1fef2c2       kube-proxy-69vf5
	ea665f41cf3f6       bcb9e554eaab6                                                                                                                2 minutes ago        Running             kube-scheduler               0                   a19ed15e0b84e       kube-scheduler-addons-963360
	f7b1d415b1b61       24bc64e911039                                                                                                                2 minutes ago        Running             etcd                         0                   232d47ecce670       etcd-addons-963360
	f2055dc65727d       ab3683b584ae5                                                                                                                2 minutes ago        Running             kube-controller-manager      0                   4f6177f92ea9a       kube-controller-manager-addons-963360
	6cf6a313f1411       39dfb036b0986                                                                                                                2 minutes ago        Running             kube-apiserver               0                   40b870e4450e1       kube-apiserver-addons-963360
	
	* 
	* ==> coredns [85ee625f8eb7] <==
	* [INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
	CoreDNS-1.10.1
	linux/arm64, go1.20, 055b2c3
	[INFO] plugin/health: Going into lameduck mode for 5s
	[ERROR] plugin/errors: 2 7673954382310292356.7624730059973829692. HINFO: dial udp 192.168.49.1:53: connect: network is unreachable
	[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: network is unreachable
	[ERROR] plugin/errors: 2 7673954382310292356.7624730059973829692. HINFO: dial udp 192.168.49.1:53: connect: network is unreachable
	
	* 
	* ==> coredns [d08d9f19c03d] <==
	* [INFO] 10.244.0.16:44834 - 57316 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000065132s
	[INFO] 10.244.0.16:44834 - 11688 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000044824s
	[INFO] 10.244.0.16:44834 - 34784 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000096155s
	[INFO] 10.244.0.16:44834 - 10774 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000076143s
	[INFO] 10.244.0.16:44834 - 51668 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001183548s
	[INFO] 10.244.0.16:44834 - 29450 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001078655s
	[INFO] 10.244.0.16:44834 - 43634 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000109464s
	[INFO] 10.244.0.16:59864 - 59807 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000113533s
	[INFO] 10.244.0.16:45280 - 37028 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000168081s
	[INFO] 10.244.0.16:59864 - 32452 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000084381s
	[INFO] 10.244.0.16:59864 - 7307 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000063844s
	[INFO] 10.244.0.16:59864 - 61037 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000077522s
	[INFO] 10.244.0.16:45280 - 37187 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000081723s
	[INFO] 10.244.0.16:45280 - 31559 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000050421s
	[INFO] 10.244.0.16:59864 - 24498 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000120713s
	[INFO] 10.244.0.16:45280 - 6096 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000086473s
	[INFO] 10.244.0.16:59864 - 1791 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000050051s
	[INFO] 10.244.0.16:45280 - 33682 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00009138s
	[INFO] 10.244.0.16:45280 - 16232 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000068439s
	[INFO] 10.244.0.16:45280 - 51215 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000774394s
	[INFO] 10.244.0.16:59864 - 22992 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002188588s
	[INFO] 10.244.0.16:45280 - 9077 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001175048s
	[INFO] 10.244.0.16:59864 - 11168 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000979595s
	[INFO] 10.244.0.16:59864 - 65482 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000081074s
	[INFO] 10.244.0.16:45280 - 1020 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000076914s
	
	* 
	* ==> describe nodes <==
	* Name:               addons-963360
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-963360
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=759becbe25e432e7a4042c59713ee144df2072e1
	                    minikube.k8s.io/name=addons-963360
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_06_26T18_56_08_0700
	                    minikube.k8s.io/version=v1.30.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-963360
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 26 Jun 2023 18:56:03 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-963360
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 26 Jun 2023 18:58:50 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 26 Jun 2023 18:58:40 +0000   Mon, 26 Jun 2023 18:56:00 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 26 Jun 2023 18:58:40 +0000   Mon, 26 Jun 2023 18:56:00 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 26 Jun 2023 18:58:40 +0000   Mon, 26 Jun 2023 18:56:00 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 26 Jun 2023 18:58:40 +0000   Mon, 26 Jun 2023 18:56:17 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-963360
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022624Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022624Ki
	  pods:               110
	System Info:
	  Machine ID:                 85da3915af3a48f19def1ec6a5a0d636
	  System UUID:                378dcd24-2fff-429f-bce1-1a5f6b0cce37
	  Boot ID:                    210d3827-912b-4be1-a50b-47a88cefca99
	  Kernel Version:             5.15.0-1038-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.2
	  Kubelet Version:            v1.27.3
	  Kube-Proxy Version:         v1.27.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (14 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-65bdb79f98-8jlgn         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         25s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         38s
	  gcp-auth                    gcp-auth-58478865f7-qdlsm                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m22s
	  headlamp                    headlamp-66f6498c69-qp8sm                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         66s
	  kube-system                 coredns-5d78c9869d-prmt6                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     2m38s
	  kube-system                 etcd-addons-963360                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         2m50s
	  kube-system                 kindnet-lmwht                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      2m38s
	  kube-system                 kube-apiserver-addons-963360             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m50s
	  kube-system                 kube-controller-manager-addons-963360    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m50s
	  kube-system                 kube-proxy-69vf5                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m38s
	  kube-system                 kube-scheduler-addons-963360             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m50s
	  kube-system                 snapshot-controller-75bbb956b9-gzl98     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m30s
	  kube-system                 snapshot-controller-75bbb956b9-xrptg     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m30s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m32s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (42%!)(MISSING)  100m (5%!)(MISSING)
	  memory             220Mi (2%!)(MISSING)  220Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 2m36s  kube-proxy       
	  Normal  Starting                 2m51s  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m50s  kubelet          Node addons-963360 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m50s  kubelet          Node addons-963360 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m50s  kubelet          Node addons-963360 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             2m50s  kubelet          Node addons-963360 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  2m50s  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                2m40s  kubelet          Node addons-963360 status is now: NodeReady
	  Normal  RegisteredNode           2m39s  node-controller  Node addons-963360 event: Registered Node addons-963360 in Controller
	
	* 
	* ==> dmesg <==
	* [  +0.000797] FS-Cache: N-cookie c=0000000c [p=00000003 fl=2 nc=0 na=1]
	[  +0.000927] FS-Cache: N-cookie d=0000000085ec082e{9p.inode} n=00000000aa080329
	[  +0.001041] FS-Cache: N-key=[8] '925b3b0000000000'
	[  +0.002815] FS-Cache: Duplicate cookie detected
	[  +0.000696] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
	[  +0.001057] FS-Cache: O-cookie d=0000000085ec082e{9p.inode} n=000000007c837106
	[  +0.001101] FS-Cache: O-key=[8] '925b3b0000000000'
	[  +0.000701] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
	[  +0.000931] FS-Cache: N-cookie d=0000000085ec082e{9p.inode} n=0000000095530259
	[  +0.001074] FS-Cache: N-key=[8] '925b3b0000000000'
	[  +1.883203] FS-Cache: Duplicate cookie detected
	[  +0.000717] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000963] FS-Cache: O-cookie d=0000000085ec082e{9p.inode} n=00000000c8967f43
	[  +0.001124] FS-Cache: O-key=[8] '915b3b0000000000'
	[  +0.000700] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
	[  +0.000962] FS-Cache: N-cookie d=0000000085ec082e{9p.inode} n=00000000aa080329
	[  +0.001066] FS-Cache: N-key=[8] '915b3b0000000000'
	[  +0.266071] FS-Cache: Duplicate cookie detected
	[  +0.000764] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
	[  +0.000960] FS-Cache: O-cookie d=0000000085ec082e{9p.inode} n=0000000008d51753
	[  +0.001137] FS-Cache: O-key=[8] '995b3b0000000000'
	[  +0.000727] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
	[  +0.000926] FS-Cache: N-cookie d=0000000085ec082e{9p.inode} n=00000000adeea2a2
	[  +0.001059] FS-Cache: N-key=[8] '995b3b0000000000'
	[ +10.053398] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
	
	* 
	* ==> etcd [f7b1d415b1b6] <==
	* {"level":"info","ts":"2023-06-26T18:56:00.365Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2023-06-26T18:56:00.369Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-06-26T18:56:00.386Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2023-06-26T18:56:00.386Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-06-26T18:56:00.387Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-06-26T18:56:00.387Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2023-06-26T18:56:00.387Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2023-06-26T18:56:00.433Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-06-26T18:56:00.433Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-06-26T18:56:00.433Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-06-26T18:56:00.433Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-06-26T18:56:00.433Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-06-26T18:56:00.433Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-06-26T18:56:00.433Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-06-26T18:56:00.437Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-06-26T18:56:00.437Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-963360 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-06-26T18:56:00.437Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-06-26T18:56:00.439Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2023-06-26T18:56:00.439Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-06-26T18:56:00.445Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-06-26T18:56:00.445Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2023-06-26T18:56:00.445Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-06-26T18:56:00.445Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-06-26T18:56:00.445Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-06-26T18:56:00.465Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.49.2:2379"}
	
	* 
	* ==> gcp-auth [1b01a48aca98] <==
	* 2023/06/26 18:57:43 GCP Auth Webhook started!
	2023/06/26 18:57:51 Ready to marshal response ...
	2023/06/26 18:57:51 Ready to write response ...
	2023/06/26 18:57:51 Ready to marshal response ...
	2023/06/26 18:57:51 Ready to write response ...
	2023/06/26 18:57:51 Ready to marshal response ...
	2023/06/26 18:57:51 Ready to write response ...
	2023/06/26 18:57:54 Ready to marshal response ...
	2023/06/26 18:57:54 Ready to write response ...
	2023/06/26 18:58:18 Ready to marshal response ...
	2023/06/26 18:58:18 Ready to write response ...
	2023/06/26 18:58:19 Ready to marshal response ...
	2023/06/26 18:58:19 Ready to write response ...
	2023/06/26 18:58:32 Ready to marshal response ...
	2023/06/26 18:58:32 Ready to write response ...
	2023/06/26 18:58:42 Ready to marshal response ...
	2023/06/26 18:58:42 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  18:58:57 up  1:41,  0 users,  load average: 1.68, 2.25, 2.14
	Linux addons-963360 5.15.0-1038-aws #43~20.04.1-Ubuntu SMP Fri Jun 2 17:11:42 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kindnet [90e6ce35291d] <==
	* I0626 18:56:53.517613       1 main.go:227] handling current node
	I0626 18:57:03.522308       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:57:03.522340       1 main.go:227] handling current node
	I0626 18:57:13.535464       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:57:13.535489       1 main.go:227] handling current node
	I0626 18:57:23.549635       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:57:23.549664       1 main.go:227] handling current node
	I0626 18:57:33.560876       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:57:33.560902       1 main.go:227] handling current node
	I0626 18:57:43.564924       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:57:43.565193       1 main.go:227] handling current node
	I0626 18:57:53.579123       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:57:53.579149       1 main.go:227] handling current node
	I0626 18:58:03.590486       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:58:03.590518       1 main.go:227] handling current node
	I0626 18:58:13.600688       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:58:13.600719       1 main.go:227] handling current node
	I0626 18:58:23.632807       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:58:23.632839       1 main.go:227] handling current node
	I0626 18:58:33.641538       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:58:33.641563       1 main.go:227] handling current node
	I0626 18:58:43.652733       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:58:43.652758       1 main.go:227] handling current node
	I0626 18:58:53.658580       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0626 18:58:53.658610       1 main.go:227] handling current node
	
	* 
	* ==> kube-apiserver [6cf6a313f141] <==
	* I0626 18:56:28.847647       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs=map[IPv4:10.103.55.240]
	I0626 18:56:28.889682       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs=map[IPv4:10.97.123.11]
	I0626 18:56:28.950425       1 controller.go:624] quota admission added evaluator for: jobs.batch
	I0626 18:56:33.717500       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-attacher" clusterIPs=map[IPv4:10.111.149.144]
	I0626 18:56:33.744404       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
	I0626 18:56:34.005868       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-resizer" clusterIPs=map[IPv4:10.99.54.157]
	I0626 18:56:35.735251       1 alloc.go:330] "allocated clusterIPs" service="gcp-auth/gcp-auth" clusterIPs=map[IPv4:10.109.154.235]
	E0626 18:56:56.822196       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.107.73.6:443/apis/metrics.k8s.io/v1beta1: Get "https://10.107.73.6:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.107.73.6:443: connect: connection refused
	E0626 18:56:56.823108       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.107.73.6:443/apis/metrics.k8s.io/v1beta1: Get "https://10.107.73.6:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.107.73.6:443: connect: connection refused
	I0626 18:56:56.823159       1 handler_discovery.go:325] DiscoveryManager: Failed to download discovery for kube-system/metrics-server:443: 503 error trying to reach service: dial tcp 10.107.73.6:443: connect: connection refused
	I0626 18:56:56.823182       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	E0626 18:56:56.829601       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.107.73.6:443/apis/metrics.k8s.io/v1beta1: Get "https://10.107.73.6:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.107.73.6:443: connect: connection refused
	I0626 18:56:56.918750       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0626 18:57:03.709759       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0626 18:57:51.509423       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs=map[IPv4:10.102.9.131]
	I0626 18:58:03.711463       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0626 18:58:12.736001       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	I0626 18:58:12.751343       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W0626 18:58:13.770602       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I0626 18:58:18.768054       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
	I0626 18:58:19.258828       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs=map[IPv4:10.97.47.33]
	I0626 18:58:30.359221       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	I0626 18:58:32.313925       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs=map[IPv4:10.107.172.165]
	E0626 18:58:48.805560       1 authentication.go:70] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	E0626 18:58:48.892595       1 authentication.go:70] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	
	* 
	* ==> kube-controller-manager [f2055dc65727] <==
	* E0626 18:58:14.907913       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0626 18:58:16.358293       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	W0626 18:58:16.803391       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0626 18:58:16.803427       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0626 18:58:19.144932       1 shared_informer.go:311] Waiting for caches to sync for resource quota
	I0626 18:58:19.151189       1 shared_informer.go:318] Caches are synced for resource quota
	I0626 18:58:19.505931       1 shared_informer.go:311] Waiting for caches to sync for garbage collector
	I0626 18:58:19.505993       1 shared_informer.go:318] Caches are synced for garbage collector
	W0626 18:58:20.959140       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0626 18:58:20.959172       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0626 18:58:22.975178       1 namespace_controller.go:182] "Namespace has been deleted" namespace="gadget"
	I0626 18:58:31.990293       1 event.go:307] "Event occurred" object="default/hello-world-app" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-world-app-65bdb79f98 to 1"
	I0626 18:58:32.060031       1 event.go:307] "Event occurred" object="default/hello-world-app-65bdb79f98" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-world-app-65bdb79f98-8jlgn"
	W0626 18:58:32.271352       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0626 18:58:32.271585       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0626 18:58:33.344865       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0626 18:58:33.347632       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0626 18:58:33.841408       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0626 18:58:42.208021       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0626 18:58:48.713510       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-create
	I0626 18:58:48.760451       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-patch
	I0626 18:58:51.210141       1 stateful_set.go:458] "StatefulSet has been deleted" key="kube-system/csi-hostpath-attacher"
	I0626 18:58:51.306726       1 stateful_set.go:458] "StatefulSet has been deleted" key="kube-system/csi-hostpath-resizer"
	W0626 18:58:55.881766       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0626 18:58:55.881804       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	
	* 
	* ==> kube-proxy [d248e0e35905] <==
	* I0626 18:56:20.915556       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0626 18:56:20.915673       1 server_others.go:110] "Detected node IP" address="192.168.49.2"
	I0626 18:56:20.915695       1 server_others.go:554] "Using iptables proxy"
	I0626 18:56:20.951688       1 server_others.go:192] "Using iptables Proxier"
	I0626 18:56:20.951723       1 server_others.go:199] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0626 18:56:20.951731       1 server_others.go:200] "Creating dualStackProxier for iptables"
	I0626 18:56:20.951746       1 server_others.go:484] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, defaulting to no-op detect-local for IPv6"
	I0626 18:56:20.951824       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0626 18:56:20.952368       1 server.go:658] "Version info" version="v1.27.3"
	I0626 18:56:20.952380       1 server.go:660] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0626 18:56:20.953521       1 config.go:188] "Starting service config controller"
	I0626 18:56:20.953593       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0626 18:56:20.953630       1 config.go:97] "Starting endpoint slice config controller"
	I0626 18:56:20.953634       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0626 18:56:20.957373       1 config.go:315] "Starting node config controller"
	I0626 18:56:20.957392       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0626 18:56:21.054812       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0626 18:56:21.054883       1 shared_informer.go:318] Caches are synced for service config
	I0626 18:56:21.057476       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [ea665f41cf3f] <==
	* W0626 18:56:03.979796       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0626 18:56:03.979860       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0626 18:56:03.980450       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0626 18:56:03.980829       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0626 18:56:03.981021       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0626 18:56:03.981255       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0626 18:56:03.980806       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0626 18:56:03.981453       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0626 18:56:03.980817       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0626 18:56:03.981634       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0626 18:56:03.980744       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0626 18:56:03.981869       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0626 18:56:03.981103       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0626 18:56:03.982047       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0626 18:56:04.872487       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0626 18:56:04.872534       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0626 18:56:04.943932       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0626 18:56:04.943983       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0626 18:56:04.989068       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0626 18:56:04.989162       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0626 18:56:05.060637       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0626 18:56:05.060676       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0626 18:56:05.118308       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0626 18:56:05.118533       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0626 18:56:07.966755       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.637860    2302 scope.go:115] "RemoveContainer" containerID="38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.638443    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194} err="failed to get container status \"38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194\": rpc error: code = Unknown desc = Error response from daemon: No such container: 38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.638468    2302 scope.go:115] "RemoveContainer" containerID="abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.639091    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea} err="failed to get container status \"abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea\": rpc error: code = Unknown desc = Error response from daemon: No such container: abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.639114    2302 scope.go:115] "RemoveContainer" containerID="6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.639709    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0} err="failed to get container status \"6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0\": rpc error: code = Unknown desc = Error response from daemon: No such container: 6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.639733    2302 scope.go:115] "RemoveContainer" containerID="b7cce9ea8eb84fb97d9ac26e9d7f557d0cb06aab5754d2e12f97f4fd49c11921"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.640318    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:b7cce9ea8eb84fb97d9ac26e9d7f557d0cb06aab5754d2e12f97f4fd49c11921} err="failed to get container status \"b7cce9ea8eb84fb97d9ac26e9d7f557d0cb06aab5754d2e12f97f4fd49c11921\": rpc error: code = Unknown desc = Error response from daemon: No such container: b7cce9ea8eb84fb97d9ac26e9d7f557d0cb06aab5754d2e12f97f4fd49c11921"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.640344    2302 scope.go:115] "RemoveContainer" containerID="4ed7385f99dea0ab83c1fd811bc5c48aecd5c13ad10a82a2dbd8b894d9704ebe"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.640916    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:4ed7385f99dea0ab83c1fd811bc5c48aecd5c13ad10a82a2dbd8b894d9704ebe} err="failed to get container status \"4ed7385f99dea0ab83c1fd811bc5c48aecd5c13ad10a82a2dbd8b894d9704ebe\": rpc error: code = Unknown desc = Error response from daemon: No such container: 4ed7385f99dea0ab83c1fd811bc5c48aecd5c13ad10a82a2dbd8b894d9704ebe"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.640943    2302 scope.go:115] "RemoveContainer" containerID="50ffb9795ecb3f491760ac452f2c46fe2e123f966517dd03b0a3b6707b4c7477"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.641673    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:50ffb9795ecb3f491760ac452f2c46fe2e123f966517dd03b0a3b6707b4c7477} err="failed to get container status \"50ffb9795ecb3f491760ac452f2c46fe2e123f966517dd03b0a3b6707b4c7477\": rpc error: code = Unknown desc = Error response from daemon: No such container: 50ffb9795ecb3f491760ac452f2c46fe2e123f966517dd03b0a3b6707b4c7477"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.641699    2302 scope.go:115] "RemoveContainer" containerID="38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.642294    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194} err="failed to get container status \"38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194\": rpc error: code = Unknown desc = Error response from daemon: No such container: 38594a1e3028c7304cc485d28baa72dce9bc25aec2dc57b775a6828a69c47194"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.642317    2302 scope.go:115] "RemoveContainer" containerID="abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.642879    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea} err="failed to get container status \"abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea\": rpc error: code = Unknown desc = Error response from daemon: No such container: abc9b9f5ceb7ae14027b744afdc48ea84b74a40f01d433722282b51f8a6cd1ea"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.642902    2302 scope.go:115] "RemoveContainer" containerID="6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.643459    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0} err="failed to get container status \"6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0\": rpc error: code = Unknown desc = Error response from daemon: No such container: 6137b42a081f7018370d04fd2fc93bb2e13c2f721f7c4ea138f6a6f382ec54b0"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.643482    2302 scope.go:115] "RemoveContainer" containerID="d4ea27a521b5c233f918e7c6f528c1e7b98831fbecf647d672607938e09a11d9"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.657717    2302 scope.go:115] "RemoveContainer" containerID="d4ea27a521b5c233f918e7c6f528c1e7b98831fbecf647d672607938e09a11d9"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: E0626 18:58:52.658520    2302 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: d4ea27a521b5c233f918e7c6f528c1e7b98831fbecf647d672607938e09a11d9" containerID="d4ea27a521b5c233f918e7c6f528c1e7b98831fbecf647d672607938e09a11d9"
	Jun 26 18:58:52 addons-963360 kubelet[2302]: I0626 18:58:52.658562    2302 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:d4ea27a521b5c233f918e7c6f528c1e7b98831fbecf647d672607938e09a11d9} err="failed to get container status \"d4ea27a521b5c233f918e7c6f528c1e7b98831fbecf647d672607938e09a11d9\": rpc error: code = Unknown desc = Error response from daemon: No such container: d4ea27a521b5c233f918e7c6f528c1e7b98831fbecf647d672607938e09a11d9"
	Jun 26 18:58:53 addons-963360 kubelet[2302]: I0626 18:58:53.052705    2302 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=9469adbf-cdee-4ab9-95b6-b777a2d6d261 path="/var/lib/kubelet/pods/9469adbf-cdee-4ab9-95b6-b777a2d6d261/volumes"
	Jun 26 18:58:53 addons-963360 kubelet[2302]: I0626 18:58:53.053807    2302 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=c8af2b4b-da4a-4667-94ba-74193e3cdba9 path="/var/lib/kubelet/pods/c8af2b4b-da4a-4667-94ba-74193e3cdba9/volumes"
	Jun 26 18:58:53 addons-963360 kubelet[2302]: I0626 18:58:53.054324    2302 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=f5149e56-fedf-4f23-b369-40a7f1c65af7 path="/var/lib/kubelet/pods/f5149e56-fedf-4f23-b369-40a7f1c65af7/volumes"
	
	* 
	* ==> storage-provisioner [04ade069e63c] <==
	* I0626 18:56:26.216593       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0626 18:56:26.242745       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0626 18:56:26.242854       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0626 18:56:26.256459       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0626 18:56:26.256763       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-963360_134256f4-d820-4432-a8ba-8b7024acee4b!
	I0626 18:56:26.265422       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1210abd0-f0e8-4ab2-9c2b-39f3ce7c6369", APIVersion:"v1", ResourceVersion:"487", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-963360_134256f4-d820-4432-a8ba-8b7024acee4b became leader
	I0626 18:56:26.357393       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-963360_134256f4-d820-4432-a8ba-8b7024acee4b!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-963360 -n addons-963360
helpers_test.go:261: (dbg) Run:  kubectl --context addons-963360 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (40.64s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (13.81s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdspecific-port597471606/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (373.6718ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (264.683257ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (378.508775ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (356.763161ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (401.576355ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (354.609576ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
2023/06/26 19:03:51 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (338.574846ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:253: /mount-9p did not appear within 12.974480448s: exit status 1
functional_test_mount_test.go:220: "TestFunctional/parallel/MountCmd/specific-port" failed, getting debug info...
functional_test_mount_test.go:221: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates"
functional_test_mount_test.go:221: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates": exit status 1 (360.2761ms)

                                                
                                                
-- stdout --
	total 8
	drwxr-xr-x 2 root root 4096 Jun 26 19:03 .
	drwxr-xr-x 1 root root 4096 Jun 26 19:03 ..
	cat: /mount-9p/pod-dates: No such file or directory

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:223: debugging command "out/minikube-linux-arm64 -p functional-453313 ssh \"mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates\"" failed : exit status 1
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "sudo umount -f /mount-9p": exit status 1 (361.790204ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-453313 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdspecific-port597471606/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:234: (dbg) [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdspecific-port597471606/001:/mount-9p --alsologtostderr -v=1 --port 46464] stdout:
* Mounting host path /tmp/TestFunctionalparallelMountCmdspecific-port597471606/001 into VM as /mount-9p ...
- Mount type:   9p
- User ID:      docker
- Group ID:     docker
- Version:      9p2000.L
- Message Size: 262144
- Options:      map[]
- Bind Address: 192.168.49.1:46464
* Userspace file server: ufs starting
* Userspace file server is shutdown

                                                
                                                

                                                
                                                
functional_test_mount_test.go:234: (dbg) [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdspecific-port597471606/001:/mount-9p --alsologtostderr -v=1 --port 46464] stderr:
I0626 19:03:39.924357  283641 out.go:296] Setting OutFile to fd 1 ...
I0626 19:03:39.930975  283641 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:39.931019  283641 out.go:309] Setting ErrFile to fd 2...
I0626 19:03:39.931036  283641 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:39.931279  283641 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
I0626 19:03:39.931680  283641 mustload.go:65] Loading cluster: functional-453313
I0626 19:03:39.934187  283641 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:39.934933  283641 cli_runner.go:164] Run: docker container inspect functional-453313 --format={{.State.Status}}
I0626 19:03:39.965218  283641 host.go:66] Checking if "functional-453313" exists ...
I0626 19:03:39.965534  283641 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0626 19:03:40.075287  283641 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-06-26 19:03:40.057371921 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
I0626 19:03:40.075468  283641 cli_runner.go:164] Run: docker network inspect functional-453313 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0626 19:03:40.100720  283641 out.go:177] * Mounting host path /tmp/TestFunctionalparallelMountCmdspecific-port597471606/001 into VM as /mount-9p ...
I0626 19:03:40.102565  283641 out.go:177]   - Mount type:   9p
I0626 19:03:40.104468  283641 out.go:177]   - User ID:      docker
I0626 19:03:40.106536  283641 out.go:177]   - Group ID:     docker
I0626 19:03:40.108681  283641 out.go:177]   - Version:      9p2000.L
I0626 19:03:40.110289  283641 out.go:177]   - Message Size: 262144
I0626 19:03:40.111979  283641 out.go:177]   - Options:      map[]
I0626 19:03:40.113457  283641 out.go:177]   - Bind Address: 192.168.49.1:46464
I0626 19:03:40.114974  283641 out.go:177] * Userspace file server: 
I0626 19:03:40.116781  283641 main.go:125] stdlog: ufs.go:27 listen tcp 192.168.49.1:46464: bind: address already in use
I0626 19:03:40.115261  283641 ssh_runner.go:195] Run: /bin/bash -c "[ "x$(findmnt -T /mount-9p | grep /mount-9p)" != "x" ] && sudo umount -f /mount-9p || echo "
I0626 19:03:40.118509  283641 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-453313
I0626 19:03:40.118678  283641 out.go:177] * Userspace file server is shutdown
I0626 19:03:40.146461  283641 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/functional-453313/id_rsa Username:docker}
I0626 19:03:40.250423  283641 mount.go:180] unmount for /mount-9p ran successfully
I0626 19:03:40.250452  283641 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /mount-9p"
I0626 19:03:40.262793  283641 ssh_runner.go:195] Run: /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p"
I0626 19:03:40.283394  283641 out.go:177] 
W0626 19:03:40.285348  283641 out.go:239] X Exiting due to GUEST_MOUNT: mount failed: mount with cmd /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p" : /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p": Process exited with status 32
stdout:

                                                
                                                
stderr:
mount: /mount-9p: mount(2) system call failed: Connection refused.

                                                
                                                
X Exiting due to GUEST_MOUNT: mount failed: mount with cmd /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p" : /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p": Process exited with status 32
stdout:

                                                
                                                
stderr:
mount: /mount-9p: mount(2) system call failed: Connection refused.

                                                
                                                
W0626 19:03:40.285366  283641 out.go:239] * 
* 
W0626 19:03:40.289440  283641 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│    * Please also attach the following file to the GitHub issue:                             │
│    * - /tmp/minikube_mount_381298437e1921311dfb91c2d218beb2182e1ff9_0.log                   │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│    * Please also attach the following file to the GitHub issue:                             │
│    * - /tmp/minikube_mount_381298437e1921311dfb91c2d218beb2182e1ff9_0.log                   │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0626 19:03:40.291025  283641 out.go:177] 
--- FAIL: TestFunctional/parallel/MountCmd/specific-port (13.81s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (54.38s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-359139 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:183: (dbg) Done: kubectl --context ingress-addon-legacy-359139 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (8.975195658s)
addons_test.go:208: (dbg) Run:  kubectl --context ingress-addon-legacy-359139 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context ingress-addon-legacy-359139 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [5c48cbc1-24ff-48ac-99be-69e73520f05e] Pending
helpers_test.go:344: "nginx" [5c48cbc1-24ff-48ac-99be-69e73520f05e] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [5c48cbc1-24ff-48ac-99be-69e73520f05e] Running
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 10.0175167s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-359139 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context ingress-addon-legacy-359139 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-359139 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.021109869s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-359139 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-359139 addons disable ingress-dns --alsologtostderr -v=1: (9.605290512s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-359139 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-359139 addons disable ingress --alsologtostderr -v=1: (7.376956831s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-359139
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-359139:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "61fb87aced5ce923b308a31208e947bc5fe700028dc8cf55a06ca6cef900a098",
	        "Created": "2023-06-26T19:04:57.910584772Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 291373,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-06-26T19:04:58.238196825Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:2c464eebc1b5db387e6fe116f67b8b9ca6006abbd75d6a2cb15f70a6643ad6d2",
	        "ResolvConfPath": "/var/lib/docker/containers/61fb87aced5ce923b308a31208e947bc5fe700028dc8cf55a06ca6cef900a098/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/61fb87aced5ce923b308a31208e947bc5fe700028dc8cf55a06ca6cef900a098/hostname",
	        "HostsPath": "/var/lib/docker/containers/61fb87aced5ce923b308a31208e947bc5fe700028dc8cf55a06ca6cef900a098/hosts",
	        "LogPath": "/var/lib/docker/containers/61fb87aced5ce923b308a31208e947bc5fe700028dc8cf55a06ca6cef900a098/61fb87aced5ce923b308a31208e947bc5fe700028dc8cf55a06ca6cef900a098-json.log",
	        "Name": "/ingress-addon-legacy-359139",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ingress-addon-legacy-359139:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "ingress-addon-legacy-359139",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/fc19c4d8284906eab8f427863bcd21c02afd36818abf4c7ed70bc2e04e929eb0-init/diff:/var/lib/docker/overlay2/c2f9a8b71b8f9533db4f212b0c66f022ed4e6bbaf97d5981202d537184ed81b1/diff",
	                "MergedDir": "/var/lib/docker/overlay2/fc19c4d8284906eab8f427863bcd21c02afd36818abf4c7ed70bc2e04e929eb0/merged",
	                "UpperDir": "/var/lib/docker/overlay2/fc19c4d8284906eab8f427863bcd21c02afd36818abf4c7ed70bc2e04e929eb0/diff",
	                "WorkDir": "/var/lib/docker/overlay2/fc19c4d8284906eab8f427863bcd21c02afd36818abf4c7ed70bc2e04e929eb0/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-359139",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-359139/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-359139",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-359139",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-359139",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "b47bfe2c07bccfe61122fe04c79a48c3fb4010c059012d86daf5b92505fd4452",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33093"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33092"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33089"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33091"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33090"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/b47bfe2c07bc",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-359139": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "61fb87aced5c",
	                        "ingress-addon-legacy-359139"
	                    ],
	                    "NetworkID": "1bf35ae597e1053081b845d4dfbdd6f51cdc3026149c90d3e6068422169324cd",
	                    "EndpointID": "4389edd41a5123fa2a57c9962a61b4f68858ec27c33300e1152813b5529d292b",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p ingress-addon-legacy-359139 -n ingress-addon-legacy-359139
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-359139 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-359139 logs -n 25: (1.041025835s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| Command |                                  Args                                  |           Profile           |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| mount   | -p functional-453313                                                   | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC |                     |
	|         | /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount1 |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| ssh     | functional-453313 ssh findmnt                                          | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC |                     |
	|         | -T /mount1                                                             |                             |         |         |                     |                     |
	| mount   | -p functional-453313                                                   | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC |                     |
	|         | /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount3 |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| mount   | -p functional-453313                                                   | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC |                     |
	|         | /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount2 |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| ssh     | functional-453313 ssh findmnt                                          | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC | 26 Jun 23 19:03 UTC |
	|         | -T /mount1                                                             |                             |         |         |                     |                     |
	| ssh     | functional-453313 ssh findmnt                                          | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC | 26 Jun 23 19:03 UTC |
	|         | -T /mount2                                                             |                             |         |         |                     |                     |
	| image   | functional-453313 image ls                                             | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC | 26 Jun 23 19:03 UTC |
	| ssh     | functional-453313 ssh findmnt                                          | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC | 26 Jun 23 19:03 UTC |
	|         | -T /mount3                                                             |                             |         |         |                     |                     |
	| image   | functional-453313                                                      | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC | 26 Jun 23 19:03 UTC |
	|         | image ls --format json                                                 |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| mount   | -p functional-453313                                                   | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC |                     |
	|         | --kill=true                                                            |                             |         |         |                     |                     |
	| image   | functional-453313                                                      | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC | 26 Jun 23 19:03 UTC |
	|         | image ls --format table                                                |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| delete  | -p functional-453313                                                   | functional-453313           | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC | 26 Jun 23 19:03 UTC |
	| start   | -p image-789959                                                        | image-789959                | jenkins | v1.30.1 | 26 Jun 23 19:03 UTC | 26 Jun 23 19:04 UTC |
	|         | --driver=docker                                                        |                             |         |         |                     |                     |
	|         | --container-runtime=docker                                             |                             |         |         |                     |                     |
	| image   | build -t aaa:latest                                                    | image-789959                | jenkins | v1.30.1 | 26 Jun 23 19:04 UTC | 26 Jun 23 19:04 UTC |
	|         | ./testdata/image-build/test-normal                                     |                             |         |         |                     |                     |
	|         | -p image-789959                                                        |                             |         |         |                     |                     |
	| image   | build -t aaa:latest                                                    | image-789959                | jenkins | v1.30.1 | 26 Jun 23 19:04 UTC | 26 Jun 23 19:04 UTC |
	|         | --build-opt=build-arg=ENV_A=test_env_str                               |                             |         |         |                     |                     |
	|         | --build-opt=no-cache                                                   |                             |         |         |                     |                     |
	|         | ./testdata/image-build/test-arg -p                                     |                             |         |         |                     |                     |
	|         | image-789959                                                           |                             |         |         |                     |                     |
	| image   | build -t aaa:latest                                                    | image-789959                | jenkins | v1.30.1 | 26 Jun 23 19:04 UTC | 26 Jun 23 19:04 UTC |
	|         | ./testdata/image-build/test-normal                                     |                             |         |         |                     |                     |
	|         | --build-opt=no-cache -p                                                |                             |         |         |                     |                     |
	|         | image-789959                                                           |                             |         |         |                     |                     |
	| image   | build -t aaa:latest                                                    | image-789959                | jenkins | v1.30.1 | 26 Jun 23 19:04 UTC | 26 Jun 23 19:04 UTC |
	|         | -f inner/Dockerfile                                                    |                             |         |         |                     |                     |
	|         | ./testdata/image-build/test-f                                          |                             |         |         |                     |                     |
	|         | -p image-789959                                                        |                             |         |         |                     |                     |
	| delete  | -p image-789959                                                        | image-789959                | jenkins | v1.30.1 | 26 Jun 23 19:04 UTC | 26 Jun 23 19:04 UTC |
	| start   | -p ingress-addon-legacy-359139                                         | ingress-addon-legacy-359139 | jenkins | v1.30.1 | 26 Jun 23 19:04 UTC | 26 Jun 23 19:06 UTC |
	|         | --kubernetes-version=v1.18.20                                          |                             |         |         |                     |                     |
	|         | --memory=4096 --wait=true                                              |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                      |                             |         |         |                     |                     |
	|         | -v=5 --driver=docker                                                   |                             |         |         |                     |                     |
	|         | --container-runtime=docker                                             |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-359139                                            | ingress-addon-legacy-359139 | jenkins | v1.30.1 | 26 Jun 23 19:06 UTC | 26 Jun 23 19:06 UTC |
	|         | addons enable ingress                                                  |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=5                                                 |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-359139                                            | ingress-addon-legacy-359139 | jenkins | v1.30.1 | 26 Jun 23 19:06 UTC | 26 Jun 23 19:06 UTC |
	|         | addons enable ingress-dns                                              |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=5                                                 |                             |         |         |                     |                     |
	| ssh     | ingress-addon-legacy-359139                                            | ingress-addon-legacy-359139 | jenkins | v1.30.1 | 26 Jun 23 19:06 UTC | 26 Jun 23 19:06 UTC |
	|         | ssh curl -s http://127.0.0.1/                                          |                             |         |         |                     |                     |
	|         | -H 'Host: nginx.example.com'                                           |                             |         |         |                     |                     |
	| ip      | ingress-addon-legacy-359139 ip                                         | ingress-addon-legacy-359139 | jenkins | v1.30.1 | 26 Jun 23 19:06 UTC | 26 Jun 23 19:06 UTC |
	| addons  | ingress-addon-legacy-359139                                            | ingress-addon-legacy-359139 | jenkins | v1.30.1 | 26 Jun 23 19:06 UTC | 26 Jun 23 19:06 UTC |
	|         | addons disable ingress-dns                                             |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-359139                                            | ingress-addon-legacy-359139 | jenkins | v1.30.1 | 26 Jun 23 19:06 UTC | 26 Jun 23 19:07 UTC |
	|         | addons disable ingress                                                 |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	|---------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/06/26 19:04:41
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0626 19:04:41.994558  290915 out.go:296] Setting OutFile to fd 1 ...
	I0626 19:04:41.994728  290915 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:04:41.994742  290915 out.go:309] Setting ErrFile to fd 2...
	I0626 19:04:41.994749  290915 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:04:41.995932  290915 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
	I0626 19:04:41.996407  290915 out.go:303] Setting JSON to false
	I0626 19:04:41.997433  290915 start.go:127] hostinfo: {"hostname":"ip-172-31-21-244","uptime":6430,"bootTime":1687799852,"procs":340,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1038-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0626 19:04:41.997508  290915 start.go:137] virtualization:  
	I0626 19:04:42.001528  290915 out.go:177] * [ingress-addon-legacy-359139] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0626 19:04:42.003172  290915 out.go:177]   - MINIKUBE_LOCATION=16761
	I0626 19:04:42.003313  290915 notify.go:220] Checking for updates...
	I0626 19:04:42.005763  290915 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0626 19:04:42.015351  290915 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	I0626 19:04:42.017581  290915 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	I0626 19:04:42.019417  290915 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0626 19:04:42.021138  290915 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0626 19:04:42.023032  290915 driver.go:373] Setting default libvirt URI to qemu:///system
	I0626 19:04:42.051856  290915 docker.go:121] docker version: linux-24.0.2:Docker Engine - Community
	I0626 19:04:42.051974  290915 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 19:04:42.135640  290915 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:27 OomKillDisable:true NGoroutines:35 SystemTime:2023-06-26 19:04:42.125016931 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 19:04:42.135749  290915 docker.go:294] overlay module found
	I0626 19:04:42.137664  290915 out.go:177] * Using the docker driver based on user configuration
	I0626 19:04:42.139220  290915 start.go:297] selected driver: docker
	I0626 19:04:42.139239  290915 start.go:954] validating driver "docker" against <nil>
	I0626 19:04:42.139260  290915 start.go:965] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0626 19:04:42.139897  290915 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 19:04:42.203812  290915 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:27 OomKillDisable:true NGoroutines:35 SystemTime:2023-06-26 19:04:42.193500735 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 19:04:42.203981  290915 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0626 19:04:42.204223  290915 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0626 19:04:42.206243  290915 out.go:177] * Using Docker driver with root privileges
	I0626 19:04:42.208086  290915 cni.go:84] Creating CNI manager for ""
	I0626 19:04:42.208115  290915 cni.go:168] CNI unnecessary in this configuration, recommending no CNI
	I0626 19:04:42.208130  290915 start_flags.go:319] config:
	{Name:ingress-addon-legacy-359139 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-359139 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.lo
cal ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 19:04:42.210208  290915 out.go:177] * Starting control plane node ingress-addon-legacy-359139 in cluster ingress-addon-legacy-359139
	I0626 19:04:42.212170  290915 cache.go:122] Beginning downloading kic base image for docker with docker
	I0626 19:04:42.214113  290915 out.go:177] * Pulling base image ...
	I0626 19:04:42.216143  290915 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0626 19:04:42.216242  290915 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local docker daemon
	I0626 19:04:42.245604  290915 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local docker daemon, skipping pull
	I0626 19:04:42.245627  290915 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 exists in daemon, skipping load
	I0626 19:04:42.284704  290915 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I0626 19:04:42.284729  290915 cache.go:57] Caching tarball of preloaded images
	I0626 19:04:42.284932  290915 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0626 19:04:42.287146  290915 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I0626 19:04:42.289056  290915 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0626 19:04:42.410178  290915 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4?checksum=md5:c8c260b886393123ce9d312d8ac2379e -> /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I0626 19:04:50.658027  290915 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0626 19:04:50.658134  290915 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0626 19:04:51.713324  290915 cache.go:60] Finished verifying existence of preloaded tar for  v1.18.20 on docker
	I0626 19:04:51.713690  290915 profile.go:148] Saving config to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/config.json ...
	I0626 19:04:51.713723  290915 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/config.json: {Name:mk30c7a3ac55ffb1cc7d2ec17353a1619cc77e26 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:04:51.713902  290915 cache.go:195] Successfully downloaded all kic artifacts
	I0626 19:04:51.713925  290915 start.go:365] acquiring machines lock for ingress-addon-legacy-359139: {Name:mk059cb741004d45796c05a35fbfaa580be0672d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0626 19:04:51.713981  290915 start.go:369] acquired machines lock for "ingress-addon-legacy-359139" in 43.257µs
	I0626 19:04:51.714005  290915 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-359139 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-359139 Namespace:defau
lt APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0626 19:04:51.714071  290915 start.go:125] createHost starting for "" (driver="docker")
	I0626 19:04:51.716107  290915 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I0626 19:04:51.716377  290915 start.go:159] libmachine.API.Create for "ingress-addon-legacy-359139" (driver="docker")
	I0626 19:04:51.716418  290915 client.go:168] LocalClient.Create starting
	I0626 19:04:51.716497  290915 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem
	I0626 19:04:51.716531  290915 main.go:141] libmachine: Decoding PEM data...
	I0626 19:04:51.716549  290915 main.go:141] libmachine: Parsing certificate...
	I0626 19:04:51.716623  290915 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem
	I0626 19:04:51.716644  290915 main.go:141] libmachine: Decoding PEM data...
	I0626 19:04:51.716658  290915 main.go:141] libmachine: Parsing certificate...
	I0626 19:04:51.717030  290915 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-359139 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0626 19:04:51.733395  290915 cli_runner.go:211] docker network inspect ingress-addon-legacy-359139 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0626 19:04:51.733471  290915 network_create.go:281] running [docker network inspect ingress-addon-legacy-359139] to gather additional debugging logs...
	I0626 19:04:51.733488  290915 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-359139
	W0626 19:04:51.750251  290915 cli_runner.go:211] docker network inspect ingress-addon-legacy-359139 returned with exit code 1
	I0626 19:04:51.750278  290915 network_create.go:284] error running [docker network inspect ingress-addon-legacy-359139]: docker network inspect ingress-addon-legacy-359139: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-359139 not found
	I0626 19:04:51.750292  290915 network_create.go:286] output of [docker network inspect ingress-addon-legacy-359139]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-359139 not found
	
	** /stderr **
	I0626 19:04:51.750351  290915 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0626 19:04:51.767230  290915 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000e20f60}
	I0626 19:04:51.767265  290915 network_create.go:123] attempt to create docker network ingress-addon-legacy-359139 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0626 19:04:51.767324  290915 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-359139 ingress-addon-legacy-359139
	I0626 19:04:51.839564  290915 network_create.go:107] docker network ingress-addon-legacy-359139 192.168.49.0/24 created
	I0626 19:04:51.839590  290915 kic.go:117] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-359139" container
	I0626 19:04:51.839673  290915 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0626 19:04:51.861497  290915 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-359139 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-359139 --label created_by.minikube.sigs.k8s.io=true
	I0626 19:04:51.881560  290915 oci.go:103] Successfully created a docker volume ingress-addon-legacy-359139
	I0626 19:04:51.881651  290915 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-359139-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-359139 --entrypoint /usr/bin/test -v ingress-addon-legacy-359139:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 -d /var/lib
	I0626 19:04:53.234969  290915 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-359139-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-359139 --entrypoint /usr/bin/test -v ingress-addon-legacy-359139:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 -d /var/lib: (1.353272479s)
	I0626 19:04:53.235001  290915 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-359139
	I0626 19:04:53.235016  290915 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0626 19:04:53.235035  290915 kic.go:190] Starting extracting preloaded images to volume ...
	I0626 19:04:53.235120  290915 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-359139:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 -I lz4 -xf /preloaded.tar -C /extractDir
	I0626 19:04:57.820814  290915 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-359139:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 -I lz4 -xf /preloaded.tar -C /extractDir: (4.585639534s)
	I0626 19:04:57.820844  290915 kic.go:199] duration metric: took 4.585806 seconds to extract preloaded images to volume
	W0626 19:04:57.821010  290915 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0626 19:04:57.821118  290915 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0626 19:04:57.894823  290915 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-359139 --name ingress-addon-legacy-359139 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-359139 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-359139 --network ingress-addon-legacy-359139 --ip 192.168.49.2 --volume ingress-addon-legacy-359139:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953
	I0626 19:04:58.247357  290915 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-359139 --format={{.State.Running}}
	I0626 19:04:58.282040  290915 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-359139 --format={{.State.Status}}
	I0626 19:04:58.307825  290915 cli_runner.go:164] Run: docker exec ingress-addon-legacy-359139 stat /var/lib/dpkg/alternatives/iptables
	I0626 19:04:58.387235  290915 oci.go:144] the created container "ingress-addon-legacy-359139" has a running status.
	I0626 19:04:58.387268  290915 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa...
	I0626 19:04:58.515618  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0626 19:04:58.515668  290915 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0626 19:04:58.543450  290915 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-359139 --format={{.State.Status}}
	I0626 19:04:58.565511  290915 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0626 19:04:58.565535  290915 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-359139 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0626 19:04:58.644957  290915 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-359139 --format={{.State.Status}}
	I0626 19:04:58.672428  290915 machine.go:88] provisioning docker machine ...
	I0626 19:04:58.672460  290915 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-359139"
	I0626 19:04:58.672528  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:04:58.696501  290915 main.go:141] libmachine: Using SSH client type: native
	I0626 19:04:58.696951  290915 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33093 <nil> <nil>}
	I0626 19:04:58.696964  290915 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-359139 && echo "ingress-addon-legacy-359139" | sudo tee /etc/hostname
	I0626 19:04:58.697809  290915 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0626 19:05:01.852731  290915 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-359139
	
	I0626 19:05:01.852813  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:01.871509  290915 main.go:141] libmachine: Using SSH client type: native
	I0626 19:05:01.871968  290915 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33093 <nil> <nil>}
	I0626 19:05:01.871992  290915 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-359139' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-359139/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-359139' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0626 19:05:02.011279  290915 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0626 19:05:02.011310  290915 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16761-239099/.minikube CaCertPath:/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16761-239099/.minikube}
	I0626 19:05:02.011331  290915 ubuntu.go:177] setting up certificates
	I0626 19:05:02.011342  290915 provision.go:83] configureAuth start
	I0626 19:05:02.011418  290915 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-359139
	I0626 19:05:02.035188  290915 provision.go:138] copyHostCerts
	I0626 19:05:02.035236  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/16761-239099/.minikube/ca.pem
	I0626 19:05:02.035268  290915 exec_runner.go:144] found /home/jenkins/minikube-integration/16761-239099/.minikube/ca.pem, removing ...
	I0626 19:05:02.035278  290915 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16761-239099/.minikube/ca.pem
	I0626 19:05:02.035354  290915 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16761-239099/.minikube/ca.pem (1078 bytes)
	I0626 19:05:02.035435  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/16761-239099/.minikube/cert.pem
	I0626 19:05:02.035458  290915 exec_runner.go:144] found /home/jenkins/minikube-integration/16761-239099/.minikube/cert.pem, removing ...
	I0626 19:05:02.035466  290915 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16761-239099/.minikube/cert.pem
	I0626 19:05:02.035493  290915 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16761-239099/.minikube/cert.pem (1123 bytes)
	I0626 19:05:02.035537  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/16761-239099/.minikube/key.pem
	I0626 19:05:02.035556  290915 exec_runner.go:144] found /home/jenkins/minikube-integration/16761-239099/.minikube/key.pem, removing ...
	I0626 19:05:02.035564  290915 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16761-239099/.minikube/key.pem
	I0626 19:05:02.035592  290915 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16761-239099/.minikube/key.pem (1675 bytes)
	I0626 19:05:02.035704  290915 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16761-239099/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-359139 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-359139]
	I0626 19:05:02.366911  290915 provision.go:172] copyRemoteCerts
	I0626 19:05:02.366980  290915 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0626 19:05:02.367023  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:02.384984  290915 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa Username:docker}
	I0626 19:05:02.483956  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0626 19:05:02.484042  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0626 19:05:02.512212  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0626 19:05:02.512276  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)
	I0626 19:05:02.540046  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0626 19:05:02.540106  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0626 19:05:02.568167  290915 provision.go:86] duration metric: configureAuth took 556.811979ms
	I0626 19:05:02.568192  290915 ubuntu.go:193] setting minikube options for container-runtime
	I0626 19:05:02.568390  290915 config.go:182] Loaded profile config "ingress-addon-legacy-359139": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I0626 19:05:02.568443  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:02.586201  290915 main.go:141] libmachine: Using SSH client type: native
	I0626 19:05:02.586639  290915 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33093 <nil> <nil>}
	I0626 19:05:02.586655  290915 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0626 19:05:02.722533  290915 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0626 19:05:02.722556  290915 ubuntu.go:71] root file system type: overlay
	I0626 19:05:02.722669  290915 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0626 19:05:02.722739  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:02.743125  290915 main.go:141] libmachine: Using SSH client type: native
	I0626 19:05:02.743542  290915 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33093 <nil> <nil>}
	I0626 19:05:02.743620  290915 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0626 19:05:02.900426  290915 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0626 19:05:02.900507  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:02.919687  290915 main.go:141] libmachine: Using SSH client type: native
	I0626 19:05:02.920126  290915 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f2c0] 0x3a1c50 <nil>  [] 0s} 127.0.0.1 33093 <nil> <nil>}
	I0626 19:05:02.920145  290915 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0626 19:05:03.727937  290915 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-05-25 21:52:53.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-06-26 19:05:02.893627911 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0626 19:05:03.727973  290915 machine.go:91] provisioned docker machine in 5.05552731s
	I0626 19:05:03.727983  290915 client.go:171] LocalClient.Create took 12.011556816s
	I0626 19:05:03.728030  290915 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-359139" took 12.011651345s
	I0626 19:05:03.728041  290915 start.go:300] post-start starting for "ingress-addon-legacy-359139" (driver="docker")
	I0626 19:05:03.728050  290915 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0626 19:05:03.728133  290915 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0626 19:05:03.728193  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:03.746851  290915 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa Username:docker}
	I0626 19:05:03.844026  290915 ssh_runner.go:195] Run: cat /etc/os-release
	I0626 19:05:03.848045  290915 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0626 19:05:03.848080  290915 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0626 19:05:03.848091  290915 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0626 19:05:03.848098  290915 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0626 19:05:03.848110  290915 filesync.go:126] Scanning /home/jenkins/minikube-integration/16761-239099/.minikube/addons for local assets ...
	I0626 19:05:03.848175  290915 filesync.go:126] Scanning /home/jenkins/minikube-integration/16761-239099/.minikube/files for local assets ...
	I0626 19:05:03.848255  290915 filesync.go:149] local asset: /home/jenkins/minikube-integration/16761-239099/.minikube/files/etc/ssl/certs/2444862.pem -> 2444862.pem in /etc/ssl/certs
	I0626 19:05:03.848266  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/files/etc/ssl/certs/2444862.pem -> /etc/ssl/certs/2444862.pem
	I0626 19:05:03.848362  290915 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0626 19:05:03.858561  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/files/etc/ssl/certs/2444862.pem --> /etc/ssl/certs/2444862.pem (1708 bytes)
	I0626 19:05:03.888215  290915 start.go:303] post-start completed in 160.157951ms
	I0626 19:05:03.888585  290915 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-359139
	I0626 19:05:03.906498  290915 profile.go:148] Saving config to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/config.json ...
	I0626 19:05:03.906793  290915 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0626 19:05:03.906844  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:03.928080  290915 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa Username:docker}
	I0626 19:05:04.023114  290915 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0626 19:05:04.029037  290915 start.go:128] duration metric: createHost completed in 12.314950915s
	I0626 19:05:04.029060  290915 start.go:83] releasing machines lock for "ingress-addon-legacy-359139", held for 12.315066539s
	I0626 19:05:04.029132  290915 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-359139
	I0626 19:05:04.048638  290915 ssh_runner.go:195] Run: cat /version.json
	I0626 19:05:04.048695  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:04.048952  290915 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0626 19:05:04.049037  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:04.070020  290915 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa Username:docker}
	I0626 19:05:04.070201  290915 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa Username:docker}
	I0626 19:05:04.306648  290915 ssh_runner.go:195] Run: systemctl --version
	I0626 19:05:04.312183  290915 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0626 19:05:04.317720  290915 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0626 19:05:04.348300  290915 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0626 19:05:04.348389  290915 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0626 19:05:04.368284  290915 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0626 19:05:04.388533  290915 cni.go:314] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0626 19:05:04.388611  290915 start.go:466] detecting cgroup driver to use...
	I0626 19:05:04.388671  290915 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0626 19:05:04.388848  290915 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0626 19:05:04.408720  290915 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0626 19:05:04.421633  290915 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0626 19:05:04.434505  290915 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0626 19:05:04.434576  290915 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0626 19:05:04.446499  290915 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0626 19:05:04.458707  290915 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0626 19:05:04.470296  290915 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0626 19:05:04.482245  290915 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0626 19:05:04.493783  290915 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0626 19:05:04.505783  290915 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0626 19:05:04.516746  290915 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0626 19:05:04.527408  290915 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0626 19:05:04.616544  290915 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0626 19:05:04.727379  290915 start.go:466] detecting cgroup driver to use...
	I0626 19:05:04.727463  290915 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0626 19:05:04.727551  290915 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0626 19:05:04.747007  290915 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0626 19:05:04.747116  290915 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0626 19:05:04.762268  290915 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock
	" | sudo tee /etc/crictl.yaml"
	I0626 19:05:04.785112  290915 ssh_runner.go:195] Run: which cri-dockerd
	I0626 19:05:04.794725  290915 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0626 19:05:04.809921  290915 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0626 19:05:04.840821  290915 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0626 19:05:04.943863  290915 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0626 19:05:05.062001  290915 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0626 19:05:05.062044  290915 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0626 19:05:05.089737  290915 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0626 19:05:05.199395  290915 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0626 19:05:05.474416  290915 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0626 19:05:05.502603  290915 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0626 19:05:05.532682  290915 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 24.0.2 ...
	I0626 19:05:05.532781  290915 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-359139 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0626 19:05:05.551842  290915 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0626 19:05:05.556399  290915 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0626 19:05:05.572709  290915 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0626 19:05:05.572793  290915 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0626 19:05:05.596354  290915 docker.go:636] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I0626 19:05:05.596377  290915 docker.go:642] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I0626 19:05:05.596431  290915 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0626 19:05:05.607628  290915 ssh_runner.go:195] Run: which lz4
	I0626 19:05:05.611990  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4
	I0626 19:05:05.612085  290915 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0626 19:05:05.616753  290915 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0626 19:05:05.616787  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (459739018 bytes)
	I0626 19:05:07.591168  290915 docker.go:600] Took 1.979115 seconds to copy over tarball
	I0626 19:05:07.591302  290915 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0626 19:05:10.028672  290915 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.437323912s)
	I0626 19:05:10.028704  290915 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0626 19:05:10.282271  290915 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0626 19:05:10.293807  290915 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)
	I0626 19:05:10.314745  290915 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0626 19:05:10.406324  290915 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0626 19:05:12.677701  290915 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.271344243s)
	I0626 19:05:12.677801  290915 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0626 19:05:12.700112  290915 docker.go:636] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I0626 19:05:12.700135  290915 docker.go:642] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I0626 19:05:12.700142  290915 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0626 19:05:12.701930  290915 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I0626 19:05:12.702115  290915 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I0626 19:05:12.702268  290915 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I0626 19:05:12.702345  290915 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I0626 19:05:12.702494  290915 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I0626 19:05:12.702561  290915 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0626 19:05:12.702615  290915 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I0626 19:05:12.702800  290915 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0626 19:05:12.702894  290915 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I0626 19:05:12.703559  290915 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I0626 19:05:12.704129  290915 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0626 19:05:12.704372  290915 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	I0626 19:05:12.704605  290915 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	I0626 19:05:12.704825  290915 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	I0626 19:05:12.705046  290915 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I0626 19:05:12.705196  290915 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	W0626 19:05:13.163712  290915 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing
	I0626 19:05:13.163938  290915 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7
	I0626 19:05:13.165557  290915 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2
	W0626 19:05:13.181382  290915 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0626 19:05:13.181613  290915 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20
	W0626 19:05:13.184284  290915 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0626 19:05:13.184577  290915 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20
	I0626 19:05:13.188923  290915 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime
	I0626 19:05:13.188987  290915 docker.go:316] Removing image: registry.k8s.io/coredns:1.6.7
	I0626 19:05:13.189078  290915 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7
	W0626 19:05:13.193639  290915 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0626 19:05:13.193854  290915 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20
	W0626 19:05:13.195436  290915 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing
	I0626 19:05:13.195705  290915 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0
	I0626 19:05:13.200113  290915 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime
	I0626 19:05:13.200207  290915 docker.go:316] Removing image: registry.k8s.io/pause:3.2
	I0626 19:05:13.200297  290915 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2
	W0626 19:05:13.241682  290915 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0626 19:05:13.241900  290915 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20
	I0626 19:05:13.274265  290915 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime
	I0626 19:05:13.274336  290915 docker.go:316] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I0626 19:05:13.274410  290915 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20
	I0626 19:05:13.275625  290915 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime
	I0626 19:05:13.275737  290915 docker.go:316] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I0626 19:05:13.275791  290915 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20
	I0626 19:05:13.287959  290915 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7
	I0626 19:05:13.288070  290915 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime
	I0626 19:05:13.288116  290915 docker.go:316] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0626 19:05:13.288173  290915 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I0626 19:05:13.288274  290915 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime
	I0626 19:05:13.288306  290915 docker.go:316] Removing image: registry.k8s.io/etcd:3.4.3-0
	I0626 19:05:13.288335  290915 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0
	I0626 19:05:13.288423  290915 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2
	W0626 19:05:13.326124  290915 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0626 19:05:13.326302  290915 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0626 19:05:13.332307  290915 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime
	I0626 19:05:13.332352  290915 docker.go:316] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I0626 19:05:13.332412  290915 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20
	I0626 19:05:13.340070  290915 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20
	I0626 19:05:13.340423  290915 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20
	I0626 19:05:13.366758  290915 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20
	I0626 19:05:13.366991  290915 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0
	I0626 19:05:13.370496  290915 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0626 19:05:13.370556  290915 docker.go:316] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0626 19:05:13.370633  290915 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0626 19:05:13.385461  290915 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20
	I0626 19:05:13.404420  290915 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0626 19:05:13.404507  290915 cache_images.go:92] LoadImages completed in 704.353469ms
	W0626 19:05:13.404591  290915 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/16761-239099/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7: no such file or directory
	I0626 19:05:13.404660  290915 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0626 19:05:13.459635  290915 cni.go:84] Creating CNI manager for ""
	I0626 19:05:13.459661  290915 cni.go:168] CNI unnecessary in this configuration, recommending no CNI
	I0626 19:05:13.459669  290915 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0626 19:05:13.459687  290915 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-359139 NodeName:ingress-addon-legacy-359139 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.
crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0626 19:05:13.459837  290915 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /var/run/dockershim.sock
	  name: "ingress-addon-legacy-359139"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0626 19:05:13.459913  290915 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-359139 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-359139 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0626 19:05:13.459985  290915 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I0626 19:05:13.470720  290915 binaries.go:44] Found k8s binaries, skipping transfer
	I0626 19:05:13.470815  290915 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0626 19:05:13.481372  290915 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (354 bytes)
	I0626 19:05:13.502717  290915 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I0626 19:05:13.523470  290915 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2124 bytes)
	I0626 19:05:13.544843  290915 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0626 19:05:13.549480  290915 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0626 19:05:13.563435  290915 certs.go:56] Setting up /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139 for IP: 192.168.49.2
	I0626 19:05:13.563470  290915 certs.go:190] acquiring lock for shared ca certs: {Name:mk3ca16c3f42222cf5b6a061c3376849045f46b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:13.563605  290915 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/16761-239099/.minikube/ca.key
	I0626 19:05:13.563667  290915 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.key
	I0626 19:05:13.563729  290915 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.key
	I0626 19:05:13.563747  290915 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt with IP's: []
	I0626 19:05:13.901786  290915 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt ...
	I0626 19:05:13.901816  290915 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: {Name:mka74586b9a65fc88ab2b5d0ee130c57b54e10a4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:13.902032  290915 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.key ...
	I0626 19:05:13.902045  290915 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.key: {Name:mkdc131d41b6a7e30d6f58ee186a8846e64f1a00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:13.902129  290915 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.key.dd3b5fb2
	I0626 19:05:13.902145  290915 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0626 19:05:14.017762  290915 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.crt.dd3b5fb2 ...
	I0626 19:05:14.017791  290915 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.crt.dd3b5fb2: {Name:mkfc9498e98a4e25773e7cb48235734671a6d081 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:14.017976  290915 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.key.dd3b5fb2 ...
	I0626 19:05:14.017989  290915 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.key.dd3b5fb2: {Name:mkaeae0f527932fe74843757e69e2676a06bb958 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:14.018081  290915 certs.go:337] copying /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.crt
	I0626 19:05:14.018152  290915 certs.go:341] copying /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.key
	I0626 19:05:14.018214  290915 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.key
	I0626 19:05:14.018235  290915 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.crt with IP's: []
	I0626 19:05:14.268497  290915 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.crt ...
	I0626 19:05:14.268524  290915 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.crt: {Name:mk0a98622bf238eee993b686a47e5c593f646d31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:14.268702  290915 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.key ...
	I0626 19:05:14.268713  290915 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.key: {Name:mk3fe239ee104258132cbfc9d954da71eab43adb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:14.268799  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0626 19:05:14.268817  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0626 19:05:14.268830  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0626 19:05:14.268844  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0626 19:05:14.268854  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0626 19:05:14.268870  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0626 19:05:14.268884  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0626 19:05:14.268898  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0626 19:05:14.268954  290915 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/244486.pem (1338 bytes)
	W0626 19:05:14.269014  290915 certs.go:433] ignoring /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/244486_empty.pem, impossibly tiny 0 bytes
	I0626 19:05:14.269024  290915 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca-key.pem (1679 bytes)
	I0626 19:05:14.269056  290915 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/ca.pem (1078 bytes)
	I0626 19:05:14.269090  290915 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/cert.pem (1123 bytes)
	I0626 19:05:14.269117  290915 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/home/jenkins/minikube-integration/16761-239099/.minikube/certs/key.pem (1675 bytes)
	I0626 19:05:14.269176  290915 certs.go:437] found cert: /home/jenkins/minikube-integration/16761-239099/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/16761-239099/.minikube/files/etc/ssl/certs/2444862.pem (1708 bytes)
	I0626 19:05:14.269210  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0626 19:05:14.269225  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/certs/244486.pem -> /usr/share/ca-certificates/244486.pem
	I0626 19:05:14.269236  290915 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16761-239099/.minikube/files/etc/ssl/certs/2444862.pem -> /usr/share/ca-certificates/2444862.pem
	I0626 19:05:14.269953  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0626 19:05:14.299189  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0626 19:05:14.328452  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0626 19:05:14.357438  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0626 19:05:14.386684  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0626 19:05:14.415378  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0626 19:05:14.445197  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0626 19:05:14.473253  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0626 19:05:14.501636  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0626 19:05:14.530226  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/certs/244486.pem --> /usr/share/ca-certificates/244486.pem (1338 bytes)
	I0626 19:05:14.560102  290915 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16761-239099/.minikube/files/etc/ssl/certs/2444862.pem --> /usr/share/ca-certificates/2444862.pem (1708 bytes)
	I0626 19:05:14.588817  290915 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0626 19:05:14.610578  290915 ssh_runner.go:195] Run: openssl version
	I0626 19:05:14.617602  290915 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0626 19:05:14.629456  290915 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0626 19:05:14.634143  290915 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jun 26 18:55 /usr/share/ca-certificates/minikubeCA.pem
	I0626 19:05:14.634229  290915 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0626 19:05:14.642891  290915 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0626 19:05:14.654476  290915 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/244486.pem && ln -fs /usr/share/ca-certificates/244486.pem /etc/ssl/certs/244486.pem"
	I0626 19:05:14.666124  290915 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/244486.pem
	I0626 19:05:14.670748  290915 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Jun 26 19:00 /usr/share/ca-certificates/244486.pem
	I0626 19:05:14.670813  290915 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/244486.pem
	I0626 19:05:14.679568  290915 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/244486.pem /etc/ssl/certs/51391683.0"
	I0626 19:05:14.691305  290915 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2444862.pem && ln -fs /usr/share/ca-certificates/2444862.pem /etc/ssl/certs/2444862.pem"
	I0626 19:05:14.702990  290915 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2444862.pem
	I0626 19:05:14.707642  290915 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Jun 26 19:00 /usr/share/ca-certificates/2444862.pem
	I0626 19:05:14.707757  290915 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2444862.pem
	I0626 19:05:14.716211  290915 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2444862.pem /etc/ssl/certs/3ec20f2e.0"
	I0626 19:05:14.728319  290915 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0626 19:05:14.732878  290915 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0626 19:05:14.732930  290915 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-359139 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-359139 Namespace:default APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptim
izations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 19:05:14.733100  290915 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0626 19:05:14.754802  290915 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0626 19:05:14.765751  290915 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0626 19:05:14.776644  290915 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0626 19:05:14.776750  290915 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0626 19:05:14.788154  290915 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0626 19:05:14.788199  290915 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0626 19:05:14.843879  290915 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I0626 19:05:14.844301  290915 kubeadm.go:322] [preflight] Running pre-flight checks
	I0626 19:05:15.052539  290915 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0626 19:05:15.052643  290915 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1038-aws
	I0626 19:05:15.052716  290915 kubeadm.go:322] DOCKER_VERSION: 24.0.2
	I0626 19:05:15.052781  290915 kubeadm.go:322] OS: Linux
	I0626 19:05:15.052847  290915 kubeadm.go:322] CGROUPS_CPU: enabled
	I0626 19:05:15.052922  290915 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0626 19:05:15.052981  290915 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0626 19:05:15.053083  290915 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0626 19:05:15.053179  290915 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0626 19:05:15.053249  290915 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0626 19:05:15.156635  290915 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0626 19:05:15.156790  290915 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0626 19:05:15.156944  290915 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0626 19:05:15.373781  290915 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0626 19:05:15.375538  290915 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0626 19:05:15.375614  290915 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0626 19:05:15.484639  290915 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0626 19:05:15.488870  290915 out.go:204]   - Generating certificates and keys ...
	I0626 19:05:15.489033  290915 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0626 19:05:15.489121  290915 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0626 19:05:15.899128  290915 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0626 19:05:16.299549  290915 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0626 19:05:16.619722  290915 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0626 19:05:16.999967  290915 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0626 19:05:17.416812  290915 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0626 19:05:17.417394  290915 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-359139 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0626 19:05:17.922540  290915 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0626 19:05:17.922941  290915 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-359139 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0626 19:05:18.222523  290915 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0626 19:05:18.697058  290915 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0626 19:05:19.084226  290915 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0626 19:05:19.084559  290915 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0626 19:05:19.371754  290915 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0626 19:05:19.957148  290915 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0626 19:05:20.529054  290915 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0626 19:05:20.830493  290915 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0626 19:05:20.831262  290915 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0626 19:05:20.833869  290915 out.go:204]   - Booting up control plane ...
	I0626 19:05:20.833964  290915 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0626 19:05:20.845736  290915 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0626 19:05:20.845817  290915 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0626 19:05:20.845900  290915 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0626 19:05:20.846062  290915 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0626 19:05:33.347831  290915 kubeadm.go:322] [apiclient] All control plane components are healthy after 12.502642 seconds
	I0626 19:05:33.347955  290915 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0626 19:05:33.364951  290915 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I0626 19:05:33.885034  290915 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0626 19:05:33.885178  290915 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-359139 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I0626 19:05:34.395446  290915 kubeadm.go:322] [bootstrap-token] Using token: 066p58.58ujs7d0iy6joaix
	I0626 19:05:34.397407  290915 out.go:204]   - Configuring RBAC rules ...
	I0626 19:05:34.397540  290915 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0626 19:05:34.402526  290915 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0626 19:05:34.411117  290915 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0626 19:05:34.414170  290915 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0626 19:05:34.416930  290915 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0626 19:05:34.420777  290915 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0626 19:05:34.430867  290915 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0626 19:05:34.786329  290915 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0626 19:05:34.874312  290915 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0626 19:05:34.876103  290915 kubeadm.go:322] 
	I0626 19:05:34.876172  290915 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0626 19:05:34.876178  290915 kubeadm.go:322] 
	I0626 19:05:34.876251  290915 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0626 19:05:34.876255  290915 kubeadm.go:322] 
	I0626 19:05:34.876279  290915 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0626 19:05:34.876335  290915 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0626 19:05:34.876383  290915 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0626 19:05:34.876387  290915 kubeadm.go:322] 
	I0626 19:05:34.876437  290915 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0626 19:05:34.876508  290915 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0626 19:05:34.876573  290915 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0626 19:05:34.876578  290915 kubeadm.go:322] 
	I0626 19:05:34.876674  290915 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0626 19:05:34.876747  290915 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0626 19:05:34.876751  290915 kubeadm.go:322] 
	I0626 19:05:34.877216  290915 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 066p58.58ujs7d0iy6joaix \
	I0626 19:05:34.877324  290915 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:064eebff4304b2a386b2747a9246be1651696da5faad8d5a09dfba9d1f0e6ac8 \
	I0626 19:05:34.877347  290915 kubeadm.go:322]     --control-plane 
	I0626 19:05:34.877352  290915 kubeadm.go:322] 
	I0626 19:05:34.877432  290915 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0626 19:05:34.877437  290915 kubeadm.go:322] 
	I0626 19:05:34.877521  290915 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 066p58.58ujs7d0iy6joaix \
	I0626 19:05:34.877621  290915 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:064eebff4304b2a386b2747a9246be1651696da5faad8d5a09dfba9d1f0e6ac8 
	I0626 19:05:34.880311  290915 kubeadm.go:322] W0626 19:05:14.842596    1655 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I0626 19:05:34.880488  290915 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
	I0626 19:05:34.880611  290915 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.2. Latest validated version: 19.03
	I0626 19:05:34.880811  290915 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1038-aws\n", err: exit status 1
	I0626 19:05:34.880914  290915 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0626 19:05:34.881059  290915 kubeadm.go:322] W0626 19:05:20.840472    1655 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0626 19:05:34.881179  290915 kubeadm.go:322] W0626 19:05:20.841736    1655 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0626 19:05:34.881219  290915 cni.go:84] Creating CNI manager for ""
	I0626 19:05:34.881246  290915 cni.go:168] CNI unnecessary in this configuration, recommending no CNI
	I0626 19:05:34.881265  290915 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0626 19:05:34.881412  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:34.881497  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=759becbe25e432e7a4042c59713ee144df2072e1 minikube.k8s.io/name=ingress-addon-legacy-359139 minikube.k8s.io/updated_at=2023_06_26T19_05_34_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:34.946972  290915 ops.go:34] apiserver oom_adj: -16
	I0626 19:05:35.373115  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:35.977064  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:36.476665  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:36.977028  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:37.476553  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:37.977096  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:38.476502  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:38.976526  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:39.477409  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:39.976598  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:40.476931  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:40.977151  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:41.476874  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:41.977358  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:42.477298  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:42.977337  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:43.476762  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:43.976527  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:44.477294  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:44.977467  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:45.477159  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:45.976527  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:46.477286  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:46.976664  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:47.477261  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:47.976561  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:48.477270  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:48.976479  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:49.476531  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:49.976548  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:50.476474  290915 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0626 19:05:50.583010  290915 kubeadm.go:1081] duration metric: took 15.701652054s to wait for elevateKubeSystemPrivileges.
	I0626 19:05:50.583038  290915 kubeadm.go:406] StartCluster complete in 35.850111637s
	I0626 19:05:50.583054  290915 settings.go:142] acquiring lock: {Name:mk17c896443b7e18d0ba93e5cbf58b5d6036ce0e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:50.583122  290915 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/16761-239099/kubeconfig
	I0626 19:05:50.583930  290915 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/kubeconfig: {Name:mk0284fcec3b30eb2952ace994009133ac5314fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 19:05:50.584673  290915 kapi.go:59] client config for ingress-addon-legacy-359139: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt", KeyFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.key", CAFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e0e60), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0626 19:05:50.585087  290915 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0626 19:05:50.585362  290915 config.go:182] Loaded profile config "ingress-addon-legacy-359139": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I0626 19:05:50.585474  290915 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
	I0626 19:05:50.585545  290915 addons.go:66] Setting storage-provisioner=true in profile "ingress-addon-legacy-359139"
	I0626 19:05:50.585559  290915 addons.go:228] Setting addon storage-provisioner=true in "ingress-addon-legacy-359139"
	I0626 19:05:50.585613  290915 host.go:66] Checking if "ingress-addon-legacy-359139" exists ...
	I0626 19:05:50.586082  290915 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-359139 --format={{.State.Status}}
	I0626 19:05:50.586148  290915 cert_rotation.go:137] Starting client certificate rotation controller
	I0626 19:05:50.586501  290915 addons.go:66] Setting default-storageclass=true in profile "ingress-addon-legacy-359139"
	I0626 19:05:50.586526  290915 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-359139"
	I0626 19:05:50.586814  290915 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-359139 --format={{.State.Status}}
	I0626 19:05:50.635621  290915 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0626 19:05:50.639632  290915 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0626 19:05:50.639655  290915 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0626 19:05:50.639721  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:50.648977  290915 kapi.go:59] client config for ingress-addon-legacy-359139: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt", KeyFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.key", CAFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e0e60), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0626 19:05:50.669952  290915 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa Username:docker}
	I0626 19:05:50.677272  290915 addons.go:228] Setting addon default-storageclass=true in "ingress-addon-legacy-359139"
	I0626 19:05:50.677371  290915 host.go:66] Checking if "ingress-addon-legacy-359139" exists ...
	I0626 19:05:50.677862  290915 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-359139 --format={{.State.Status}}
	W0626 19:05:50.701752  290915 kapi.go:245] failed rescaling "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-359139" context to 1 replicas: non-retryable failure while rescaling coredns deployment: Operation cannot be fulfilled on deployments.apps "coredns": the object has been modified; please apply your changes to the latest version and try again
	E0626 19:05:50.701776  290915 start.go:219] Unable to scale down deployment "coredns" in namespace "kube-system" to 1 replica: non-retryable failure while rescaling coredns deployment: Operation cannot be fulfilled on deployments.apps "coredns": the object has been modified; please apply your changes to the latest version and try again
	I0626 19:05:50.701795  290915 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0626 19:05:50.706124  290915 out.go:177] * Verifying Kubernetes components...
	I0626 19:05:50.707985  290915 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0626 19:05:50.706452  290915 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml
	I0626 19:05:50.708088  290915 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0626 19:05:50.708132  290915 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-359139
	I0626 19:05:50.750830  290915 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/ingress-addon-legacy-359139/id_rsa Username:docker}
	I0626 19:05:50.912256  290915 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0626 19:05:50.912887  290915 kapi.go:59] client config for ingress-addon-legacy-359139: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt", KeyFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.key", CAFile:"/home/jenkins/minikube-integration/16761-239099/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e0e60), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0626 19:05:50.913179  290915 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-359139" to be "Ready" ...
	I0626 19:05:50.917214  290915 node_ready.go:49] node "ingress-addon-legacy-359139" has status "Ready":"True"
	I0626 19:05:50.917236  290915 node_ready.go:38] duration metric: took 4.0348ms waiting for node "ingress-addon-legacy-359139" to be "Ready" ...
	I0626 19:05:50.917246  290915 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0626 19:05:50.929496  290915 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-2h7s8" in "kube-system" namespace to be "Ready" ...
	I0626 19:05:51.016422  290915 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0626 19:05:51.018301  290915 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0626 19:05:51.682050  290915 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0626 19:05:51.744333  290915 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0626 19:05:51.746254  290915 addons.go:499] enable addons completed in 1.160772461s: enabled=[storage-provisioner default-storageclass]
	I0626 19:05:52.939750  290915 pod_ready.go:102] pod "coredns-66bff467f8-2h7s8" in "kube-system" namespace has status "Ready":"False"
	I0626 19:05:54.942813  290915 pod_ready.go:102] pod "coredns-66bff467f8-2h7s8" in "kube-system" namespace has status "Ready":"False"
	I0626 19:05:57.440469  290915 pod_ready.go:102] pod "coredns-66bff467f8-2h7s8" in "kube-system" namespace has status "Ready":"False"
	I0626 19:05:59.440132  290915 pod_ready.go:92] pod "coredns-66bff467f8-2h7s8" in "kube-system" namespace has status "Ready":"True"
	I0626 19:05:59.440157  290915 pod_ready.go:81] duration metric: took 8.510584712s waiting for pod "coredns-66bff467f8-2h7s8" in "kube-system" namespace to be "Ready" ...
	I0626 19:05:59.440167  290915 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-95hhf" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:00.950825  290915 pod_ready.go:92] pod "coredns-66bff467f8-95hhf" in "kube-system" namespace has status "Ready":"True"
	I0626 19:06:00.950852  290915 pod_ready.go:81] duration metric: took 1.510677947s waiting for pod "coredns-66bff467f8-95hhf" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:00.950863  290915 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-359139" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:00.955798  290915 pod_ready.go:92] pod "etcd-ingress-addon-legacy-359139" in "kube-system" namespace has status "Ready":"True"
	I0626 19:06:00.955822  290915 pod_ready.go:81] duration metric: took 4.952296ms waiting for pod "etcd-ingress-addon-legacy-359139" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:00.955833  290915 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-359139" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:00.961083  290915 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-359139" in "kube-system" namespace has status "Ready":"True"
	I0626 19:06:00.961106  290915 pod_ready.go:81] duration metric: took 5.265743ms waiting for pod "kube-apiserver-ingress-addon-legacy-359139" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:00.961118  290915 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-359139" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:00.966124  290915 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-359139" in "kube-system" namespace has status "Ready":"True"
	I0626 19:06:00.966154  290915 pod_ready.go:81] duration metric: took 5.026928ms waiting for pod "kube-controller-manager-ingress-addon-legacy-359139" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:00.966168  290915 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dj9c4" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:01.035065  290915 request.go:628] Waited for 66.219716ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-359139
	I0626 19:06:01.037794  290915 pod_ready.go:92] pod "kube-proxy-dj9c4" in "kube-system" namespace has status "Ready":"True"
	I0626 19:06:01.037822  290915 pod_ready.go:81] duration metric: took 71.642674ms waiting for pod "kube-proxy-dj9c4" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:01.037833  290915 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-359139" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:01.235276  290915 request.go:628] Waited for 197.351524ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-359139
	I0626 19:06:01.435709  290915 request.go:628] Waited for 197.338165ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-359139
	I0626 19:06:01.438619  290915 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-359139" in "kube-system" namespace has status "Ready":"True"
	I0626 19:06:01.438642  290915 pod_ready.go:81] duration metric: took 400.801495ms waiting for pod "kube-scheduler-ingress-addon-legacy-359139" in "kube-system" namespace to be "Ready" ...
	I0626 19:06:01.438652  290915 pod_ready.go:38] duration metric: took 10.521396478s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0626 19:06:01.438675  290915 api_server.go:52] waiting for apiserver process to appear ...
	I0626 19:06:01.438734  290915 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0626 19:06:01.452608  290915 api_server.go:72] duration metric: took 10.750785063s to wait for apiserver process to appear ...
	I0626 19:06:01.452632  290915 api_server.go:88] waiting for apiserver healthz status ...
	I0626 19:06:01.452649  290915 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0626 19:06:01.461755  290915 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0626 19:06:01.462725  290915 api_server.go:141] control plane version: v1.18.20
	I0626 19:06:01.462746  290915 api_server.go:131] duration metric: took 10.107009ms to wait for apiserver health ...
	I0626 19:06:01.462755  290915 system_pods.go:43] waiting for kube-system pods to appear ...
	I0626 19:06:01.635147  290915 request.go:628] Waited for 172.325309ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0626 19:06:01.641344  290915 system_pods.go:59] 8 kube-system pods found
	I0626 19:06:01.641375  290915 system_pods.go:61] "coredns-66bff467f8-2h7s8" [825fd35b-a396-4802-82b1-0e051a8c0ff5] Running
	I0626 19:06:01.641382  290915 system_pods.go:61] "coredns-66bff467f8-95hhf" [dba30533-ef39-4135-8de9-ef0e77b6b654] Running
	I0626 19:06:01.641408  290915 system_pods.go:61] "etcd-ingress-addon-legacy-359139" [74ed11b5-3463-4d7f-af6c-789203be98d9] Running
	I0626 19:06:01.641421  290915 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-359139" [cb27e56f-3c5d-40ee-b16f-5f0de5511542] Running
	I0626 19:06:01.641427  290915 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-359139" [fd6446d9-1aa4-49d4-8749-57357c6976ee] Running
	I0626 19:06:01.641432  290915 system_pods.go:61] "kube-proxy-dj9c4" [6bf85bd8-2f5c-455f-9fbe-298d94a3d893] Running
	I0626 19:06:01.641437  290915 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-359139" [06d4671c-41d6-4975-80d6-0defff283405] Running
	I0626 19:06:01.641445  290915 system_pods.go:61] "storage-provisioner" [154c3719-7669-4971-ac96-aed5dec9b9d5] Running
	I0626 19:06:01.641452  290915 system_pods.go:74] duration metric: took 178.692445ms to wait for pod list to return data ...
	I0626 19:06:01.641464  290915 default_sa.go:34] waiting for default service account to be created ...
	I0626 19:06:01.835878  290915 request.go:628] Waited for 194.33843ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I0626 19:06:01.838446  290915 default_sa.go:45] found service account: "default"
	I0626 19:06:01.838468  290915 default_sa.go:55] duration metric: took 196.998801ms for default service account to be created ...
	I0626 19:06:01.838478  290915 system_pods.go:116] waiting for k8s-apps to be running ...
	I0626 19:06:02.035870  290915 request.go:628] Waited for 197.330208ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0626 19:06:02.041960  290915 system_pods.go:86] 8 kube-system pods found
	I0626 19:06:02.041995  290915 system_pods.go:89] "coredns-66bff467f8-2h7s8" [825fd35b-a396-4802-82b1-0e051a8c0ff5] Running
	I0626 19:06:02.042003  290915 system_pods.go:89] "coredns-66bff467f8-95hhf" [dba30533-ef39-4135-8de9-ef0e77b6b654] Running
	I0626 19:06:02.042009  290915 system_pods.go:89] "etcd-ingress-addon-legacy-359139" [74ed11b5-3463-4d7f-af6c-789203be98d9] Running
	I0626 19:06:02.042036  290915 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-359139" [cb27e56f-3c5d-40ee-b16f-5f0de5511542] Running
	I0626 19:06:02.042047  290915 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-359139" [fd6446d9-1aa4-49d4-8749-57357c6976ee] Running
	I0626 19:06:02.042052  290915 system_pods.go:89] "kube-proxy-dj9c4" [6bf85bd8-2f5c-455f-9fbe-298d94a3d893] Running
	I0626 19:06:02.042057  290915 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-359139" [06d4671c-41d6-4975-80d6-0defff283405] Running
	I0626 19:06:02.042062  290915 system_pods.go:89] "storage-provisioner" [154c3719-7669-4971-ac96-aed5dec9b9d5] Running
	I0626 19:06:02.042076  290915 system_pods.go:126] duration metric: took 203.588431ms to wait for k8s-apps to be running ...
	I0626 19:06:02.042089  290915 system_svc.go:44] waiting for kubelet service to be running ....
	I0626 19:06:02.042161  290915 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0626 19:06:02.059225  290915 system_svc.go:56] duration metric: took 17.126498ms WaitForService to wait for kubelet.
	I0626 19:06:02.059252  290915 kubeadm.go:581] duration metric: took 11.357434145s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0626 19:06:02.059275  290915 node_conditions.go:102] verifying NodePressure condition ...
	I0626 19:06:02.235654  290915 request.go:628] Waited for 176.305944ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I0626 19:06:02.238494  290915 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0626 19:06:02.238549  290915 node_conditions.go:123] node cpu capacity is 2
	I0626 19:06:02.238566  290915 node_conditions.go:105] duration metric: took 179.285151ms to run NodePressure ...
	I0626 19:06:02.238578  290915 start.go:228] waiting for startup goroutines ...
	I0626 19:06:02.238586  290915 start.go:233] waiting for cluster config update ...
	I0626 19:06:02.238597  290915 start.go:242] writing updated cluster config ...
	I0626 19:06:02.238890  290915 ssh_runner.go:195] Run: rm -f paused
	I0626 19:06:02.297115  290915 start.go:652] kubectl: 1.27.3, cluster: 1.18.20 (minor skew: 9)
	I0626 19:06:02.299322  290915 out.go:177] 
	W0626 19:06:02.301163  290915 out.go:239] ! /usr/local/bin/kubectl is version 1.27.3, which may have incompatibilities with Kubernetes 1.18.20.
	I0626 19:06:02.302729  290915 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I0626 19:06:02.304441  290915 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-359139" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Jun 26 19:05:12 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:05:12.646683921Z" level=info msg="Daemon has completed initialization"
	Jun 26 19:05:12 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:05:12.675302034Z" level=info msg="API listen on /var/run/docker.sock"
	Jun 26 19:05:12 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:05:12.675312053Z" level=info msg="API listen on [::]:2376"
	Jun 26 19:05:12 ingress-addon-legacy-359139 systemd[1]: Started Docker Application Container Engine.
	Jun 26 19:06:03 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:03.617784186Z" level=warning msg="reference for unknown type: " digest="sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7" remote="docker.io/jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7"
	Jun 26 19:06:05 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:05.187979966Z" level=info msg="ignoring event" container=2a1613977ed5e9bbf3fe2047bd7adbaba0e89514a6138fd06c48dfe1161584e7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:05 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:05.199868298Z" level=info msg="ignoring event" container=1aeb0941334c6efdd9aec93d9bf53a9db760bb2ac1e4554f26fe4bbdcef92a18 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:05 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:05.900539584Z" level=info msg="ignoring event" container=e573d58c4b73f70bd912a6b4d89c31f11da6a11338a24ec537f096de28e8982a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:06 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:06.061455410Z" level=info msg="ignoring event" container=9fae7222bbd369a7f8ebd01a0f991b0cdaf954bef40870d89a16aa713ab9e5aa module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:06 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:06.924852332Z" level=info msg="ignoring event" container=a38f0231621b076bfde354ee52753c65d9f1c3711b7e45aee85e2db677e2a4d1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:07 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:07.275378675Z" level=warning msg="reference for unknown type: " digest="sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324" remote="registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324"
	Jun 26 19:06:13 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:13.857965759Z" level=warning msg="Published ports are discarded when using host network mode"
	Jun 26 19:06:13 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:13.878592681Z" level=warning msg="Published ports are discarded when using host network mode"
	Jun 26 19:06:14 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:14.041286614Z" level=warning msg="reference for unknown type: " digest="sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" remote="docker.io/cryptexlabs/minikube-ingress-dns@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab"
	Jun 26 19:06:20 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:20.377953025Z" level=info msg="ignoring event" container=82d6fb0a522ef07440468e2cce9895ff9af9e66ad3c0b6a634e0894aaaf9c7c2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:21 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:21.184093416Z" level=info msg="ignoring event" container=340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:36 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:36.176744416Z" level=info msg="ignoring event" container=945c0b19b38287dc4da1064be64cb69564933fc22be51a93fe919434dbea08ed module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:36 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:36.411563601Z" level=info msg="ignoring event" container=72622a0fec715ac7b51488fc03ba0f6c75f1f7ad91eed4b2247415e5b02c74e5 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:37 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:37.647556764Z" level=info msg="ignoring event" container=6cf229d6972e28f1bf4385f1c1f273c94e91ed4f94133797385e671ec85dbc22 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:48 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:48.652122706Z" level=info msg="ignoring event" container=7f633c6ba29cf17b50d2a9d3dd8646dc3516baf8e4a01a631a360ac66a92322e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:06:50 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:06:50.557776506Z" level=info msg="ignoring event" container=3b6e3359e79436a06008b781262332fedf1c1dbafd719ed9e95511f53c42b1ca module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:07:01 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:07:01.268020507Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=dcacb0cfdd83806733c20aa675da2143efff8698d80124bcbbc386dee135577e
	Jun 26 19:07:01 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:07:01.283904660Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=dcacb0cfdd83806733c20aa675da2143efff8698d80124bcbbc386dee135577e
	Jun 26 19:07:01 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:07:01.350900875Z" level=info msg="ignoring event" container=dcacb0cfdd83806733c20aa675da2143efff8698d80124bcbbc386dee135577e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jun 26 19:07:01 ingress-addon-legacy-359139 dockerd[1297]: time="2023-06-26T19:07:01.419111320Z" level=info msg="ignoring event" container=9ad0ae32a6a28e0842f36098d6ccd2cd975fb5d0d4e034c6a060c24921807056 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                              CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	7f633c6ba29cf       13753a81eccfd                                                                                                      18 seconds ago       Exited              hello-world-app           2                   3f278ec7e8d98       hello-world-app-5f5d8b66bb-b7qp6
	30f47244c4960       nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6                                      41 seconds ago       Running             nginx                     0                   cda5ee36a7b29       nginx
	dcacb0cfdd838       registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324   55 seconds ago       Exited              controller                0                   9ad0ae32a6a28       ingress-nginx-controller-7fcf777cb7-7jk2d
	9fae7222bbd36       a883f7fc35610                                                                                                      About a minute ago   Exited              patch                     1                   a38f0231621b0       ingress-nginx-admission-patch-mf5b7
	1aeb0941334c6       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              create                    0                   e573d58c4b73f       ingress-nginx-admission-create-qz5lm
	0874a922fe072       gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944    About a minute ago   Running             storage-provisioner       0                   ac4016aa4cf9c       storage-provisioner
	e93ef0cc1f94c       6e17ba78cf3eb                                                                                                      About a minute ago   Running             coredns                   0                   13f6d5d1c9eb9       coredns-66bff467f8-95hhf
	3d4b5686f0e24       6e17ba78cf3eb                                                                                                      About a minute ago   Running             coredns                   0                   b05a4cae0258e       coredns-66bff467f8-2h7s8
	0af71df9a8c01       565297bc6f7d4                                                                                                      About a minute ago   Running             kube-proxy                0                   bcba171ee0470       kube-proxy-dj9c4
	afa1002fdf527       095f37015706d                                                                                                      About a minute ago   Running             kube-scheduler            0                   90e30e4ebd151       kube-scheduler-ingress-addon-legacy-359139
	cab96dab9e056       ab707b0a0ea33                                                                                                      About a minute ago   Running             etcd                      0                   422d1a96f2201       etcd-ingress-addon-legacy-359139
	53dd945247cb2       68a4fac29a865                                                                                                      About a minute ago   Running             kube-controller-manager   0                   96e3a17dee972       kube-controller-manager-ingress-addon-legacy-359139
	8007c3fd244db       2694cf044d665                                                                                                      About a minute ago   Running             kube-apiserver            0                   1c85d44478c6b       kube-apiserver-ingress-addon-legacy-359139
	
	* 
	* ==> coredns [3d4b5686f0e2] <==
	* .:53
	[INFO] plugin/reload: Running configuration MD5 = 45700869df5177c7f3d9f7a279928a55
	CoreDNS-1.6.7
	linux/arm64, go1.13.6, da7f65b
	[INFO] 127.0.0.1:45880 - 51811 "HINFO IN 4002407017817778049.6295494152029716801. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.024428544s
	[INFO] 172.17.0.1:3164 - 20850 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000177523s
	[INFO] 172.17.0.1:3164 - 30214 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000126102s
	[INFO] 172.17.0.1:3164 - 30326 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000153777s
	[INFO] 172.17.0.1:3164 - 65052 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000119735s
	[INFO] 172.17.0.1:3164 - 7509 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000117692s
	[INFO] 172.17.0.1:3164 - 33056 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00011016s
	[INFO] 172.17.0.1:3164 - 39784 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001079947s
	[INFO] 172.17.0.1:3164 - 63815 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00082149s
	[INFO] 172.17.0.1:3164 - 41194 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000107305s
	
	* 
	* ==> coredns [e93ef0cc1f94] <==
	* [INFO] 172.17.0.1:8280 - 18511 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000091921s
	[INFO] 172.17.0.1:8280 - 41621 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.0000799s
	[INFO] 172.17.0.1:8280 - 46177 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000081976s
	[INFO] 172.17.0.1:8280 - 19256 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000075929s
	[INFO] 172.17.0.1:8280 - 42032 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001937539s
	[INFO] 172.17.0.1:8280 - 8987 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.007185857s
	[INFO] 172.17.0.1:8280 - 5159 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000169728s
	[INFO] 172.17.0.1:51313 - 51774 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000086496s
	[INFO] 172.17.0.1:51313 - 45181 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000048853s
	[INFO] 172.17.0.1:51313 - 24942 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000037349s
	[INFO] 172.17.0.1:51313 - 15372 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000035749s
	[INFO] 172.17.0.1:51313 - 10272 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000040262s
	[INFO] 172.17.0.1:51313 - 57674 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000050092s
	[INFO] 172.17.0.1:51313 - 39936 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002592738s
	[INFO] 172.17.0.1:51313 - 8905 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000845071s
	[INFO] 172.17.0.1:51313 - 32995 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000063605s
	[INFO] 172.17.0.1:38913 - 6818 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000090747s
	[INFO] 172.17.0.1:38913 - 1652 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000054292s
	[INFO] 172.17.0.1:38913 - 54778 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00005732s
	[INFO] 172.17.0.1:38913 - 34835 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000073278s
	[INFO] 172.17.0.1:38913 - 35007 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000052815s
	[INFO] 172.17.0.1:38913 - 50847 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000059732s
	[INFO] 172.17.0.1:38913 - 39505 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001040013s
	[INFO] 172.17.0.1:38913 - 12509 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000873789s
	[INFO] 172.17.0.1:38913 - 10264 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000061151s
	
	* 
	* ==> describe nodes <==
	* Name:               ingress-addon-legacy-359139
	Roles:              master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=ingress-addon-legacy-359139
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=759becbe25e432e7a4042c59713ee144df2072e1
	                    minikube.k8s.io/name=ingress-addon-legacy-359139
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_06_26T19_05_34_0700
	                    minikube.k8s.io/version=v1.30.1
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 26 Jun 2023 19:05:31 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-359139
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 26 Jun 2023 19:06:58 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 26 Jun 2023 19:06:38 +0000   Mon, 26 Jun 2023 19:05:25 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 26 Jun 2023 19:06:38 +0000   Mon, 26 Jun 2023 19:05:25 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 26 Jun 2023 19:06:38 +0000   Mon, 26 Jun 2023 19:05:25 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 26 Jun 2023 19:06:38 +0000   Mon, 26 Jun 2023 19:05:48 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-359139
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022624Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022624Ki
	  pods:               110
	System Info:
	  Machine ID:                 b38d6ac284e7496b9afec3b0dc742631
	  System UUID:                067408f6-2cb0-4fa4-8dbc-6b07c3e88431
	  Boot ID:                    210d3827-912b-4be1-a50b-47a88cefca99
	  Kernel Version:             5.15.0-1038-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.2
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-b7qp6                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         34s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         44s
	  kube-system                 coredns-66bff467f8-2h7s8                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     77s
	  kube-system                 coredns-66bff467f8-95hhf                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     77s
	  kube-system                 etcd-ingress-addon-legacy-359139                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         89s
	  kube-system                 kube-apiserver-ingress-addon-legacy-359139             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         89s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-359139    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         89s
	  kube-system                 kube-proxy-dj9c4                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         77s
	  kube-system                 kube-scheduler-ingress-addon-legacy-359139             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         89s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         76s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)
	  memory             140Mi (1%!)(MISSING)  340Mi (4%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From        Message
	  ----    ------                   ----                 ----        -------
	  Normal  Starting                 104s                 kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  104s (x3 over 104s)  kubelet     Node ingress-addon-legacy-359139 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    104s (x3 over 104s)  kubelet     Node ingress-addon-legacy-359139 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     104s (x3 over 104s)  kubelet     Node ingress-addon-legacy-359139 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  104s                 kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  89s                  kubelet     Node ingress-addon-legacy-359139 status is now: NodeHasSufficientMemory
	  Normal  Starting                 89s                  kubelet     Starting kubelet.
	  Normal  NodeHasNoDiskPressure    89s                  kubelet     Node ingress-addon-legacy-359139 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     89s                  kubelet     Node ingress-addon-legacy-359139 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             89s                  kubelet     Node ingress-addon-legacy-359139 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  89s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                79s                  kubelet     Node ingress-addon-legacy-359139 status is now: NodeReady
	  Normal  Starting                 76s                  kube-proxy  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +0.000764] FS-Cache: N-cookie c=0000001e [p=00000015 fl=2 nc=0 na=1]
	[  +0.000937] FS-Cache: N-cookie d=0000000085ec082e{9p.inode} n=00000000bc7743a2
	[  +0.001035] FS-Cache: N-key=[8] '985d3b0000000000'
	[  +0.002844] FS-Cache: Duplicate cookie detected
	[  +0.000682] FS-Cache: O-cookie c=00000018 [p=00000015 fl=226 nc=0 na=1]
	[  +0.001134] FS-Cache: O-cookie d=0000000085ec082e{9p.inode} n=000000002d67d4d1
	[  +0.001132] FS-Cache: O-key=[8] '985d3b0000000000'
	[  +0.000704] FS-Cache: N-cookie c=0000001f [p=00000015 fl=2 nc=0 na=1]
	[  +0.000943] FS-Cache: N-cookie d=0000000085ec082e{9p.inode} n=00000000cdd50c59
	[  +0.001055] FS-Cache: N-key=[8] '985d3b0000000000'
	[  +2.294522] FS-Cache: Duplicate cookie detected
	[  +0.000785] FS-Cache: O-cookie c=00000016 [p=00000015 fl=226 nc=0 na=1]
	[  +0.001060] FS-Cache: O-cookie d=0000000085ec082e{9p.inode} n=00000000a4a25369
	[  +0.001105] FS-Cache: O-key=[8] '975d3b0000000000'
	[  +0.000715] FS-Cache: N-cookie c=00000021 [p=00000015 fl=2 nc=0 na=1]
	[  +0.001004] FS-Cache: N-cookie d=0000000085ec082e{9p.inode} n=0000000095530259
	[  +0.001158] FS-Cache: N-key=[8] '975d3b0000000000'
	[  +0.306451] FS-Cache: Duplicate cookie detected
	[  +0.000689] FS-Cache: O-cookie c=0000001b [p=00000015 fl=226 nc=0 na=1]
	[  +0.001028] FS-Cache: O-cookie d=0000000085ec082e{9p.inode} n=00000000b0eadc9c
	[  +0.001062] FS-Cache: O-key=[8] '9d5d3b0000000000'
	[  +0.000769] FS-Cache: N-cookie c=00000022 [p=00000015 fl=2 nc=0 na=1]
	[  +0.000935] FS-Cache: N-cookie d=0000000085ec082e{9p.inode} n=000000009a8ba647
	[  +0.001086] FS-Cache: N-key=[8] '9d5d3b0000000000'
	[  +0.880868] 9pnet: p9_fd_create_tcp (283757): problem connecting socket to 192.168.49.1
	
	* 
	* ==> etcd [cab96dab9e05] <==
	* raft2023/06/26 19:05:25 INFO: aec36adc501070cc became follower at term 0
	raft2023/06/26 19:05:25 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	raft2023/06/26 19:05:25 INFO: aec36adc501070cc became follower at term 1
	raft2023/06/26 19:05:25 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-06-26 19:05:26.423032 W | auth: simple token is not cryptographically signed
	2023-06-26 19:05:26.570105 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	2023-06-26 19:05:26.707136 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	raft2023/06/26 19:05:26 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-06-26 19:05:26.799204 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2023-06-26 19:05:27.003850 I | embed: listening for metrics on http://127.0.0.1:2381
	2023-06-26 19:05:27.004088 I | embed: listening for peers on 192.168.49.2:2380
	2023-06-26 19:05:27.004141 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	raft2023/06/26 19:05:27 INFO: aec36adc501070cc is starting a new election at term 1
	raft2023/06/26 19:05:27 INFO: aec36adc501070cc became candidate at term 2
	raft2023/06/26 19:05:27 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2023/06/26 19:05:27 INFO: aec36adc501070cc became leader at term 2
	raft2023/06/26 19:05:27 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2023-06-26 19:05:27.574186 I | etcdserver: setting up the initial cluster version to 3.4
	2023-06-26 19:05:27.574811 N | etcdserver/membership: set the initial cluster version to 3.4
	2023-06-26 19:05:27.574977 I | etcdserver/api: enabled capabilities for version 3.4
	2023-06-26 19:05:27.575114 I | etcdserver: published {Name:ingress-addon-legacy-359139 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2023-06-26 19:05:27.575326 I | embed: ready to serve client requests
	2023-06-26 19:05:27.576904 I | embed: serving client requests on 192.168.49.2:2379
	2023-06-26 19:05:27.577104 I | embed: ready to serve client requests
	2023-06-26 19:05:27.578321 I | embed: serving client requests on 127.0.0.1:2379
	
	* 
	* ==> kernel <==
	*  19:07:07 up  1:49,  0 users,  load average: 1.10, 2.51, 2.39
	Linux ingress-addon-legacy-359139 5.15.0-1038-aws #43~20.04.1-Ubuntu SMP Fri Jun 2 17:11:42 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kube-apiserver [8007c3fd244d] <==
	* E0626 19:05:31.634430       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.49.2, ResourceVersion: 0, AdditionalErrorMsg: 
	I0626 19:05:31.735812       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I0626 19:05:31.765131       1 cache.go:39] Caches are synced for autoregister controller
	I0626 19:05:31.770240       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0626 19:05:31.770400       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0626 19:05:31.770536       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I0626 19:05:32.563359       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0626 19:05:32.563479       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0626 19:05:32.573183       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I0626 19:05:32.578606       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I0626 19:05:32.578637       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I0626 19:05:33.005453       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0626 19:05:33.063675       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0626 19:05:33.170165       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0626 19:05:33.171244       1 controller.go:609] quota admission added evaluator for: endpoints
	I0626 19:05:33.175564       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0626 19:05:33.974393       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I0626 19:05:34.742049       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I0626 19:05:34.823714       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I0626 19:05:38.352346       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I0626 19:05:50.592463       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I0626 19:05:50.747853       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I0626 19:06:02.925390       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I0626 19:06:22.894040       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	E0626 19:06:58.550343       1 watch.go:251] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoder{writer:(*http2.responseWriter)(0x400eade558), encoder:(*versioning.codec)(0x400f4bb180), buf:(*bytes.Buffer)(0x400fe36420)})
	
	* 
	* ==> kube-controller-manager [53dd945247cb] <==
	* I0626 19:05:50.739862       1 shared_informer.go:230] Caches are synced for daemon sets 
	I0626 19:05:50.771158       1 event.go:278] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"78802033-c972-436f-8629-1746af66704a", APIVersion:"apps/v1", ResourceVersion:"211", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-dj9c4
	I0626 19:05:50.794449       1 shared_informer.go:230] Caches are synced for endpoint_slice 
	E0626 19:05:50.816937       1 daemon_controller.go:321] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"/apis/apps/v1/namespaces/kube-system/daemonsets/kube-proxy", UID:"78802033-c972-436f-8629-1746af66704a", ResourceVersion:"211", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63823403134, loc:(*time.Location)(0x6307ca0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4000be2580), FieldsType:"FieldsV1", FieldsV1:(*v1.Fields
V1)(0x4000be25a0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4000be25c0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(n
il), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4001299a40), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSou
rce)(0x4000be25e0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.Pr
ojectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000be2600), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolum
eSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.18.20", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4000be2640)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList
(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4000a38be0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x40006f61c8), Acti
veDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40003aa8c0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPoli
cy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x40000c7b50)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x40006f6278)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
	I0626 19:05:50.819133       1 shared_informer.go:230] Caches are synced for taint 
	I0626 19:05:50.819251       1 node_lifecycle_controller.go:1433] Initializing eviction metric for zone: 
	W0626 19:05:50.819314       1 node_lifecycle_controller.go:1048] Missing timestamp for Node ingress-addon-legacy-359139. Assuming now as a timestamp.
	I0626 19:05:50.819348       1 node_lifecycle_controller.go:1249] Controller detected that zone  is now in state Normal.
	I0626 19:05:50.819625       1 taint_manager.go:187] Starting NoExecuteTaintManager
	I0626 19:05:50.819922       1 event.go:278] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"ingress-addon-legacy-359139", UID:"c766a011-0bf8-4f6d-b467-cdd348f088a6", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node ingress-addon-legacy-359139 event: Registered Node ingress-addon-legacy-359139 in Controller
	I0626 19:05:50.933905       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0626 19:05:50.933929       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0626 19:05:50.936472       1 shared_informer.go:230] Caches are synced for resource quota 
	I0626 19:05:50.939184       1 shared_informer.go:230] Caches are synced for resource quota 
	I0626 19:05:50.957187       1 shared_informer.go:230] Caches are synced for certificate-csrapproving 
	I0626 19:05:50.962043       1 shared_informer.go:230] Caches are synced for certificate-csrsigning 
	I0626 19:05:51.019082       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0626 19:06:02.927532       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"64fed7d5-74e9-4f11-8cb1-23fc21b87e67", APIVersion:"apps/v1", ResourceVersion:"454", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I0626 19:06:02.947353       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"2cb108af-3b85-4bdc-b036-0be0c6227d5a", APIVersion:"batch/v1", ResourceVersion:"456", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-qz5lm
	I0626 19:06:02.956705       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"2b442981-94f3-443d-9fcd-6888f813e2e1", APIVersion:"apps/v1", ResourceVersion:"455", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-7jk2d
	I0626 19:06:03.038003       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"2c1a1860-cfdd-4432-a9be-abff140a59f5", APIVersion:"batch/v1", ResourceVersion:"466", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-mf5b7
	I0626 19:06:05.846230       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"2cb108af-3b85-4bdc-b036-0be0c6227d5a", APIVersion:"batch/v1", ResourceVersion:"469", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0626 19:06:06.885744       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"2c1a1860-cfdd-4432-a9be-abff140a59f5", APIVersion:"batch/v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0626 19:06:33.676453       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"4ee31f54-0f2f-408f-9814-5b7acb07fe6f", APIVersion:"apps/v1", ResourceVersion:"589", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	I0626 19:06:33.698082       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"f5e92d50-53c3-43b1-b4b4-473ca37185e1", APIVersion:"apps/v1", ResourceVersion:"590", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-b7qp6
	
	* 
	* ==> kube-proxy [0af71df9a8c0] <==
	* W0626 19:05:51.809702       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I0626 19:05:51.821638       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I0626 19:05:51.821688       1 server_others.go:186] Using iptables Proxier.
	I0626 19:05:51.822062       1 server.go:583] Version: v1.18.20
	I0626 19:05:51.824345       1 config.go:315] Starting service config controller
	I0626 19:05:51.826685       1 shared_informer.go:223] Waiting for caches to sync for service config
	I0626 19:05:51.824525       1 config.go:133] Starting endpoints config controller
	I0626 19:05:51.827045       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I0626 19:05:51.927144       1 shared_informer.go:230] Caches are synced for service config 
	I0626 19:05:51.927283       1 shared_informer.go:230] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [afa1002fdf52] <==
	* I0626 19:05:31.760033       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0626 19:05:31.760053       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0626 19:05:31.761115       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
	I0626 19:05:31.761265       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0626 19:05:31.765812       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0626 19:05:31.766446       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0626 19:05:31.766549       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0626 19:05:31.766623       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0626 19:05:31.766730       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0626 19:05:31.766794       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0626 19:05:31.766863       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0626 19:05:31.769934       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0626 19:05:31.770008       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0626 19:05:31.770127       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0626 19:05:31.770827       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0626 19:05:31.772632       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0626 19:05:32.583413       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0626 19:05:32.626745       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0626 19:05:32.639563       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0626 19:05:32.680133       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0626 19:05:32.706978       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0626 19:05:32.769473       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0626 19:05:32.803582       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0626 19:05:35.760186       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	E0626 19:05:50.704369       1 factory.go:503] pod: kube-system/coredns-66bff467f8-2h7s8 is already present in the active queue
	
	* 
	* ==> kubelet <==
	* Jun 26 19:06:38 ingress-addon-legacy-359139 kubelet[2851]: E0626 19:06:38.375913    2851 remote_runtime.go:261] RemoveContainer "340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad" from runtime service failed: rpc error: code = Unknown desc = failed to get container "340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad" log path: failed to inspect container "340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad": Error: No such container: 340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad
	Jun 26 19:06:38 ingress-addon-legacy-359139 kubelet[2851]: E0626 19:06:38.375985    2851 kuberuntime_gc.go:143] Failed to remove container "340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad": rpc error: code = Unknown desc = failed to get container "340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad" log path: failed to inspect container "340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad": Error: No such container: 340004a4a1d5676b4abc24a758c0e167bb32bb753ad3c41335e848c61b4134ad
	Jun 26 19:06:48 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:06:48.525362    2851 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 72622a0fec715ac7b51488fc03ba0f6c75f1f7ad91eed4b2247415e5b02c74e5
	Jun 26 19:06:48 ingress-addon-legacy-359139 kubelet[2851]: W0626 19:06:48.682274    2851 container.go:412] Failed to create summary reader for "/kubepods/besteffort/pod66052868-51c9-48d0-8afb-9c2f5681249e/7f633c6ba29cf17b50d2a9d3dd8646dc3516baf8e4a01a631a360ac66a92322e": none of the resources are being tracked.
	Jun 26 19:06:49 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:06:49.385374    2851 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-4wc22" (UniqueName: "kubernetes.io/secret/58045bb3-29f7-4dd6-a921-46cbccb8fa65-minikube-ingress-dns-token-4wc22") pod "58045bb3-29f7-4dd6-a921-46cbccb8fa65" (UID: "58045bb3-29f7-4dd6-a921-46cbccb8fa65")
	Jun 26 19:06:49 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:06:49.389847    2851 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58045bb3-29f7-4dd6-a921-46cbccb8fa65-minikube-ingress-dns-token-4wc22" (OuterVolumeSpecName: "minikube-ingress-dns-token-4wc22") pod "58045bb3-29f7-4dd6-a921-46cbccb8fa65" (UID: "58045bb3-29f7-4dd6-a921-46cbccb8fa65"). InnerVolumeSpecName "minikube-ingress-dns-token-4wc22". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jun 26 19:06:49 ingress-addon-legacy-359139 kubelet[2851]: W0626 19:06:49.456489    2851 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-b7qp6 through plugin: invalid network status for
	Jun 26 19:06:49 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:06:49.461524    2851 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 72622a0fec715ac7b51488fc03ba0f6c75f1f7ad91eed4b2247415e5b02c74e5
	Jun 26 19:06:49 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:06:49.461915    2851 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 7f633c6ba29cf17b50d2a9d3dd8646dc3516baf8e4a01a631a360ac66a92322e
	Jun 26 19:06:49 ingress-addon-legacy-359139 kubelet[2851]: E0626 19:06:49.462188    2851 pod_workers.go:191] Error syncing pod 66052868-51c9-48d0-8afb-9c2f5681249e ("hello-world-app-5f5d8b66bb-b7qp6_default(66052868-51c9-48d0-8afb-9c2f5681249e)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-b7qp6_default(66052868-51c9-48d0-8afb-9c2f5681249e)"
	Jun 26 19:06:49 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:06:49.485656    2851 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-4wc22" (UniqueName: "kubernetes.io/secret/58045bb3-29f7-4dd6-a921-46cbccb8fa65-minikube-ingress-dns-token-4wc22") on node "ingress-addon-legacy-359139" DevicePath ""
	Jun 26 19:06:50 ingress-addon-legacy-359139 kubelet[2851]: W0626 19:06:50.470764    2851 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-b7qp6 through plugin: invalid network status for
	Jun 26 19:06:51 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:06:51.486936    2851 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 6cf229d6972e28f1bf4385f1c1f273c94e91ed4f94133797385e671ec85dbc22
	Jun 26 19:06:59 ingress-addon-legacy-359139 kubelet[2851]: E0626 19:06:59.254404    2851 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-7jk2d.176c4afef51c2b0e", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-7jk2d", UID:"bda4cc11-3726-42ba-bf6f-c731a8734475", APIVersion:"v1", ResourceVersion:"463", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-359139"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc11e9654cefdad0e, ext:84624421710, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc11e9654cefdad0e, ext:84624421710, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-7jk2d.176c4afef51c2b0e" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jun 26 19:06:59 ingress-addon-legacy-359139 kubelet[2851]: E0626 19:06:59.267085    2851 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-7jk2d.176c4afef51c2b0e", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-7jk2d", UID:"bda4cc11-3726-42ba-bf6f-c731a8734475", APIVersion:"v1", ResourceVersion:"463", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-359139"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc11e9654cefdad0e, ext:84624421710, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc11e9654cf9b8992, ext:84634767306, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-7jk2d.176c4afef51c2b0e" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jun 26 19:07:00 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:07:00.524775    2851 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 7f633c6ba29cf17b50d2a9d3dd8646dc3516baf8e4a01a631a360ac66a92322e
	Jun 26 19:07:00 ingress-addon-legacy-359139 kubelet[2851]: E0626 19:07:00.525564    2851 pod_workers.go:191] Error syncing pod 66052868-51c9-48d0-8afb-9c2f5681249e ("hello-world-app-5f5d8b66bb-b7qp6_default(66052868-51c9-48d0-8afb-9c2f5681249e)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-b7qp6_default(66052868-51c9-48d0-8afb-9c2f5681249e)"
	Jun 26 19:07:01 ingress-addon-legacy-359139 kubelet[2851]: W0626 19:07:01.580578    2851 pod_container_deletor.go:77] Container "9ad0ae32a6a28e0842f36098d6ccd2cd975fb5d0d4e034c6a060c24921807056" not found in pod's containers
	Jun 26 19:07:03 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:07:03.326114    2851 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bda4cc11-3726-42ba-bf6f-c731a8734475-webhook-cert") pod "bda4cc11-3726-42ba-bf6f-c731a8734475" (UID: "bda4cc11-3726-42ba-bf6f-c731a8734475")
	Jun 26 19:07:03 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:07:03.326162    2851 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-2v42q" (UniqueName: "kubernetes.io/secret/bda4cc11-3726-42ba-bf6f-c731a8734475-ingress-nginx-token-2v42q") pod "bda4cc11-3726-42ba-bf6f-c731a8734475" (UID: "bda4cc11-3726-42ba-bf6f-c731a8734475")
	Jun 26 19:07:03 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:07:03.332779    2851 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda4cc11-3726-42ba-bf6f-c731a8734475-ingress-nginx-token-2v42q" (OuterVolumeSpecName: "ingress-nginx-token-2v42q") pod "bda4cc11-3726-42ba-bf6f-c731a8734475" (UID: "bda4cc11-3726-42ba-bf6f-c731a8734475"). InnerVolumeSpecName "ingress-nginx-token-2v42q". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jun 26 19:07:03 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:07:03.333693    2851 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda4cc11-3726-42ba-bf6f-c731a8734475-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bda4cc11-3726-42ba-bf6f-c731a8734475" (UID: "bda4cc11-3726-42ba-bf6f-c731a8734475"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jun 26 19:07:03 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:07:03.426493    2851 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bda4cc11-3726-42ba-bf6f-c731a8734475-webhook-cert") on node "ingress-addon-legacy-359139" DevicePath ""
	Jun 26 19:07:03 ingress-addon-legacy-359139 kubelet[2851]: I0626 19:07:03.426553    2851 reconciler.go:319] Volume detached for volume "ingress-nginx-token-2v42q" (UniqueName: "kubernetes.io/secret/bda4cc11-3726-42ba-bf6f-c731a8734475-ingress-nginx-token-2v42q") on node "ingress-addon-legacy-359139" DevicePath ""
	Jun 26 19:07:04 ingress-addon-legacy-359139 kubelet[2851]: W0626 19:07:04.540225    2851 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/bda4cc11-3726-42ba-bf6f-c731a8734475/volumes" does not exist
	
	* 
	* ==> storage-provisioner [0874a922fe07] <==
	* I0626 19:05:54.124603       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0626 19:05:54.137678       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0626 19:05:54.137886       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0626 19:05:54.146528       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0626 19:05:54.146839       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-359139_e7e29347-5b55-4baa-9bb0-f415f870eb1a!
	I0626 19:05:54.148295       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fa48740d-1bc3-45a8-a6b2-133074c37075", APIVersion:"v1", ResourceVersion:"403", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-359139_e7e29347-5b55-4baa-9bb0-f415f870eb1a became leader
	I0626 19:05:54.248056       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-359139_e7e29347-5b55-4baa-9bb0-f415f870eb1a!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-359139 -n ingress-addon-legacy-359139
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-359139 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (54.38s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (406.73s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.17.0.3947631287.exe start -p running-upgrade-959232 --memory=2200 --vm-driver=docker  --container-runtime=docker
E0626 19:33:12.825616  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
version_upgrade_test.go:132: (dbg) Non-zero exit: /tmp/minikube-v1.17.0.3947631287.exe start -p running-upgrade-959232 --memory=2200 --vm-driver=docker  --container-runtime=docker: exit status 80 (17.148906519s)

                                                
                                                
-- stdout --
	* [running-upgrade-959232] minikube v1.17.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16761
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/tmp/legacy_kubeconfig3389402387
	* Using the docker driver based on user configuration
	* Starting control plane node running-upgrade-959232 in cluster running-upgrade-959232
	* Downloading Kubernetes v1.20.2 preload ...
	* Creating docker container (CPUs=2, Memory=2200MB) ...| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	    > preloaded-images-k8s-v8-v1....: 8.00 MiB / 514.92 MiB [>__] 1.55% ? p/s ?    > preloaded-images-k8s-v8-v1....: 16.55 MiB / 514.92 MiB [>_] 3.21% ? p/s ?    > preloaded-images-k8s-v8-v1....: 24.64 MiB / 514.92 MiB [>_] 4.79% ? p/s ?    > preloaded-images-k8s-v8-v1....: 32.44 MiB / 514.92 MiB  6.30% 40.73 MiB p    > preloaded-images-k8s-v8-v1....: 40.42 MiB / 514.92 MiB  7.85% 40.73 MiB p    > preloaded-images-k8s-v8-v1....: 54.62 MiB / 514.92 MiB  10.61% 40.73 MiB     > preloaded-images-k8s-v8-v1....: 63.67 MiB / 514.92 MiB  12.37% 41.46 MiB     > preloaded-images-k8s-v8-v1....: 78.58 MiB / 514.92 MiB  15.26% 41.46 MiB     > preloaded-images-k8s-v8-v1....: 88.47 MiB / 514.92 MiB  17.18% 41.46 MiB     > preloaded-images-k8s-v8-v1....: 99.44 MiB / 514.92 MiB  19.31% 42.63 MiB     > preloaded-images-k8s-v8-v1....: 108.95 MiB / 514.92 MiB  21.16% 42.63 MiB    > preloaded-images-k8s-v8-v1....: 118.05 MiB / 514.92 MiB  22.93% 42.63 MiB    > preloaded-images-k8s-v8-v1....: 127.72 MiB / 514.92 MiB  24.8
0% 42.92 MiB    > preloaded-images-k8s-v8-v1....: 141.25 MiB / 514.92 MiB  27.43% 42.92 MiB    > preloaded-images-k8s-v8-v1....: 150.02 MiB / 514.92 MiB  29.13% 42.92 MiB    > preloaded-images-k8s-v8-v1....: 162.56 MiB / 514.92 MiB  31.57% 43.90 MiB    > preloaded-images-k8s-v8-v1....: 173.95 MiB / 514.92 MiB  33.78% 43.90 MiB    > preloaded-images-k8s-v8-v1....: 184.17 MiB / 514.92 MiB  35.77% 43.90 MiB    > preloaded-images-k8s-v8-v1....: 200.83 MiB / 514.92 MiB  39.00% 45.18 MiB    > preloaded-images-k8s-v8-v1....: 213.12 MiB / 514.92 MiB  41.39% 45.18 MiB    > preloaded-images-k8s-v8-v1....: 224.00 MiB / 514.92 MiB  43.50% 45.18 MiB    > preloaded-images-k8s-v8-v1....: 233.41 MiB / 514.92 MiB  45.33% 45.77 MiB    > preloaded-images-k8s-v8-v1....: 248.52 MiB / 514.92 MiB  48.26% 45.77 MiB    > preloaded-images-k8s-v8-v1....: 264.00 MiB / 514.92 MiB  51.27% 45.77 MiB    > preloaded-images-k8s-v8-v1....: 277.55 MiB / 514.92 MiB  53.90% 47.56 MiB    > preloaded-images-k8s-v8-v1....: 289.33 MiB / 514.92 MiB  5
6.19% 47.56 MiB    > preloaded-images-k8s-v8-v1....: 303.97 MiB / 514.92 MiB  59.03% 47.56 MiB    > preloaded-images-k8s-v8-v1....: 316.69 MiB / 514.92 MiB  61.50% 48.70 MiB    > preloaded-images-k8s-v8-v1....: 330.90 MiB / 514.92 MiB  64.26% 48.70 MiB    > preloaded-images-k8s-v8-v1....: 341.55 MiB / 514.92 MiB  66.33% 48.70 MiB    > preloaded-images-k8s-v8-v1....: 354.12 MiB / 514.92 MiB  68.77% 49.59 MiB    > preloaded-images-k8s-v8-v1....: 367.40 MiB / 514.92 MiB  71.35% 49.59 MiB    > preloaded-images-k8s-v8-v1....: 382.66 MiB / 514.92 MiB  74.31% 49.59 MiB    > preloaded-images-k8s-v8-v1....: 394.42 MiB / 514.92 MiB  76.60% 50.72 MiB    > preloaded-images-k8s-v8-v1....: 406.05 MiB / 514.92 MiB  78.86% 50.72 MiB    > preloaded-images-k8s-v8-v1....: 421.36 MiB / 514.92 MiB  81.83% 50.72 MiB    > preloaded-images-k8s-v8-v1....: 437.50 MiB / 514.92 MiB  84.96% 52.08 MiB    > preloaded-images-k8s-v8-v1....: 452.73 MiB / 514.92 MiB  87.92% 52.08 MiB    > preloaded-images-k8s-v8-v1....: 468.17 MiB / 514.92 MiB
90.92% 52.08 MiB    > preloaded-images-k8s-v8-v1....: 480.72 MiB / 514.92 MiB  93.36% 53.37 MiB    > preloaded-images-k8s-v8-v1....: 497.94 MiB / 514.92 MiB  96.70% 53.37 MiB    > preloaded-images-k8s-v8-v1....: 513.00 MiB / 514.92 MiB  99.63% 53.37 MiB    > preloaded-images-k8s-v8-v1....: 514.92 MiB / 514.92 MiB  100.00% 62.66 MiX Exiting due to GUEST_PROVISION: Failed to start host: can't create with that IP, address already in use
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.17.0.3947631287.exe start -p running-upgrade-959232 --memory=2200 --vm-driver=docker  --container-runtime=docker
version_upgrade_test.go:132: (dbg) Non-zero exit: /tmp/minikube-v1.17.0.3947631287.exe start -p running-upgrade-959232 --memory=2200 --vm-driver=docker  --container-runtime=docker: exit status 80 (3m12.642794245s)

                                                
                                                
-- stdout --
	* [running-upgrade-959232] minikube v1.17.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16761
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/tmp/legacy_kubeconfig2766380558
	* Using the docker driver based on existing profile
	* Starting control plane node running-upgrade-959232 in cluster running-upgrade-959232
	* docker "running-upgrade-959232" container is missing, will recreate.
	* Creating docker container (CPUs=2, Memory=2200MB) ...| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW
/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_PROVISION: Failed to start host: can't create with that IP, address already in use
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.17.0.3947631287.exe start -p running-upgrade-959232 --memory=2200 --vm-driver=docker  --container-runtime=docker
E0626 19:36:50.902468  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:37:18.587256  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:37:44.567196  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:37:56.895291  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
version_upgrade_test.go:132: (dbg) Non-zero exit: /tmp/minikube-v1.17.0.3947631287.exe start -p running-upgrade-959232 --memory=2200 --vm-driver=docker  --container-runtime=docker: exit status 80 (3m11.949499034s)

                                                
                                                
-- stdout --
	* [running-upgrade-959232] minikube v1.17.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16761
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/tmp/legacy_kubeconfig1666200807
	* Using the docker driver based on existing profile
	* Starting control plane node running-upgrade-959232 in cluster running-upgrade-959232
	* docker "running-upgrade-959232" container is missing, will recreate.
	* Creating docker container (CPUs=2, Memory=2200MB) ...| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW
/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_PROVISION: Failed to start host: can't create with that IP, address already in use
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:138: legacy v1.17.0 start failed: exit status 80
panic.go:522: *** TestRunningBinaryUpgrade FAILED at 2023-06-26 19:39:44.322393155 +0000 UTC m=+2715.674705276
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestRunningBinaryUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect running-upgrade-959232
helpers_test.go:235: (dbg) docker inspect running-upgrade-959232:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "ca4093fb00c68258f4ece57d39fb328375a881124c9066b04bd0f42702b935be",
	        "Created": "2023-06-26T19:39:37.157878384Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "created",
	            "Running": false,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 0,
	            "ExitCode": 128,
	            "Error": "Address already in use",
	            "StartedAt": "0001-01-01T00:00:00Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:9b79b8263a5873a7b57b8bb7698df1f71e90108b3174dea92dc6c576c0a9dbf9",
	        "ResolvConfPath": "",
	        "HostnamePath": "",
	        "HostsPath": "",
	        "LogPath": "",
	        "Name": "/running-upgrade-959232",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "running-upgrade-959232:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "running-upgrade-959232",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 2306867200,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/a02b0214fa50543bf7b7fcd0a06eb6a796cb161b1dc1e31a183eeba2f8612647-init/diff:/var/lib/docker/overlay2/04915339f54b5d9f0e22509f04f3b577195055d08e429d22bc6fe92094c3cd10/diff:/var/lib/docker/overlay2/2b9465653a1a62db8ac61f98bbb5a0189b2c0b69c9226d185429945de83fd390/diff:/var/lib/docker/overlay2/03c2f192e866ef8f86d40b45ceaa18ca9a5648baa3aee0c1d440927a0dc053d6/diff:/var/lib/docker/overlay2/573c011f66c04f121d84dcd61983871f4f959220da73bfe27badb7fbb5911cd6/diff:/var/lib/docker/overlay2/7de91613c0237ff6086a9848abc0a3f7bfa07bd416f34080afe1f002aff0f606/diff:/var/lib/docker/overlay2/2c3584983c6153163510fe83cc7732e8fa1018d0e6944abc08ef881edb925c6c/diff:/var/lib/docker/overlay2/8ab80c419ea9972c07515b285bc88da1937d19d9f142ce47faf1662d409a3d08/diff:/var/lib/docker/overlay2/5a78d076ee9ffde88144239992548ce60e0fee88f5568e8849a7e34955eb05b8/diff:/var/lib/docker/overlay2/fa68bd9715781b45e068212be31a0c1f4c1d7228fc1bd9b9dab6d815ea501eae/diff:/var/lib/docker/overlay2/6f1949
bea5415ee47c1578a3957c35266eb49bf2eda6758a1054e66c044f1ca5/diff:/var/lib/docker/overlay2/cc64592f6dc0d3e4542413bf7c9813ff451f948e47fdefe36894a1da540d63de/diff:/var/lib/docker/overlay2/0d133d6a03e20ab907f5fb3d079398182e29518b223c6016364432ac999ff16d/diff:/var/lib/docker/overlay2/26ee6e1bab1f5875d5d6bc3d56a50042843cd7179871ed5c13c5b305193eae1b/diff:/var/lib/docker/overlay2/197922304bed48b18198ec1012dd1f570f2c983a6e74d08c8194cbd0d5bdf06d/diff:/var/lib/docker/overlay2/701e89824b829359f1475ce02d57c08480a8207d10c8d11313f90e391c50f27b/diff:/var/lib/docker/overlay2/83906ef34fd0afa6e3ed3c7d0ee3b7d7a5b5af04ec87b8b3b152b5faa71b1eba/diff:/var/lib/docker/overlay2/b87f7f0811c78043ffcd0c7beeaae054ec3c8d9cda5c6ac49bc8d34576eb5dbb/diff:/var/lib/docker/overlay2/06b9d9b4082ebc757a1086852e659928e05f5a94d0c64fe138a44f79b69e3785/diff:/var/lib/docker/overlay2/5741b256cb43ba4aa0acccded6b361e22f7602d96baf4ba11352ded37de655f4/diff:/var/lib/docker/overlay2/bb52202ae547154f89fe9db73d7cb338cb5c2c9aa83c14eb56ccc21664d4ca55/diff:/var/lib/d
ocker/overlay2/6a4713557dca257ae833b5dc3083a471c2d74cce14ec0b56fa434f2178a3939c/diff:/var/lib/docker/overlay2/ea097b411db3366b55c394891fda0c7745368f41554642ba5f4e6ffa397ec812/diff:/var/lib/docker/overlay2/dc686b05b8db3410bfedc7a3cb0e71a0bf433f8740f8f80befe3acb1bfdb6e93/diff:/var/lib/docker/overlay2/4cf94bfc859b97574aab54605a52e4a03e14bc16c36400c0b25f880f998bf021/diff:/var/lib/docker/overlay2/81d62abc8a186c0db3e377b0a58e26d1d29e3a86c08d22ea5e99ec593812869a/diff:/var/lib/docker/overlay2/dac122280da60a1e794b7dba616670509c6e4bf93896535af32be07b33374879/diff:/var/lib/docker/overlay2/5f88e375bc7bf0b9f5c258a08f742c4950c9d75cee05180f976efa48f0a306cf/diff:/var/lib/docker/overlay2/b5e54369e88c4a4c87b208d69fa7aebb0fc365c85c50dfb0c30f00b8bc8c82ff/diff:/var/lib/docker/overlay2/9b99125398e9fa92e829b1cf752481ce481fa00ba1c57e35111d44b5954cac3a/diff:/var/lib/docker/overlay2/ce85e4616bbd233b53b5849d139ba99e04d65a48cca4208dddeeb2d51fa4643e/diff:/var/lib/docker/overlay2/1b66dc6d898365ae85658041aa5f79b35687446024bce05c6d9d2553c5f
aee65/diff:/var/lib/docker/overlay2/062a2e6fd980df9446c3c0e7d2816efb03c2343a0cb8560e05c5bf29bd7ba3f2/diff:/var/lib/docker/overlay2/79c578e5383603217acddd98371b0248c9ab14436fff988e5c0598c7ed3c68a5/diff:/var/lib/docker/overlay2/a0aa5512c4c015c16d3dbcfac85f6d37edef061a79462dafef509a0cde918b8f/diff",
	                "MergedDir": "/var/lib/docker/overlay2/a02b0214fa50543bf7b7fcd0a06eb6a796cb161b1dc1e31a183eeba2f8612647/merged",
	                "UpperDir": "/var/lib/docker/overlay2/a02b0214fa50543bf7b7fcd0a06eb6a796cb161b1dc1e31a183eeba2f8612647/diff",
	                "WorkDir": "/var/lib/docker/overlay2/a02b0214fa50543bf7b7fcd0a06eb6a796cb161b1dc1e31a183eeba2f8612647/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "running-upgrade-959232",
	                "Source": "/var/lib/docker/volumes/running-upgrade-959232/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "running-upgrade-959232",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "running-upgrade-959232",
	                "name.minikube.sigs.k8s.io": "running-upgrade-959232",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {},
	            "SandboxKey": "",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "running-upgrade-959232": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.70.1"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "ca4093fb00c6",
	                        "running-upgrade-959232"
	                    ],
	                    "NetworkID": "",
	                    "EndpointID": "",
	                    "Gateway": "",
	                    "IPAddress": "",
	                    "IPPrefixLen": 0,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p running-upgrade-959232 -n running-upgrade-959232
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p running-upgrade-959232 -n running-upgrade-959232: exit status 7 (112.086746ms)

                                                
                                                
-- stdout --
	Nonexistent

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "running-upgrade-959232" host is not running, skipping log retrieval (state="Nonexistent")
helpers_test.go:175: Cleaning up "running-upgrade-959232" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-959232
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-959232: (1.827406734s)
--- FAIL: TestRunningBinaryUpgrade (406.73s)

                                                
                                    

Test pass (291/318)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 35.61
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.15
10 TestDownloadOnly/v1.27.3/json-events 14.47
11 TestDownloadOnly/v1.27.3/preload-exists 0
15 TestDownloadOnly/v1.27.3/LogsDuration 0.07
16 TestDownloadOnly/DeleteAll 0.23
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.14
19 TestBinaryMirror 0.6
20 TestOffline 76.21
22 TestAddons/Setup 143.96
24 TestAddons/parallel/Registry 14.79
26 TestAddons/parallel/InspektorGadget 10.87
27 TestAddons/parallel/MetricsServer 5.75
30 TestAddons/parallel/CSI 58.95
31 TestAddons/parallel/Headlamp 11.53
32 TestAddons/parallel/CloudSpanner 5.52
35 TestAddons/serial/GCPAuth/Namespaces 0.18
36 TestAddons/StoppedEnableDisable 11.01
37 TestCertOptions 47.21
38 TestCertExpiration 249.1
39 TestDockerFlags 47.69
40 TestForceSystemdFlag 40.68
41 TestForceSystemdEnv 36.97
46 TestErrorSpam/setup 35.33
47 TestErrorSpam/start 0.77
48 TestErrorSpam/status 1.08
49 TestErrorSpam/pause 1.41
50 TestErrorSpam/unpause 1.57
51 TestErrorSpam/stop 2.06
54 TestFunctional/serial/CopySyncFile 0
55 TestFunctional/serial/StartWithProxy 62.67
56 TestFunctional/serial/AuditLog 0
57 TestFunctional/serial/SoftStart 36.8
58 TestFunctional/serial/KubeContext 0.06
59 TestFunctional/serial/KubectlGetPods 0.1
62 TestFunctional/serial/CacheCmd/cache/add_remote 3.26
63 TestFunctional/serial/CacheCmd/cache/add_local 0.95
64 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
65 TestFunctional/serial/CacheCmd/cache/list 0.06
66 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.34
67 TestFunctional/serial/CacheCmd/cache/cache_reload 1.81
68 TestFunctional/serial/CacheCmd/cache/delete 0.12
69 TestFunctional/serial/MinikubeKubectlCmd 0.16
70 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.15
71 TestFunctional/serial/ExtraConfig 42.5
72 TestFunctional/serial/ComponentHealth 0.1
73 TestFunctional/serial/LogsCmd 1.38
74 TestFunctional/serial/LogsFileCmd 1.43
75 TestFunctional/serial/InvalidService 4.95
77 TestFunctional/parallel/ConfigCmd 0.45
78 TestFunctional/parallel/DashboardCmd 8.96
79 TestFunctional/parallel/DryRun 0.45
80 TestFunctional/parallel/InternationalLanguage 0.31
81 TestFunctional/parallel/StatusCmd 1.08
85 TestFunctional/parallel/ServiceCmdConnect 7.68
86 TestFunctional/parallel/AddonsCmd 0.2
87 TestFunctional/parallel/PersistentVolumeClaim 27.33
89 TestFunctional/parallel/SSHCmd 0.7
90 TestFunctional/parallel/CpCmd 1.38
92 TestFunctional/parallel/FileSync 0.4
93 TestFunctional/parallel/CertSync 2.26
97 TestFunctional/parallel/NodeLabels 0.1
99 TestFunctional/parallel/NonActiveRuntimeDisabled 0.44
101 TestFunctional/parallel/License 0.44
102 TestFunctional/parallel/Version/short 0.06
103 TestFunctional/parallel/Version/components 0.6
104 TestFunctional/parallel/ImageCommands/ImageListShort 0.28
105 TestFunctional/parallel/ImageCommands/ImageListTable 0.28
106 TestFunctional/parallel/ImageCommands/ImageListJson 0.28
107 TestFunctional/parallel/ImageCommands/ImageListYaml 0.26
108 TestFunctional/parallel/ImageCommands/ImageBuild 2.87
109 TestFunctional/parallel/ImageCommands/Setup 2.12
110 TestFunctional/parallel/DockerEnv/bash 1.23
111 TestFunctional/parallel/UpdateContextCmd/no_changes 0.18
112 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.15
113 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.14
114 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 4.5
115 TestFunctional/parallel/ServiceCmd/DeployApp 11.32
116 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 2.94
117 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 5.3
118 TestFunctional/parallel/ImageCommands/ImageSaveToFile 1.05
119 TestFunctional/parallel/ServiceCmd/List 0.58
120 TestFunctional/parallel/ImageCommands/ImageRemove 0.57
121 TestFunctional/parallel/ServiceCmd/JSONOutput 0.47
122 TestFunctional/parallel/ServiceCmd/HTTPS 0.52
123 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 1.7
124 TestFunctional/parallel/ServiceCmd/Format 0.51
125 TestFunctional/parallel/ServiceCmd/URL 0.52
126 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 3.49
128 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.75
129 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
131 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 10.58
132 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.12
133 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
137 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.12
138 TestFunctional/parallel/ProfileCmd/profile_not_create 0.5
139 TestFunctional/parallel/ProfileCmd/profile_list 0.5
140 TestFunctional/parallel/ProfileCmd/profile_json_output 0.48
141 TestFunctional/parallel/MountCmd/any-port 6.61
143 TestFunctional/parallel/MountCmd/VerifyCleanup 2.56
144 TestFunctional/delete_addon-resizer_images 0.1
145 TestFunctional/delete_my-image_image 0.02
146 TestFunctional/delete_minikube_cached_images 0.02
150 TestImageBuild/serial/Setup 36.48
151 TestImageBuild/serial/NormalBuild 1.75
152 TestImageBuild/serial/BuildWithBuildArg 0.87
153 TestImageBuild/serial/BuildWithDockerIgnore 0.71
154 TestImageBuild/serial/BuildWithSpecifiedDockerfile 0.7
157 TestIngressAddonLegacy/StartLegacyK8sCluster 80.38
159 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 10.78
160 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.41
164 TestJSONOutput/start/Command 62.75
165 TestJSONOutput/start/Audit 0
167 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
168 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
170 TestJSONOutput/pause/Command 0.6
171 TestJSONOutput/pause/Audit 0
173 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
174 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
176 TestJSONOutput/unpause/Command 0.6
177 TestJSONOutput/unpause/Audit 0
179 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
180 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
182 TestJSONOutput/stop/Command 5.84
183 TestJSONOutput/stop/Audit 0
185 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
186 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
187 TestErrorJSONOutput 0.24
189 TestKicCustomNetwork/create_custom_network 32.68
190 TestKicCustomNetwork/use_default_bridge_network 36.99
191 TestKicExistingNetwork 37.38
192 TestKicCustomSubnet 37.51
193 TestKicStaticIP 37.97
194 TestMainNoArgs 0.05
195 TestMinikubeProfile 78.95
198 TestMountStart/serial/StartWithMountFirst 8.2
199 TestMountStart/serial/VerifyMountFirst 0.27
200 TestMountStart/serial/StartWithMountSecond 11.23
201 TestMountStart/serial/VerifyMountSecond 0.28
202 TestMountStart/serial/DeleteFirst 1.49
203 TestMountStart/serial/VerifyMountPostDelete 0.27
204 TestMountStart/serial/Stop 1.2
205 TestMountStart/serial/RestartStopped 8.06
206 TestMountStart/serial/VerifyMountPostStop 0.29
209 TestMultiNode/serial/FreshStart2Nodes 81.84
210 TestMultiNode/serial/DeployApp2Nodes 47.6
211 TestMultiNode/serial/PingHostFrom2Pods 1.13
212 TestMultiNode/serial/AddNode 22.82
213 TestMultiNode/serial/ProfileList 0.43
214 TestMultiNode/serial/CopyFile 10.93
215 TestMultiNode/serial/StopNode 2.46
216 TestMultiNode/serial/StartAfterStop 14.27
217 TestMultiNode/serial/RestartKeepsNodes 126.17
218 TestMultiNode/serial/DeleteNode 5.14
219 TestMultiNode/serial/StopMultiNode 21.79
220 TestMultiNode/serial/RestartMultiNode 90.88
221 TestMultiNode/serial/ValidateNameConflict 40
226 TestPreload 143.43
228 TestScheduledStopUnix 104.14
229 TestSkaffold 109.93
231 TestInsufficientStorage 14.02
234 TestKubernetesUpgrade 212.42
235 TestMissingContainerUpgrade 180.05
237 TestPause/serial/Start 73.91
238 TestPause/serial/SecondStartNoReconfiguration 48.3
239 TestPause/serial/Pause 1.33
240 TestPause/serial/VerifyStatus 0.53
241 TestPause/serial/Unpause 0.86
242 TestPause/serial/PauseAgain 1.19
243 TestPause/serial/DeletePaused 2.68
244 TestPause/serial/VerifyDeletedResources 0.29
245 TestStoppedBinaryUpgrade/Setup 0.96
246 TestStoppedBinaryUpgrade/Upgrade 101.79
247 TestStoppedBinaryUpgrade/MinikubeLogs 2.82
256 TestNoKubernetes/serial/StartNoK8sWithVersion 0.08
257 TestNoKubernetes/serial/StartWithK8s 37.12
258 TestNoKubernetes/serial/StartWithStopK8s 16.49
259 TestNoKubernetes/serial/Start 6.89
260 TestNoKubernetes/serial/VerifyK8sNotRunning 0.28
261 TestNoKubernetes/serial/ProfileList 0.64
262 TestNoKubernetes/serial/Stop 1.23
263 TestNoKubernetes/serial/StartNoArgs 7.77
264 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.27
277 TestStartStop/group/old-k8s-version/serial/FirstStart 137.49
279 TestStartStop/group/no-preload/serial/FirstStart 87.92
280 TestStartStop/group/no-preload/serial/DeployApp 8.56
281 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.97
282 TestStartStop/group/no-preload/serial/Stop 11.07
283 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.16
284 TestStartStop/group/no-preload/serial/SecondStart 346.95
285 TestStartStop/group/old-k8s-version/serial/DeployApp 9.51
286 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.78
287 TestStartStop/group/old-k8s-version/serial/Stop 11.09
288 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.17
289 TestStartStop/group/old-k8s-version/serial/SecondStart 455.88
290 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 13.03
291 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.13
292 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.46
293 TestStartStop/group/no-preload/serial/Pause 3.31
295 TestStartStop/group/embed-certs/serial/FirstStart 69.89
296 TestStartStop/group/embed-certs/serial/DeployApp 9.5
297 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.07
298 TestStartStop/group/embed-certs/serial/Stop 10.96
299 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.17
300 TestStartStop/group/embed-certs/serial/SecondStart 350.52
301 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.03
302 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.15
303 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.38
304 TestStartStop/group/old-k8s-version/serial/Pause 3.21
306 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 63.83
307 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 8.52
308 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1
309 TestStartStop/group/default-k8s-diff-port/serial/Stop 11.07
310 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.18
311 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 360.54
312 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 11.03
313 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.12
314 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.38
315 TestStartStop/group/embed-certs/serial/Pause 3.22
317 TestStartStop/group/newest-cni/serial/FirstStart 49.18
318 TestStartStop/group/newest-cni/serial/DeployApp 0
319 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.34
320 TestStartStop/group/newest-cni/serial/Stop 11.18
321 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.19
322 TestStartStop/group/newest-cni/serial/SecondStart 38.8
323 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
324 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
325 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.58
326 TestStartStop/group/newest-cni/serial/Pause 6.39
327 TestNetworkPlugins/group/auto/Start 69.03
328 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 16.04
329 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.17
330 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.55
331 TestStartStop/group/default-k8s-diff-port/serial/Pause 4.72
332 TestNetworkPlugins/group/kindnet/Start 71.62
333 TestNetworkPlugins/group/auto/KubeletFlags 0.43
334 TestNetworkPlugins/group/auto/NetCatPod 11.55
335 TestNetworkPlugins/group/auto/DNS 0.22
336 TestNetworkPlugins/group/auto/Localhost 0.19
337 TestNetworkPlugins/group/auto/HairPin 0.22
338 TestNetworkPlugins/group/kindnet/ControllerPod 5.05
339 TestNetworkPlugins/group/calico/Start 83.26
340 TestNetworkPlugins/group/kindnet/KubeletFlags 0.38
341 TestNetworkPlugins/group/kindnet/NetCatPod 11.6
342 TestNetworkPlugins/group/kindnet/DNS 0.24
343 TestNetworkPlugins/group/kindnet/Localhost 0.24
344 TestNetworkPlugins/group/kindnet/HairPin 0.25
345 TestNetworkPlugins/group/custom-flannel/Start 73.52
346 TestNetworkPlugins/group/calico/ControllerPod 5.03
347 TestNetworkPlugins/group/calico/KubeletFlags 0.33
348 TestNetworkPlugins/group/calico/NetCatPod 10.52
349 TestNetworkPlugins/group/calico/DNS 0.36
350 TestNetworkPlugins/group/calico/Localhost 0.3
351 TestNetworkPlugins/group/calico/HairPin 0.35
352 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.4
353 TestNetworkPlugins/group/custom-flannel/NetCatPod 12.56
354 TestNetworkPlugins/group/false/Start 58.61
355 TestNetworkPlugins/group/custom-flannel/DNS 0.28
356 TestNetworkPlugins/group/custom-flannel/Localhost 0.25
357 TestNetworkPlugins/group/custom-flannel/HairPin 0.2
358 TestNetworkPlugins/group/enable-default-cni/Start 54.7
359 TestNetworkPlugins/group/false/KubeletFlags 0.52
360 TestNetworkPlugins/group/false/NetCatPod 13.7
361 TestNetworkPlugins/group/false/DNS 0.24
362 TestNetworkPlugins/group/false/Localhost 0.23
363 TestNetworkPlugins/group/false/HairPin 0.21
364 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.42
365 TestNetworkPlugins/group/enable-default-cni/NetCatPod 12.57
366 TestNetworkPlugins/group/enable-default-cni/DNS 0.32
367 TestNetworkPlugins/group/flannel/Start 68.55
368 TestNetworkPlugins/group/enable-default-cni/Localhost 0.22
369 TestNetworkPlugins/group/enable-default-cni/HairPin 0.27
370 TestNetworkPlugins/group/bridge/Start 96.63
371 TestNetworkPlugins/group/flannel/ControllerPod 5.03
372 TestNetworkPlugins/group/flannel/KubeletFlags 0.33
373 TestNetworkPlugins/group/flannel/NetCatPod 11.39
374 TestNetworkPlugins/group/flannel/DNS 0.22
375 TestNetworkPlugins/group/flannel/Localhost 0.2
376 TestNetworkPlugins/group/flannel/HairPin 0.19
377 TestNetworkPlugins/group/kubenet/Start 57.23
378 TestNetworkPlugins/group/bridge/KubeletFlags 0.4
379 TestNetworkPlugins/group/bridge/NetCatPod 11.57
380 TestNetworkPlugins/group/bridge/DNS 0.28
381 TestNetworkPlugins/group/bridge/Localhost 0.27
382 TestNetworkPlugins/group/bridge/HairPin 0.4
383 TestNetworkPlugins/group/kubenet/KubeletFlags 0.34
384 TestNetworkPlugins/group/kubenet/NetCatPod 10.36
385 TestNetworkPlugins/group/kubenet/DNS 0.21
386 TestNetworkPlugins/group/kubenet/Localhost 0.18
387 TestNetworkPlugins/group/kubenet/HairPin 0.2
x
+
TestDownloadOnly/v1.16.0/json-events (35.61s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-515212 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-515212 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker: (35.607017359s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (35.61s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.15s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-515212
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-515212: exit status 85 (153.749169ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-515212 | jenkins | v1.30.1 | 26 Jun 23 18:54 UTC |          |
	|         | -p download-only-515212        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/06/26 18:54:28
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0626 18:54:28.740499  244491 out.go:296] Setting OutFile to fd 1 ...
	I0626 18:54:28.740672  244491 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 18:54:28.740681  244491 out.go:309] Setting ErrFile to fd 2...
	I0626 18:54:28.740686  244491 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 18:54:28.740837  244491 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
	W0626 18:54:28.740963  244491 root.go:312] Error reading config file at /home/jenkins/minikube-integration/16761-239099/.minikube/config/config.json: open /home/jenkins/minikube-integration/16761-239099/.minikube/config/config.json: no such file or directory
	I0626 18:54:28.741373  244491 out.go:303] Setting JSON to true
	I0626 18:54:28.742380  244491 start.go:127] hostinfo: {"hostname":"ip-172-31-21-244","uptime":5817,"bootTime":1687799852,"procs":353,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1038-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0626 18:54:28.742449  244491 start.go:137] virtualization:  
	I0626 18:54:28.745489  244491 out.go:97] [download-only-515212] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0626 18:54:28.747285  244491 out.go:169] MINIKUBE_LOCATION=16761
	W0626 18:54:28.745684  244491 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball: no such file or directory
	I0626 18:54:28.745753  244491 notify.go:220] Checking for updates...
	I0626 18:54:28.750992  244491 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0626 18:54:28.752787  244491 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	I0626 18:54:28.754688  244491 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	I0626 18:54:28.756442  244491 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0626 18:54:28.760083  244491 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0626 18:54:28.760417  244491 driver.go:373] Setting default libvirt URI to qemu:///system
	I0626 18:54:28.783371  244491 docker.go:121] docker version: linux-24.0.2:Docker Engine - Community
	I0626 18:54:28.783454  244491 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 18:54:28.860493  244491 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2023-06-26 18:54:28.849956081 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 18:54:28.860599  244491 docker.go:294] overlay module found
	I0626 18:54:28.862400  244491 out.go:97] Using the docker driver based on user configuration
	I0626 18:54:28.862422  244491 start.go:297] selected driver: docker
	I0626 18:54:28.862428  244491 start.go:954] validating driver "docker" against <nil>
	I0626 18:54:28.862536  244491 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 18:54:28.922706  244491 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2023-06-26 18:54:28.912830388 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 18:54:28.922859  244491 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0626 18:54:28.923138  244491 start_flags.go:382] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0626 18:54:28.923286  244491 start_flags.go:901] Wait components to verify : map[apiserver:true system_pods:true]
	I0626 18:54:28.925151  244491 out.go:169] Using Docker driver with root privileges
	I0626 18:54:28.926956  244491 cni.go:84] Creating CNI manager for ""
	I0626 18:54:28.926981  244491 cni.go:168] CNI unnecessary in this configuration, recommending no CNI
	I0626 18:54:28.926991  244491 start_flags.go:319] config:
	{Name:download-only-515212 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-515212 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 18:54:28.928842  244491 out.go:97] Starting control plane node download-only-515212 in cluster download-only-515212
	I0626 18:54:28.928889  244491 cache.go:122] Beginning downloading kic base image for docker with docker
	I0626 18:54:28.930561  244491 out.go:97] Pulling base image ...
	I0626 18:54:28.930593  244491 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0626 18:54:28.930762  244491 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local docker daemon
	I0626 18:54:28.947475  244491 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 to local cache
	I0626 18:54:28.948157  244491 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local cache directory
	I0626 18:54:28.948271  244491 image.go:118] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 to local cache
	I0626 18:54:29.000796  244491 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I0626 18:54:29.000825  244491 cache.go:57] Caching tarball of preloaded images
	I0626 18:54:29.001459  244491 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0626 18:54:29.003676  244491 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0626 18:54:29.003696  244491 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0626 18:54:29.133445  244491 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I0626 18:54:38.343074  244491 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 as a tarball
	I0626 18:55:01.874024  244491 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0626 18:55:01.874145  244491 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0626 18:55:02.755278  244491 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I0626 18:55:02.755630  244491 profile.go:148] Saving config to /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/download-only-515212/config.json ...
	I0626 18:55:02.755664  244491 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/download-only-515212/config.json: {Name:mk949d810fa4e9bcd90acda676f4d2a052601520 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0626 18:55:02.756383  244491 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0626 18:55:02.756980  244491 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl.sha1 -> /home/jenkins/minikube-integration/16761-239099/.minikube/cache/linux/arm64/v1.16.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-515212"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.15s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/json-events (14.47s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-515212 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-515212 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=docker --driver=docker  --container-runtime=docker: (14.465608062s)
--- PASS: TestDownloadOnly/v1.27.3/json-events (14.47s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/preload-exists
--- PASS: TestDownloadOnly/v1.27.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-515212
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-515212: exit status 85 (68.466872ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-515212 | jenkins | v1.30.1 | 26 Jun 23 18:54 UTC |          |
	|         | -p download-only-515212        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-515212 | jenkins | v1.30.1 | 26 Jun 23 18:55 UTC |          |
	|         | -p download-only-515212        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.27.3   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/06/26 18:55:04
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0626 18:55:04.503614  244567 out.go:296] Setting OutFile to fd 1 ...
	I0626 18:55:04.503780  244567 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 18:55:04.503787  244567 out.go:309] Setting ErrFile to fd 2...
	I0626 18:55:04.503793  244567 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 18:55:04.503933  244567 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
	W0626 18:55:04.504049  244567 root.go:312] Error reading config file at /home/jenkins/minikube-integration/16761-239099/.minikube/config/config.json: open /home/jenkins/minikube-integration/16761-239099/.minikube/config/config.json: no such file or directory
	I0626 18:55:04.504256  244567 out.go:303] Setting JSON to true
	I0626 18:55:04.505273  244567 start.go:127] hostinfo: {"hostname":"ip-172-31-21-244","uptime":5853,"bootTime":1687799852,"procs":351,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1038-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0626 18:55:04.505362  244567 start.go:137] virtualization:  
	I0626 18:55:04.512645  244567 out.go:97] [download-only-515212] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0626 18:55:04.512955  244567 notify.go:220] Checking for updates...
	I0626 18:55:04.522521  244567 out.go:169] MINIKUBE_LOCATION=16761
	I0626 18:55:04.533846  244567 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0626 18:55:04.547346  244567 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	I0626 18:55:04.595854  244567 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	I0626 18:55:04.628285  244567 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0626 18:55:04.676780  244567 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0626 18:55:04.677304  244567 config.go:182] Loaded profile config "download-only-515212": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W0626 18:55:04.677369  244567 start.go:862] api.Load failed for download-only-515212: filestore "download-only-515212": Docker machine "download-only-515212" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0626 18:55:04.677519  244567 driver.go:373] Setting default libvirt URI to qemu:///system
	W0626 18:55:04.677548  244567 start.go:862] api.Load failed for download-only-515212: filestore "download-only-515212": Docker machine "download-only-515212" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0626 18:55:04.701179  244567 docker.go:121] docker version: linux-24.0.2:Docker Engine - Community
	I0626 18:55:04.701263  244567 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 18:55:04.769019  244567 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-06-26 18:55:04.759315523 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 18:55:04.769123  244567 docker.go:294] overlay module found
	I0626 18:55:04.788651  244567 out.go:97] Using the docker driver based on existing profile
	I0626 18:55:04.788701  244567 start.go:297] selected driver: docker
	I0626 18:55:04.788709  244567 start.go:954] validating driver "docker" against &{Name:download-only-515212 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-515212 Namespace:default APIServerName:
minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:
SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 18:55:04.788901  244567 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 18:55:04.852620  244567 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-06-26 18:55:04.842337712 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 18:55:04.853179  244567 cni.go:84] Creating CNI manager for ""
	I0626 18:55:04.853201  244567 cni.go:149] "docker" driver + "docker" runtime found, recommending kindnet
	I0626 18:55:04.853219  244567 start_flags.go:319] config:
	{Name:download-only-515212 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:download-only-515212 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 18:55:04.868183  244567 out.go:97] Starting control plane node download-only-515212 in cluster download-only-515212
	I0626 18:55:04.868244  244567 cache.go:122] Beginning downloading kic base image for docker with docker
	I0626 18:55:04.900501  244567 out.go:97] Pulling base image ...
	I0626 18:55:04.900538  244567 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0626 18:55:04.900726  244567 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local docker daemon
	I0626 18:55:04.919189  244567 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 to local cache
	I0626 18:55:04.919299  244567 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local cache directory
	I0626 18:55:04.919327  244567 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 in local cache directory, skipping pull
	I0626 18:55:04.919338  244567 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 exists in cache, skipping pull
	I0626 18:55:04.919350  244567 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 as a tarball
	I0626 18:55:04.963542  244567 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	I0626 18:55:04.963571  244567 cache.go:57] Caching tarball of preloaded images
	I0626 18:55:04.963712  244567 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0626 18:55:05.013613  244567 out.go:97] Downloading Kubernetes v1.27.3 preload ...
	I0626 18:55:05.013671  244567 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4 ...
	I0626 18:55:05.135262  244567 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4?checksum=md5:e061b1178966dc348ac19219444153f4 -> /home/jenkins/minikube-integration/16761-239099/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-515212"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.27.3/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.23s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:187: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.23s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.14s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:199: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-515212
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.14s)

                                                
                                    
x
+
TestBinaryMirror (0.6s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:304: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-790182 --alsologtostderr --binary-mirror http://127.0.0.1:45983 --driver=docker  --container-runtime=docker
helpers_test.go:175: Cleaning up "binary-mirror-790182" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-790182
--- PASS: TestBinaryMirror (0.60s)

                                                
                                    
x
+
TestOffline (76.21s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-arm64 start -p offline-docker-801926 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-arm64 start -p offline-docker-801926 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker: (1m13.803763065s)
helpers_test.go:175: Cleaning up "offline-docker-801926" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p offline-docker-801926
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p offline-docker-801926: (2.407227631s)
--- PASS: TestOffline (76.21s)

                                                
                                    
x
+
TestAddons/Setup (143.96s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:88: (dbg) Run:  out/minikube-linux-arm64 start -p addons-963360 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns
addons_test.go:88: (dbg) Done: out/minikube-linux-arm64 start -p addons-963360 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns: (2m23.957984796s)
--- PASS: TestAddons/Setup (143.96s)

                                                
                                    
x
+
TestAddons/parallel/Registry (14.79s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:306: registry stabilized in 34.518092ms
addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-kcrl6" [ecfe2e2c-43c4-42a9-a979-167fe22f5d47] Running
addons_test.go:308: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.0258881s
addons_test.go:311: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-2n5gs" [da693eb2-5172-48f3-919d-332ab16d60f1] Running
addons_test.go:311: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.010773455s
addons_test.go:316: (dbg) Run:  kubectl --context addons-963360 delete po -l run=registry-test --now
addons_test.go:321: (dbg) Run:  kubectl --context addons-963360 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:321: (dbg) Done: kubectl --context addons-963360 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.851177029s)
addons_test.go:335: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 ip
2023/06/26 18:57:58 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (14.79s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.87s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-kfp6g" [cec47e93-6836-4f62-9615-6a52267793c4] Running
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.008145226s
addons_test.go:817: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-963360
addons_test.go:817: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-963360: (5.857068161s)
--- PASS: TestAddons/parallel/InspektorGadget (10.87s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.75s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:383: metrics-server stabilized in 3.644069ms
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-844d8db974-zkzdr" [e7bcd344-88b7-4e24-8fd2-b1fe95144127] Running
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.0085447s
addons_test.go:391: (dbg) Run:  kubectl --context addons-963360 top pods -n kube-system
addons_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.75s)

                                                
                                    
x
+
TestAddons/parallel/CSI (58.95s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:537: csi-hostpath-driver pods stabilized in 5.459867ms
addons_test.go:540: (dbg) Run:  kubectl --context addons-963360 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:550: (dbg) Run:  kubectl --context addons-963360 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:550: (dbg) Done: kubectl --context addons-963360 create -f testdata/csi-hostpath-driver/pv-pod.yaml: (1.041513909s)
addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [4acee710-0317-451e-b27e-38cf2e42879e] Pending
helpers_test.go:344: "task-pv-pod" [4acee710-0317-451e-b27e-38cf2e42879e] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [4acee710-0317-451e-b27e-38cf2e42879e] Running
addons_test.go:555: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.02524235s
addons_test.go:560: (dbg) Run:  kubectl --context addons-963360 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-963360 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-963360 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:570: (dbg) Run:  kubectl --context addons-963360 delete pod task-pv-pod
addons_test.go:570: (dbg) Done: kubectl --context addons-963360 delete pod task-pv-pod: (1.24268854s)
addons_test.go:576: (dbg) Run:  kubectl --context addons-963360 delete pvc hpvc
addons_test.go:582: (dbg) Run:  kubectl --context addons-963360 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:587: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-963360 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:592: (dbg) Run:  kubectl --context addons-963360 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:597: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [affe904d-ad0f-44a1-a960-1f0a20cc1fc2] Pending
helpers_test.go:344: "task-pv-pod-restore" [affe904d-ad0f-44a1-a960-1f0a20cc1fc2] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [affe904d-ad0f-44a1-a960-1f0a20cc1fc2] Running
addons_test.go:597: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.024094003s
addons_test.go:602: (dbg) Run:  kubectl --context addons-963360 delete pod task-pv-pod-restore
addons_test.go:606: (dbg) Run:  kubectl --context addons-963360 delete pvc hpvc-restore
addons_test.go:610: (dbg) Run:  kubectl --context addons-963360 delete volumesnapshot new-snapshot-demo
addons_test.go:614: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:614: (dbg) Done: out/minikube-linux-arm64 -p addons-963360 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.589380298s)
addons_test.go:618: (dbg) Run:  out/minikube-linux-arm64 -p addons-963360 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:618: (dbg) Done: out/minikube-linux-arm64 -p addons-963360 addons disable volumesnapshots --alsologtostderr -v=1: (1.00878318s)
--- PASS: TestAddons/parallel/CSI (58.95s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (11.53s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:800: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-963360 --alsologtostderr -v=1
addons_test.go:800: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-963360 --alsologtostderr -v=1: (1.508119329s)
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-66f6498c69-qp8sm" [b23877e6-6806-4761-ad64-8ff7f3a749bc] Pending
helpers_test.go:344: "headlamp-66f6498c69-qp8sm" [b23877e6-6806-4761-ad64-8ff7f3a749bc] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-66f6498c69-qp8sm" [b23877e6-6806-4761-ad64-8ff7f3a749bc] Running
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.019204102s
--- PASS: TestAddons/parallel/Headlamp (11.53s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.52s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-fb67554b8-lmlgq" [4a118603-8c05-416e-8055-8b862746c16b] Running
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.016285963s
addons_test.go:836: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-963360
--- PASS: TestAddons/parallel/CloudSpanner (5.52s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:626: (dbg) Run:  kubectl --context addons-963360 create ns new-namespace
addons_test.go:640: (dbg) Run:  kubectl --context addons-963360 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (11.01s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:148: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-963360
addons_test.go:148: (dbg) Done: out/minikube-linux-arm64 stop -p addons-963360: (10.794624195s)
addons_test.go:152: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-963360
addons_test.go:156: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-963360
addons_test.go:161: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-963360
--- PASS: TestAddons/StoppedEnableDisable (11.01s)

                                                
                                    
x
+
TestCertOptions (47.21s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-267434 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-267434 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker: (43.347603324s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-267434 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-267434 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-267434 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-267434" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-267434
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-267434: (2.945618036s)
--- PASS: TestCertOptions (47.21s)

                                                
                                    
x
+
TestCertExpiration (249.1s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-398972 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker
E0626 19:36:13.526161  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-398972 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker: (34.746156694s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-398972 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-398972 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker: (31.945703543s)
helpers_test.go:175: Cleaning up "cert-expiration-398972" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-398972
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-398972: (2.408393069s)
--- PASS: TestCertExpiration (249.10s)

                                                
                                    
x
+
TestDockerFlags (47.69s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:45: (dbg) Run:  out/minikube-linux-arm64 start -p docker-flags-942769 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:45: (dbg) Done: out/minikube-linux-arm64 start -p docker-flags-942769 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (44.539999527s)
docker_test.go:50: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-942769 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:61: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-942769 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
helpers_test.go:175: Cleaning up "docker-flags-942769" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-flags-942769
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-flags-942769: (2.386171779s)
--- PASS: TestDockerFlags (47.69s)

                                                
                                    
x
+
TestForceSystemdFlag (40.68s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-586263 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-586263 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (38.047676153s)
docker_test.go:104: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-586263 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-flag-586263" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-586263
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-586263: (2.206585675s)
--- PASS: TestForceSystemdFlag (40.68s)

                                                
                                    
x
+
TestForceSystemdEnv (36.97s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:149: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-222036 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E0626 19:35:47.613418  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
docker_test.go:149: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-222036 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (34.520691074s)
docker_test.go:104: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-222036 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-env-222036" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-222036
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-222036: (2.110868603s)
--- PASS: TestForceSystemdEnv (36.97s)

                                                
                                    
x
+
TestErrorSpam/setup (35.33s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-557376 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-557376 --driver=docker  --container-runtime=docker
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-557376 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-557376 --driver=docker  --container-runtime=docker: (35.330484687s)
--- PASS: TestErrorSpam/setup (35.33s)

                                                
                                    
x
+
TestErrorSpam/start (0.77s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 start --dry-run
--- PASS: TestErrorSpam/start (0.77s)

                                                
                                    
x
+
TestErrorSpam/status (1.08s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 status
--- PASS: TestErrorSpam/status (1.08s)

                                                
                                    
x
+
TestErrorSpam/pause (1.41s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 pause
--- PASS: TestErrorSpam/pause (1.41s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.57s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 unpause
--- PASS: TestErrorSpam/unpause (1.57s)

                                                
                                    
x
+
TestErrorSpam/stop (2.06s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 stop: (1.861747477s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-557376 --log_dir /tmp/nospam-557376 stop
--- PASS: TestErrorSpam/stop (2.06s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/16761-239099/.minikube/files/etc/test/nested/copy/244486/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (62.67s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-453313 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-453313 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker: (1m2.66594156s)
--- PASS: TestFunctional/serial/StartWithProxy (62.67s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (36.8s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-453313 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-453313 --alsologtostderr -v=8: (36.79698708s)
functional_test.go:659: soft start took 36.798135192s for "functional-453313" cluster.
--- PASS: TestFunctional/serial/SoftStart (36.80s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.06s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-453313 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.10s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.26s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 cache add registry.k8s.io/pause:3.1: (1.022068024s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 cache add registry.k8s.io/pause:3.3: (1.358815028s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.26s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (0.95s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-453313 /tmp/TestFunctionalserialCacheCmdcacheadd_local4270175022/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 cache add minikube-local-cache-test:functional-453313
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 cache delete minikube-local-cache-test:functional-453313
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-453313
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (0.95s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.34s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.34s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.81s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (341.596911ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.81s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.16s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 kubectl -- --context functional-453313 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.16s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.15s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-453313 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.15s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (42.5s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-453313 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-453313 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (42.502208625s)
functional_test.go:757: restart took 42.502303392s for "functional-453313" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (42.50s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-453313 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.10s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.38s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 logs
E0626 19:02:44.567613  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:02:44.573271  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:02:44.583526  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:02:44.603713  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:02:44.644591  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:02:44.725072  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 logs: (1.375330369s)
--- PASS: TestFunctional/serial/LogsCmd (1.38s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.43s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 logs --file /tmp/TestFunctionalserialLogsFileCmd1649362584/001/logs.txt
E0626 19:02:44.885565  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:02:45.206068  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:02:45.846717  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 logs --file /tmp/TestFunctionalserialLogsFileCmd1649362584/001/logs.txt: (1.43180898s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.43s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.95s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-453313 apply -f testdata/invalidsvc.yaml
E0626 19:02:47.127688  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-453313
E0626 19:02:49.688386  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-453313: exit status 115 (538.803406ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30199 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-453313 delete -f testdata/invalidsvc.yaml
functional_test.go:2323: (dbg) Done: kubectl --context functional-453313 delete -f testdata/invalidsvc.yaml: (1.065530862s)
--- PASS: TestFunctional/serial/InvalidService (4.95s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 config get cpus: exit status 14 (76.587858ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 config get cpus: exit status 14 (64.523728ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (8.96s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-453313 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-453313 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 284219: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (8.96s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-453313 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-453313 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (199.849477ms)

                                                
                                                
-- stdout --
	* [functional-453313] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16761
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0626 19:03:41.623494  283847 out.go:296] Setting OutFile to fd 1 ...
	I0626 19:03:41.623740  283847 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:03:41.623768  283847 out.go:309] Setting ErrFile to fd 2...
	I0626 19:03:41.623789  283847 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:03:41.623954  283847 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
	I0626 19:03:41.624336  283847 out.go:303] Setting JSON to false
	I0626 19:03:41.625545  283847 start.go:127] hostinfo: {"hostname":"ip-172-31-21-244","uptime":6370,"bootTime":1687799852,"procs":285,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1038-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0626 19:03:41.625652  283847 start.go:137] virtualization:  
	I0626 19:03:41.628551  283847 out.go:177] * [functional-453313] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0626 19:03:41.630762  283847 out.go:177]   - MINIKUBE_LOCATION=16761
	I0626 19:03:41.630834  283847 notify.go:220] Checking for updates...
	I0626 19:03:41.633391  283847 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0626 19:03:41.635532  283847 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	I0626 19:03:41.637224  283847 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	I0626 19:03:41.638846  283847 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0626 19:03:41.640469  283847 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0626 19:03:41.642708  283847 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0626 19:03:41.643309  283847 driver.go:373] Setting default libvirt URI to qemu:///system
	I0626 19:03:41.668244  283847 docker.go:121] docker version: linux-24.0.2:Docker Engine - Community
	I0626 19:03:41.668351  283847 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 19:03:41.758978  283847 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-06-26 19:03:41.74922422 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 19:03:41.759082  283847 docker.go:294] overlay module found
	I0626 19:03:41.761240  283847 out.go:177] * Using the docker driver based on existing profile
	I0626 19:03:41.763117  283847 start.go:297] selected driver: docker
	I0626 19:03:41.763142  283847 start.go:954] validating driver "docker" against &{Name:functional-453313 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-453313 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p200
0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 19:03:41.763256  283847 start.go:965] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0626 19:03:41.765780  283847 out.go:177] 
	W0626 19:03:41.767523  283847 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0626 19:03:41.769139  283847 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-453313 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
--- PASS: TestFunctional/parallel/DryRun (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-453313 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-453313 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (312.597982ms)

                                                
                                                
-- stdout --
	* [functional-453313] minikube v1.30.1 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16761
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0626 19:03:42.106283  283962 out.go:296] Setting OutFile to fd 1 ...
	I0626 19:03:42.106477  283962 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:03:42.106486  283962 out.go:309] Setting ErrFile to fd 2...
	I0626 19:03:42.106493  283962 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:03:42.106762  283962 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
	I0626 19:03:42.107211  283962 out.go:303] Setting JSON to false
	I0626 19:03:42.108545  283962 start.go:127] hostinfo: {"hostname":"ip-172-31-21-244","uptime":6370,"bootTime":1687799852,"procs":287,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1038-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0626 19:03:42.108639  283962 start.go:137] virtualization:  
	I0626 19:03:42.112234  283962 out.go:177] * [functional-453313] minikube v1.30.1 sur Ubuntu 20.04 (arm64)
	I0626 19:03:42.113912  283962 out.go:177]   - MINIKUBE_LOCATION=16761
	I0626 19:03:42.115712  283962 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0626 19:03:42.114028  283962 notify.go:220] Checking for updates...
	I0626 19:03:42.120271  283962 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	I0626 19:03:42.123063  283962 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	I0626 19:03:42.125171  283962 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0626 19:03:42.127158  283962 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0626 19:03:42.129460  283962 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0626 19:03:42.130036  283962 driver.go:373] Setting default libvirt URI to qemu:///system
	I0626 19:03:42.211372  283962 docker.go:121] docker version: linux-24.0.2:Docker Engine - Community
	I0626 19:03:42.211524  283962 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 19:03:42.324388  283962 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-06-26 19:03:42.313909137 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 19:03:42.324506  283962 docker.go:294] overlay module found
	I0626 19:03:42.327316  283962 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0626 19:03:42.328914  283962 start.go:297] selected driver: docker
	I0626 19:03:42.328935  283962 start.go:954] validating driver "docker" against &{Name:functional-453313 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1687538068-16731@sha256:d08658afefe15fb29b5fcdace4d88182b61941d4fc6089c962f9de20073de953 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-453313 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p200
0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0626 19:03:42.329083  283962 start.go:965] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0626 19:03:42.331711  283962 out.go:177] 
	W0626 19:03:42.333370  283962 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0626 19:03:42.334898  283962 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.08s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (7.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-453313 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-453313 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-58d66798bb-w5gjh" [c1bc2ac3-2de7-4fec-a064-3f58762d31c5] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-58d66798bb-w5gjh" [c1bc2ac3-2de7-4fec-a064-3f58762d31c5] Running
E0626 19:03:25.530223  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 7.01087194s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:30213
functional_test.go:1674: http://192.168.49.2:30213: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-58d66798bb-w5gjh

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:30213
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (7.68s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (27.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [96e0a20d-cff3-4927-a159-28b5bb7e468e] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.009814319s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-453313 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-453313 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-453313 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-453313 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [b18a085a-8cb6-4134-a188-c95c36687ee6] Pending
helpers_test.go:344: "sp-pod" [b18a085a-8cb6-4134-a188-c95c36687ee6] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [b18a085a-8cb6-4134-a188-c95c36687ee6] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 12.013914362s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-453313 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-453313 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-453313 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [87da7674-c3d8-40d3-9cb5-ca9b4c9cbcd3] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [87da7674-c3d8-40d3-9cb5-ca9b4c9cbcd3] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 8.009118177s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-453313 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (27.33s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh -n functional-453313 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 cp functional-453313:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd1580108014/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh -n functional-453313 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.38s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/244486/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo cat /etc/test/nested/copy/244486/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/244486.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo cat /etc/ssl/certs/244486.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/244486.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo cat /usr/share/ca-certificates/244486.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo cat /etc/ssl/certs/51391683.0"
E0626 19:02:54.809070  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
functional_test.go:1995: Checking for existence of /etc/ssl/certs/2444862.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo cat /etc/ssl/certs/2444862.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/2444862.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo cat /usr/share/ca-certificates/2444862.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.26s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-453313 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "sudo systemctl is-active crio": exit status 1 (439.292499ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.44s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.44s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 version --short
--- PASS: TestFunctional/parallel/Version/short (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.6s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.60s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-453313 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.27.3
registry.k8s.io/kube-proxy:v1.27.3
registry.k8s.io/kube-controller-manager:v1.27.3
registry.k8s.io/kube-apiserver:v1.27.3
registry.k8s.io/etcd:3.5.7-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-453313
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-453313
docker.io/kubernetesui/metrics-scraper:<none>
docker.io/kubernetesui/dashboard:<none>
docker.io/kindest/kindnetd:v20230511-dc714da8
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-453313 image ls --format short --alsologtostderr:
I0626 19:03:52.469381  284982 out.go:296] Setting OutFile to fd 1 ...
I0626 19:03:52.469632  284982 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:52.469664  284982 out.go:309] Setting ErrFile to fd 2...
I0626 19:03:52.469685  284982 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:52.469879  284982 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
I0626 19:03:52.470506  284982 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:52.470669  284982 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:52.471175  284982 cli_runner.go:164] Run: docker container inspect functional-453313 --format={{.State.Status}}
I0626 19:03:52.496374  284982 ssh_runner.go:195] Run: systemctl --version
I0626 19:03:52.496429  284982 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-453313
I0626 19:03:52.524003  284982 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/functional-453313/id_rsa Username:docker}
I0626 19:03:52.620856  284982 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-453313 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/kube-scheduler              | v1.27.3            | bcb9e554eaab6 | 56.2MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | ba04bb24b9575 | 29MB   |
| registry.k8s.io/pause                       | 3.3                | 3d18732f8686c | 484kB  |
| registry.k8s.io/pause                       | 3.1                | 8057e0500773a | 525kB  |
| registry.k8s.io/pause                       | latest             | 8cb2091f603e7 | 240kB  |
| docker.io/library/minikube-local-cache-test | functional-453313  | 21b1bd24e0ad8 | 30B    |
| docker.io/kindest/kindnetd                  | v20230511-dc714da8 | b18bf71b941ba | 59.2MB |
| gcr.io/google-containers/addon-resizer      | functional-453313  | ffd4cfbbe753e | 32.9MB |
| registry.k8s.io/kube-apiserver              | v1.27.3            | 39dfb036b0986 | 115MB  |
| docker.io/library/nginx                     | latest             | 2d21d843073b4 | 192MB  |
| registry.k8s.io/etcd                        | 3.5.7-0            | 24bc64e911039 | 181MB  |
| docker.io/kubernetesui/metrics-scraper      | <none>             | a422e0e982356 | 42.3MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | 1611cd07b61d5 | 3.55MB |
| docker.io/localhost/my-image                | functional-453313  | ec0d92667c848 | 1.41MB |
| registry.k8s.io/kube-proxy                  | v1.27.3            | fb73e92641fd5 | 66.5MB |
| registry.k8s.io/kube-controller-manager     | v1.27.3            | ab3683b584ae5 | 107MB  |
| registry.k8s.io/coredns/coredns             | v1.10.1            | 97e04611ad434 | 51.4MB |
| registry.k8s.io/pause                       | 3.9                | 829e9de338bd5 | 514kB  |
| docker.io/kubernetesui/dashboard            | <none>             | 20b332c9a70d8 | 244MB  |
| registry.k8s.io/echoserver-arm              | 1.8                | 72565bf5bbedf | 85MB   |
| docker.io/library/nginx                     | alpine             | 66bf2c914bf4d | 41MB   |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-453313 image ls --format table --alsologtostderr:
I0626 19:03:56.216171  285857 out.go:296] Setting OutFile to fd 1 ...
I0626 19:03:56.216402  285857 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:56.216412  285857 out.go:309] Setting ErrFile to fd 2...
I0626 19:03:56.216418  285857 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:56.216621  285857 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
I0626 19:03:56.217708  285857 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:56.217855  285857 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:56.218423  285857 cli_runner.go:164] Run: docker container inspect functional-453313 --format={{.State.Status}}
I0626 19:03:56.244330  285857 ssh_runner.go:195] Run: systemctl --version
I0626 19:03:56.244395  285857 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-453313
I0626 19:03:56.264248  285857 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/functional-453313/id_rsa Username:docker}
I0626 19:03:56.364308  285857 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-453313 image ls --format json --alsologtostderr:
[{"id":"ec0d92667c8486221721d706372f3550461eef2689c413eb8882c187b82907be","repoDigests":[],"repoTags":["docker.io/localhost/my-image:functional-453313"],"size":"1410000"},{"id":"fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a","repoDigests":[],"repoTags":["registry.k8s.io/kube-proxy:v1.27.3"],"size":"66500000"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29000000"},{"id":"39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473","repoDigests":[],"repoTags":["registry.k8s.io/kube-apiserver:v1.27.3"],"size":"115000000"},{"id":"bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540","repoDigests":[],"repoTags":["registry.k8s.io/kube-scheduler:v1.27.3"],"size":"56200000"},{"id":"2d21d843073b4df6a03022861da4cb59f7116c864fe90b3b5db3b90e1ce932d3","repoDigests":[],"repoTags":["docker.io/library/nginx:latest"],"size":"192000000"},{"id":"24bc64e911039ecf00e263be21617
97c758b7d82403ca5516ab64047a477f737","repoDigests":[],"repoTags":["registry.k8s.io/etcd:3.5.7-0"],"size":"181000000"},{"id":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":[],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"51400000"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"484000"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3550000"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-453313"],"size":"32900000"},{"id":"21b1bd24e0ad86c1a550e363830d818c75bbb47f1d0c4f7340efcc75fda53032","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-453313"],"size":"30"},{"id":"66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6
ea","repoDigests":[],"repoTags":["docker.io/library/nginx:alpine"],"size":"41000000"},{"id":"ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8","repoDigests":[],"repoTags":["registry.k8s.io/kube-controller-manager:v1.27.3"],"size":"107000000"},{"id":"b18bf71b941bae2e12db1c07e567ad14e4febbc778310a0fc64487f1ac877d79","repoDigests":[],"repoTags":["docker.io/kindest/kindnetd:v20230511-dc714da8"],"size":"59200000"},{"id":"829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.9"],"size":"514000"},{"id":"20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":[],"repoTags":["docker.io/kubernetesui/dashboard:\u003cnone\u003e"],"size":"244000000"},{"id":"a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":[],"repoTags":["docker.io/kubernetesui/metrics-scraper:\u003cnone\u003e"],"size":"42300000"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"r
epoTags":["registry.k8s.io/pause:3.1"],"size":"525000"},{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":[],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"85000000"},{"id":"8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"240000"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-453313 image ls --format json --alsologtostderr:
I0626 19:03:55.906384  285802 out.go:296] Setting OutFile to fd 1 ...
I0626 19:03:55.907607  285802 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:55.907722  285802 out.go:309] Setting ErrFile to fd 2...
I0626 19:03:55.907765  285802 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:55.908016  285802 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
I0626 19:03:55.908890  285802 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:55.909126  285802 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:55.909883  285802 cli_runner.go:164] Run: docker container inspect functional-453313 --format={{.State.Status}}
I0626 19:03:55.931691  285802 ssh_runner.go:195] Run: systemctl --version
I0626 19:03:55.931746  285802 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-453313
I0626 19:03:55.954963  285802 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/functional-453313/id_rsa Username:docker}
I0626 19:03:56.064281  285802 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-453313 image ls --format yaml --alsologtostderr:
- id: bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540
repoDigests: []
repoTags:
- registry.k8s.io/kube-scheduler:v1.27.3
size: "56200000"
- id: b18bf71b941bae2e12db1c07e567ad14e4febbc778310a0fc64487f1ac877d79
repoDigests: []
repoTags:
- docker.io/kindest/kindnetd:v20230511-dc714da8
size: "59200000"
- id: 829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.9
size: "514000"
- id: a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests: []
repoTags:
- docker.io/kubernetesui/metrics-scraper:<none>
size: "42300000"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests: []
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "85000000"
- id: 39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473
repoDigests: []
repoTags:
- registry.k8s.io/kube-apiserver:v1.27.3
size: "115000000"
- id: 24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737
repoDigests: []
repoTags:
- registry.k8s.io/etcd:3.5.7-0
size: "181000000"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29000000"
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-453313
size: "32900000"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "525000"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "240000"
- id: fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a
repoDigests: []
repoTags:
- registry.k8s.io/kube-proxy:v1.27.3
size: "66500000"
- id: 97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests: []
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "51400000"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "484000"
- id: 66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea
repoDigests: []
repoTags:
- docker.io/library/nginx:alpine
size: "41000000"
- id: ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8
repoDigests: []
repoTags:
- registry.k8s.io/kube-controller-manager:v1.27.3
size: "107000000"
- id: 2d21d843073b4df6a03022861da4cb59f7116c864fe90b3b5db3b90e1ce932d3
repoDigests: []
repoTags:
- docker.io/library/nginx:latest
size: "192000000"
- id: 20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests: []
repoTags:
- docker.io/kubernetesui/dashboard:<none>
size: "244000000"
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3550000"
- id: 21b1bd24e0ad86c1a550e363830d818c75bbb47f1d0c4f7340efcc75fda53032
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-453313
size: "30"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-453313 image ls --format yaml --alsologtostderr:
I0626 19:03:52.766925  285055 out.go:296] Setting OutFile to fd 1 ...
I0626 19:03:52.767121  285055 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:52.767132  285055 out.go:309] Setting ErrFile to fd 2...
I0626 19:03:52.767138  285055 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:52.767332  285055 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
I0626 19:03:52.767976  285055 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:52.768135  285055 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:52.768647  285055 cli_runner.go:164] Run: docker container inspect functional-453313 --format={{.State.Status}}
I0626 19:03:52.786537  285055 ssh_runner.go:195] Run: systemctl --version
I0626 19:03:52.786587  285055 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-453313
I0626 19:03:52.815376  285055 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/functional-453313/id_rsa Username:docker}
I0626 19:03:52.910928  285055 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (2.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh pgrep buildkitd: exit status 1 (394.376974ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image build -t localhost/my-image:functional-453313 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 image build -t localhost/my-image:functional-453313 testdata/build --alsologtostderr: (2.206492911s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-453313 image build -t localhost/my-image:functional-453313 testdata/build --alsologtostderr:
I0626 19:03:53.422515  285219 out.go:296] Setting OutFile to fd 1 ...
I0626 19:03:53.423037  285219 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:53.423049  285219 out.go:309] Setting ErrFile to fd 2...
I0626 19:03:53.423056  285219 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0626 19:03:53.423220  285219 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
I0626 19:03:53.423827  285219 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:53.424505  285219 config.go:182] Loaded profile config "functional-453313": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0626 19:03:53.425177  285219 cli_runner.go:164] Run: docker container inspect functional-453313 --format={{.State.Status}}
I0626 19:03:53.454902  285219 ssh_runner.go:195] Run: systemctl --version
I0626 19:03:53.454947  285219 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-453313
I0626 19:03:53.477592  285219 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33083 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/functional-453313/id_rsa Username:docker}
I0626 19:03:53.574881  285219 build_images.go:151] Building image from path: /tmp/build.1827768933.tar
I0626 19:03:53.574947  285219 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0626 19:03:53.585958  285219 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.1827768933.tar
I0626 19:03:53.590473  285219 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.1827768933.tar: stat -c "%s %y" /var/lib/minikube/build/build.1827768933.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.1827768933.tar': No such file or directory
I0626 19:03:53.590507  285219 ssh_runner.go:362] scp /tmp/build.1827768933.tar --> /var/lib/minikube/build/build.1827768933.tar (3072 bytes)
I0626 19:03:53.619715  285219 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.1827768933
I0626 19:03:53.630348  285219 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.1827768933 -xf /var/lib/minikube/build/build.1827768933.tar
I0626 19:03:53.641893  285219 docker.go:339] Building image: /var/lib/minikube/build/build.1827768933
I0626 19:03:53.641965  285219 ssh_runner.go:195] Run: docker build -t localhost/my-image:functional-453313 /var/lib/minikube/build/build.1827768933
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.7s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 770B / 770B done
#5 sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9 527B / 527B done
#5 sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02 1.47kB / 1.47kB done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.2s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.0s done
#5 DONE 0.3s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.3s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.0s done
#8 writing image sha256:ec0d92667c8486221721d706372f3550461eef2689c413eb8882c187b82907be done
#8 naming to localhost/my-image:functional-453313 done
#8 DONE 0.1s
I0626 19:03:55.520535  285219 ssh_runner.go:235] Completed: docker build -t localhost/my-image:functional-453313 /var/lib/minikube/build/build.1827768933: (1.878519363s)
I0626 19:03:55.520608  285219 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.1827768933
I0626 19:03:55.534497  285219 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.1827768933.tar
I0626 19:03:55.551925  285219 build_images.go:207] Built localhost/my-image:functional-453313 from /tmp/build.1827768933.tar
I0626 19:03:55.551951  285219 build_images.go:123] succeeded building to: functional-453313
I0626 19:03:55.551956  285219 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (2.87s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (2.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.090644134s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-453313
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.12s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (1.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-453313 docker-env) && out/minikube-linux-arm64 status -p functional-453313"
functional_test.go:518: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-453313 docker-env) && docker images"
--- PASS: TestFunctional/parallel/DockerEnv/bash (1.23s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image load --daemon gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 image load --daemon gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr: (4.244441312s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.50s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (11.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-453313 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-453313 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-7b684b55f9-jf996" [dde38db7-0973-43fe-95e0-0875f4e5ea11] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-7b684b55f9-jf996" [dde38db7-0973-43fe-95e0-0875f4e5ea11] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 11.029214391s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (11.32s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.94s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image load --daemon gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 image load --daemon gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr: (2.721235173s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.94s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.848826016s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-453313
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image load --daemon gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr
E0626 19:03:05.049261  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 image load --daemon gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr: (3.210326595s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.30s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image save gcr.io/google-containers/addon-resizer:functional-453313 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:379: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 image save gcr.io/google-containers/addon-resizer:functional-453313 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.051290136s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.05s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.58s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image rm gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.57s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 service list -o json
functional_test.go:1493: Took "472.607928ms" to run "out/minikube-linux-arm64 -p functional-453313 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.52s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.49.2:31955
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.52s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:408: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.403293162s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.70s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.52s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:31955
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.52s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (3.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-453313
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 image save --daemon gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr
functional_test.go:423: (dbg) Done: out/minikube-linux-arm64 -p functional-453313 image save --daemon gcr.io/google-containers/addon-resizer:functional-453313 --alsologtostderr: (3.437895128s)
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-453313
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (3.49s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.75s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-453313 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-453313 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-453313 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-453313 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 281136: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.75s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-453313 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-453313 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [c21ade78-bafa-4d31-8633-34d444e1e6e3] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [c21ade78-bafa-4d31-8633-34d444e1e6e3] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 10.00804534s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.58s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-453313 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.109.34.207 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-453313 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1314: Took "438.522172ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1328: Took "59.537598ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1365: Took "369.55091ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1378: Took "106.297963ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (6.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdany-port2691929147/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1687806213229294327" to /tmp/TestFunctionalparallelMountCmdany-port2691929147/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1687806213229294327" to /tmp/TestFunctionalparallelMountCmdany-port2691929147/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1687806213229294327" to /tmp/TestFunctionalparallelMountCmdany-port2691929147/001/test-1687806213229294327
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jun 26 19:03 created-by-test
-rw-r--r-- 1 docker docker 24 Jun 26 19:03 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jun 26 19:03 test-1687806213229294327
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh cat /mount-9p/test-1687806213229294327
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-453313 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [5455f3ab-8974-4da4-ae78-6d72a722ba5b] Pending
helpers_test.go:344: "busybox-mount" [5455f3ab-8974-4da4-ae78-6d72a722ba5b] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [5455f3ab-8974-4da4-ae78-6d72a722ba5b] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [5455f3ab-8974-4da4-ae78-6d72a722ba5b] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.009826352s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-453313 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdany-port2691929147/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (6.61s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (2.56s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T" /mount1: exit status 1 (786.297828ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-453313 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-453313 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-453313 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2993251346/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (2.56s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.1s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-453313
--- PASS: TestFunctional/delete_addon-resizer_images (0.10s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-453313
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-453313
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (36.48s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -p image-789959 --driver=docker  --container-runtime=docker
E0626 19:04:06.491708  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
image_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -p image-789959 --driver=docker  --container-runtime=docker: (36.484209857s)
--- PASS: TestImageBuild/serial/Setup (36.48s)

                                                
                                    
x
+
TestImageBuild/serial/NormalBuild (1.75s)

                                                
                                                
=== RUN   TestImageBuild/serial/NormalBuild
image_test.go:78: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-789959
image_test.go:78: (dbg) Done: out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-789959: (1.754402582s)
--- PASS: TestImageBuild/serial/NormalBuild (1.75s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithBuildArg (0.87s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithBuildArg
image_test.go:99: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-789959
--- PASS: TestImageBuild/serial/BuildWithBuildArg (0.87s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithDockerIgnore (0.71s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithDockerIgnore
image_test.go:133: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal --build-opt=no-cache -p image-789959
--- PASS: TestImageBuild/serial/BuildWithDockerIgnore (0.71s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.7s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithSpecifiedDockerfile
image_test.go:88: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest -f inner/Dockerfile ./testdata/image-build/test-f -p image-789959
--- PASS: TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.70s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (80.38s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-arm64 start -p ingress-addon-legacy-359139 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E0626 19:05:28.411899  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-arm64 start -p ingress-addon-legacy-359139 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (1m20.380048382s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (80.38s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (10.78s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-359139 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-359139 addons enable ingress --alsologtostderr -v=5: (10.784601868s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (10.78s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.41s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-359139 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.41s)

                                                
                                    
x
+
TestJSONOutput/start/Command (62.75s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-851508 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker
E0626 19:07:44.567104  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:07:56.894738  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:56.899998  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:56.910202  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:56.930443  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:56.970686  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:57.050947  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:57.211289  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:57.531772  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:58.172729  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:07:59.453835  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:08:02.015090  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:08:07.135596  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:08:12.252718  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-851508 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker: (1m2.751702162s)
--- PASS: TestJSONOutput/start/Command (62.75s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.6s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-851508 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.60s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.6s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-851508 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.60s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.84s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-851508 --output=json --user=testUser
E0626 19:08:17.376394  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-851508 --output=json --user=testUser: (5.839604844s)
--- PASS: TestJSONOutput/stop/Command (5.84s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.24s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-740947 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-740947 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (81.135955ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"cbe45f7a-3ae9-4a4f-8d11-f164598f3cf5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-740947] minikube v1.30.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"71922d68-2eb0-4146-8c1e-d98518bee40d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16761"}}
	{"specversion":"1.0","id":"488d7a89-b60e-4181-a14f-3db22bbed187","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"0d72e919-b716-4f16-80e7-63d983fb0669","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig"}}
	{"specversion":"1.0","id":"3ef7512c-6c4a-4fd7-abae-67fa90c1c5eb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube"}}
	{"specversion":"1.0","id":"45ecf969-0bf3-47a2-abda-399a2c81ca59","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"5ef67847-ee3e-4a7f-85ca-f37023d54a03","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"5d5f6293-2086-4226-8486-a75fb850422a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-740947" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-740947
--- PASS: TestErrorJSONOutput (0.24s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (32.68s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-307859 --network=
E0626 19:08:37.856632  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-307859 --network=: (30.535707121s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-307859" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-307859
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-307859: (2.120314453s)
--- PASS: TestKicCustomNetwork/create_custom_network (32.68s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (36.99s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-111107 --network=bridge
E0626 19:09:18.817309  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-111107 --network=bridge: (34.97660695s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-111107" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-111107
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-111107: (1.982479437s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (36.99s)

                                                
                                    
x
+
TestKicExistingNetwork (37.38s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-017023 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-017023 --network=existing-network: (35.180129524s)
helpers_test.go:175: Cleaning up "existing-network-017023" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-017023
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-017023: (2.032377247s)
--- PASS: TestKicExistingNetwork (37.38s)

                                                
                                    
x
+
TestKicCustomSubnet (37.51s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-567081 --subnet=192.168.60.0/24
E0626 19:10:40.738249  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-567081 --subnet=192.168.60.0/24: (35.410516455s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-567081 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-567081" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-567081
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-567081: (2.075318686s)
--- PASS: TestKicCustomSubnet (37.51s)

                                                
                                    
x
+
TestKicStaticIP (37.97s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-333073 --static-ip=192.168.200.200
E0626 19:11:13.525469  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:13.531126  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:13.541335  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:13.561545  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:13.601774  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:13.682014  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:13.842356  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:14.162821  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:14.802948  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:16.083131  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:18.643346  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-333073 --static-ip=192.168.200.200: (35.694511705s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-333073 ip
helpers_test.go:175: Cleaning up "static-ip-333073" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-333073
E0626 19:11:23.764200  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-333073: (2.125338223s)
--- PASS: TestKicStaticIP (37.97s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (78.95s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-642237 --driver=docker  --container-runtime=docker
E0626 19:11:34.006395  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:11:54.486969  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-642237 --driver=docker  --container-runtime=docker: (36.811063927s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-645290 --driver=docker  --container-runtime=docker
E0626 19:12:35.447614  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-645290 --driver=docker  --container-runtime=docker: (36.728750101s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-642237
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-645290
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-645290" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-645290
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-645290: (2.087405808s)
helpers_test.go:175: Cleaning up "first-642237" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-642237
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-642237: (2.109468533s)
--- PASS: TestMinikubeProfile (78.95s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (8.2s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-518261 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
E0626 19:12:44.566878  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-518261 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (7.202022166s)
--- PASS: TestMountStart/serial/StartWithMountFirst (8.20s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-518261 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.27s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (11.23s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-520190 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
E0626 19:12:56.895151  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-520190 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (10.231724905s)
--- PASS: TestMountStart/serial/StartWithMountSecond (11.23s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-520190 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.28s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.49s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-518261 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-518261 --alsologtostderr -v=5: (1.48968489s)
--- PASS: TestMountStart/serial/DeleteFirst (1.49s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-520190 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.27s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.2s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-520190
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-520190: (1.200863511s)
--- PASS: TestMountStart/serial/Stop (1.20s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (8.06s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-520190
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-520190: (7.059734174s)
--- PASS: TestMountStart/serial/RestartStopped (8.06s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-520190 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.29s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (81.84s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-412635 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E0626 19:13:24.579180  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:13:57.368554  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p multinode-412635 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m21.249723689s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (81.84s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (47.6s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-412635 -- rollout status deployment/busybox: (3.063023943s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-t467l -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-xbfhg -- nslookup kubernetes.io
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-t467l -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-xbfhg -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-t467l -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-xbfhg -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (47.60s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.13s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-t467l -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-t467l -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-xbfhg -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-412635 -- exec busybox-67b7f59bb-xbfhg -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.13s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (22.82s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-412635 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-412635 -v 3 --alsologtostderr: (22.058012723s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (22.82s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.43s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.43s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (10.93s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp testdata/cp-test.txt multinode-412635:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1256678964/001/cp-test_multinode-412635.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635:/home/docker/cp-test.txt multinode-412635-m02:/home/docker/cp-test_multinode-412635_multinode-412635-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m02 "sudo cat /home/docker/cp-test_multinode-412635_multinode-412635-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635:/home/docker/cp-test.txt multinode-412635-m03:/home/docker/cp-test_multinode-412635_multinode-412635-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m03 "sudo cat /home/docker/cp-test_multinode-412635_multinode-412635-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp testdata/cp-test.txt multinode-412635-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1256678964/001/cp-test_multinode-412635-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635-m02:/home/docker/cp-test.txt multinode-412635:/home/docker/cp-test_multinode-412635-m02_multinode-412635.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635 "sudo cat /home/docker/cp-test_multinode-412635-m02_multinode-412635.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635-m02:/home/docker/cp-test.txt multinode-412635-m03:/home/docker/cp-test_multinode-412635-m02_multinode-412635-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m03 "sudo cat /home/docker/cp-test_multinode-412635-m02_multinode-412635-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp testdata/cp-test.txt multinode-412635-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1256678964/001/cp-test_multinode-412635-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635-m03:/home/docker/cp-test.txt multinode-412635:/home/docker/cp-test_multinode-412635-m03_multinode-412635.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635 "sudo cat /home/docker/cp-test_multinode-412635-m03_multinode-412635.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 cp multinode-412635-m03:/home/docker/cp-test.txt multinode-412635-m02:/home/docker/cp-test_multinode-412635-m03_multinode-412635-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 ssh -n multinode-412635-m02 "sudo cat /home/docker/cp-test_multinode-412635-m03_multinode-412635-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (10.93s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.46s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-arm64 -p multinode-412635 node stop m03: (1.275268601s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-412635 status: exit status 7 (547.643374ms)

                                                
                                                
-- stdout --
	multinode-412635
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-412635-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-412635-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-412635 status --alsologtostderr: exit status 7 (636.776143ms)

                                                
                                                
-- stdout --
	multinode-412635
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-412635-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-412635-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0626 19:16:03.490305  351193 out.go:296] Setting OutFile to fd 1 ...
	I0626 19:16:03.490524  351193 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:16:03.490550  351193 out.go:309] Setting ErrFile to fd 2...
	I0626 19:16:03.490569  351193 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:16:03.490742  351193 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
	I0626 19:16:03.491018  351193 out.go:303] Setting JSON to false
	I0626 19:16:03.491098  351193 mustload.go:65] Loading cluster: multinode-412635
	I0626 19:16:03.491206  351193 notify.go:220] Checking for updates...
	I0626 19:16:03.491571  351193 config.go:182] Loaded profile config "multinode-412635": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0626 19:16:03.491607  351193 status.go:255] checking status of multinode-412635 ...
	I0626 19:16:03.492099  351193 cli_runner.go:164] Run: docker container inspect multinode-412635 --format={{.State.Status}}
	I0626 19:16:03.515003  351193 status.go:330] multinode-412635 host status = "Running" (err=<nil>)
	I0626 19:16:03.515026  351193 host.go:66] Checking if "multinode-412635" exists ...
	I0626 19:16:03.515317  351193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-412635
	I0626 19:16:03.534694  351193 host.go:66] Checking if "multinode-412635" exists ...
	I0626 19:16:03.534998  351193 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0626 19:16:03.535039  351193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-412635
	I0626 19:16:03.565716  351193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33153 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/multinode-412635/id_rsa Username:docker}
	I0626 19:16:03.667983  351193 ssh_runner.go:195] Run: systemctl --version
	I0626 19:16:03.674155  351193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0626 19:16:03.687887  351193 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0626 19:16:03.758169  351193 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:55 SystemTime:2023-06-26 19:16:03.746176127 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1038-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215166976 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.2 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.10.5] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.18.1]] Warnings:<nil>}}
	I0626 19:16:03.758831  351193 kubeconfig.go:92] found "multinode-412635" server: "https://192.168.58.2:8443"
	I0626 19:16:03.758855  351193 api_server.go:166] Checking apiserver status ...
	I0626 19:16:03.758901  351193 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0626 19:16:03.785472  351193 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/2140/cgroup
	I0626 19:16:03.803324  351193 api_server.go:182] apiserver freezer: "10:freezer:/docker/f040522b156bb5e39d604129e6cdd699f9a0881315c6c80cbf7651a7dbb2cdc2/kubepods/burstable/pod487e6dcb096a52d8c24e95ab68bacd5d/abd7bd5bebe92c023932e3978962bce69eae4db0af0bc6d424ac35f8c1ee3fbc"
	I0626 19:16:03.803401  351193 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/f040522b156bb5e39d604129e6cdd699f9a0881315c6c80cbf7651a7dbb2cdc2/kubepods/burstable/pod487e6dcb096a52d8c24e95ab68bacd5d/abd7bd5bebe92c023932e3978962bce69eae4db0af0bc6d424ac35f8c1ee3fbc/freezer.state
	I0626 19:16:03.820850  351193 api_server.go:204] freezer state: "THAWED"
	I0626 19:16:03.820875  351193 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0626 19:16:03.830623  351193 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0626 19:16:03.830651  351193 status.go:421] multinode-412635 apiserver status = Running (err=<nil>)
	I0626 19:16:03.830662  351193 status.go:257] multinode-412635 status: &{Name:multinode-412635 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0626 19:16:03.830680  351193 status.go:255] checking status of multinode-412635-m02 ...
	I0626 19:16:03.831021  351193 cli_runner.go:164] Run: docker container inspect multinode-412635-m02 --format={{.State.Status}}
	I0626 19:16:03.864167  351193 status.go:330] multinode-412635-m02 host status = "Running" (err=<nil>)
	I0626 19:16:03.864191  351193 host.go:66] Checking if "multinode-412635-m02" exists ...
	I0626 19:16:03.864504  351193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-412635-m02
	I0626 19:16:03.895899  351193 host.go:66] Checking if "multinode-412635-m02" exists ...
	I0626 19:16:03.896229  351193 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0626 19:16:03.896279  351193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-412635-m02
	I0626 19:16:03.919007  351193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33158 SSHKeyPath:/home/jenkins/minikube-integration/16761-239099/.minikube/machines/multinode-412635-m02/id_rsa Username:docker}
	I0626 19:16:04.015785  351193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0626 19:16:04.030556  351193 status.go:257] multinode-412635-m02 status: &{Name:multinode-412635-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0626 19:16:04.030595  351193 status.go:255] checking status of multinode-412635-m03 ...
	I0626 19:16:04.030966  351193 cli_runner.go:164] Run: docker container inspect multinode-412635-m03 --format={{.State.Status}}
	I0626 19:16:04.049252  351193 status.go:330] multinode-412635-m03 host status = "Stopped" (err=<nil>)
	I0626 19:16:04.049278  351193 status.go:343] host is not running, skipping remaining checks
	I0626 19:16:04.049285  351193 status.go:257] multinode-412635-m03 status: &{Name:multinode-412635-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.46s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (14.27s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 node start m03 --alsologtostderr
E0626 19:16:13.526316  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
multinode_test.go:254: (dbg) Done: out/minikube-linux-arm64 -p multinode-412635 node start m03 --alsologtostderr: (13.421856704s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (14.27s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (126.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-412635
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-412635
multinode_test.go:290: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-412635: (22.643968069s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-412635 --wait=true -v=8 --alsologtostderr
E0626 19:16:41.209140  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:17:44.567372  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:17:56.895012  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-arm64 start -p multinode-412635 --wait=true -v=8 --alsologtostderr: (1m43.394632393s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-412635
--- PASS: TestMultiNode/serial/RestartKeepsNodes (126.17s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.14s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 node delete m03
multinode_test.go:394: (dbg) Done: out/minikube-linux-arm64 -p multinode-412635 node delete m03: (4.371943539s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.14s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (21.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 stop
multinode_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p multinode-412635 stop: (21.600810936s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-412635 status: exit status 7 (100.599969ms)

                                                
                                                
-- stdout --
	multinode-412635
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-412635-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-412635 status --alsologtostderr: exit status 7 (88.944741ms)

                                                
                                                
-- stdout --
	multinode-412635
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-412635-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0626 19:18:51.386836  367264 out.go:296] Setting OutFile to fd 1 ...
	I0626 19:18:51.386999  367264 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:18:51.387006  367264 out.go:309] Setting ErrFile to fd 2...
	I0626 19:18:51.387011  367264 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0626 19:18:51.387170  367264 root.go:336] Updating PATH: /home/jenkins/minikube-integration/16761-239099/.minikube/bin
	I0626 19:18:51.387337  367264 out.go:303] Setting JSON to false
	I0626 19:18:51.387372  367264 mustload.go:65] Loading cluster: multinode-412635
	I0626 19:18:51.387456  367264 notify.go:220] Checking for updates...
	I0626 19:18:51.387741  367264 config.go:182] Loaded profile config "multinode-412635": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0626 19:18:51.387758  367264 status.go:255] checking status of multinode-412635 ...
	I0626 19:18:51.389232  367264 cli_runner.go:164] Run: docker container inspect multinode-412635 --format={{.State.Status}}
	I0626 19:18:51.408651  367264 status.go:330] multinode-412635 host status = "Stopped" (err=<nil>)
	I0626 19:18:51.408672  367264 status.go:343] host is not running, skipping remaining checks
	I0626 19:18:51.408680  367264 status.go:257] multinode-412635 status: &{Name:multinode-412635 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0626 19:18:51.408711  367264 status.go:255] checking status of multinode-412635-m02 ...
	I0626 19:18:51.409219  367264 cli_runner.go:164] Run: docker container inspect multinode-412635-m02 --format={{.State.Status}}
	I0626 19:18:51.426954  367264 status.go:330] multinode-412635-m02 host status = "Stopped" (err=<nil>)
	I0626 19:18:51.426972  367264 status.go:343] host is not running, skipping remaining checks
	I0626 19:18:51.426979  367264 status.go:257] multinode-412635-m02 status: &{Name:multinode-412635-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (21.79s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (90.88s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-412635 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E0626 19:19:07.613220  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
multinode_test.go:354: (dbg) Done: out/minikube-linux-arm64 start -p multinode-412635 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m29.975110855s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-arm64 -p multinode-412635 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (90.88s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (40s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-412635
multinode_test.go:452: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-412635-m02 --driver=docker  --container-runtime=docker
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-412635-m02 --driver=docker  --container-runtime=docker: exit status 14 (89.872905ms)

                                                
                                                
-- stdout --
	* [multinode-412635-m02] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16761
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-412635-m02' is duplicated with machine name 'multinode-412635-m02' in profile 'multinode-412635'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-412635-m03 --driver=docker  --container-runtime=docker
multinode_test.go:460: (dbg) Done: out/minikube-linux-arm64 start -p multinode-412635-m03 --driver=docker  --container-runtime=docker: (37.291161195s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-412635
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-412635: exit status 80 (380.574099ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-412635
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-412635-m03 already exists in multinode-412635-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-412635-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-412635-m03: (2.18257299s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (40.00s)

                                                
                                    
x
+
TestPreload (143.43s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-369317 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4
E0626 19:21:13.526067  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-369317 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4: (1m18.271125934s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-369317 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-369317 image pull gcr.io/k8s-minikube/busybox: (1.47431524s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-369317
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-369317: (10.824711096s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-369317 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker
E0626 19:22:44.567274  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:22:56.894503  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-369317 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker: (50.272664278s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-369317 image list
helpers_test.go:175: Cleaning up "test-preload-369317" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-369317
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-369317: (2.334359359s)
--- PASS: TestPreload (143.43s)

                                                
                                    
x
+
TestScheduledStopUnix (104.14s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-512977 --memory=2048 --driver=docker  --container-runtime=docker
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-512977 --memory=2048 --driver=docker  --container-runtime=docker: (30.764197978s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-512977 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-512977 -n scheduled-stop-512977
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-512977 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-512977 --cancel-scheduled
E0626 19:24:19.939370  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-512977 -n scheduled-stop-512977
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-512977
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-512977 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-512977
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-512977: exit status 7 (79.707745ms)

                                                
                                                
-- stdout --
	scheduled-stop-512977
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-512977 -n scheduled-stop-512977
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-512977 -n scheduled-stop-512977: exit status 7 (82.202029ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-512977" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-512977
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-512977: (1.701693232s)
--- PASS: TestScheduledStopUnix (104.14s)

                                                
                                    
x
+
TestSkaffold (109.93s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /tmp/skaffold.exe271845168 version
skaffold_test.go:63: skaffold version: v2.5.1
skaffold_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p skaffold-028220 --memory=2600 --driver=docker  --container-runtime=docker
skaffold_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p skaffold-028220 --memory=2600 --driver=docker  --container-runtime=docker: (31.77300612s)
skaffold_test.go:86: copying out/minikube-linux-arm64 to /home/jenkins/workspace/Docker_Linux_docker_arm64/out/minikube
skaffold_test.go:105: (dbg) Run:  /tmp/skaffold.exe271845168 run --minikube-profile skaffold-028220 --kube-context skaffold-028220 --status-check=true --port-forward=false --interactive=false
E0626 19:26:13.525661  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
skaffold_test.go:105: (dbg) Done: /tmp/skaffold.exe271845168 run --minikube-profile skaffold-028220 --kube-context skaffold-028220 --status-check=true --port-forward=false --interactive=false: (1m3.572397228s)
skaffold_test.go:111: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-app" in namespace "default" ...
helpers_test.go:344: "leeroy-app-66798c5cd4-w2nt9" [c687a4c1-2830-4a87-84c9-7c0ed2adbe15] Running
skaffold_test.go:111: (dbg) TestSkaffold: app=leeroy-app healthy within 5.021968604s
skaffold_test.go:114: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-web" in namespace "default" ...
helpers_test.go:344: "leeroy-web-67976cff7f-dg7q4" [8faaef16-23ea-43ec-abde-ae0c33825b13] Running
skaffold_test.go:114: (dbg) TestSkaffold: app=leeroy-web healthy within 5.007701518s
helpers_test.go:175: Cleaning up "skaffold-028220" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p skaffold-028220
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p skaffold-028220: (2.86158943s)
--- PASS: TestSkaffold (109.93s)

                                                
                                    
x
+
TestInsufficientStorage (14.02s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-875838 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-875838 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker: exit status 26 (11.65073959s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"c28de8a8-070d-487f-aa56-3887e36d8862","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-875838] minikube v1.30.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"d2029497-dc0d-497d-89fc-b059b83d8942","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16761"}}
	{"specversion":"1.0","id":"0335642a-56a2-4b9f-89c0-bd08cab6bbc7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"bd009f28-b320-4502-a816-1cb5f7c2ab3d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig"}}
	{"specversion":"1.0","id":"3216d7dd-d6bd-40ce-83c6-08290cefac6d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube"}}
	{"specversion":"1.0","id":"b86f55ca-8ed7-4b16-918a-f4c357e1c048","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"1d184b2f-6398-4cda-8b7a-98627273f4ad","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"2f1775e2-eb88-4005-9735-8320b974e68f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"77d29163-df6e-4c61-8af6-9c1b8643361e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"79f85dc0-66e5-4921-b1cd-f9b15a3b025d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"c56d33d2-8857-497f-8963-e6042ad4729c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"bebdf034-bfad-45ec-8f38-8c123a936db2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-875838 in cluster insufficient-storage-875838","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"e2dfe47e-faea-4044-a8b7-b29f93de55b4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"6b4cb552-176a-4273-8555-6f012191b94c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"1f0a5577-76d9-4876-9380-797d34c813ed","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-875838 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-875838 --output=json --layout=cluster: exit status 7 (313.4885ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-875838","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.30.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-875838","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0626 19:27:15.759098  404082 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-875838" does not appear in /home/jenkins/minikube-integration/16761-239099/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-875838 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-875838 --output=json --layout=cluster: exit status 7 (316.292148ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-875838","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.30.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-875838","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0626 19:27:16.076084  404135 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-875838" does not appear in /home/jenkins/minikube-integration/16761-239099/kubeconfig
	E0626 19:27:16.088664  404135 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/insufficient-storage-875838/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-875838" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-875838
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-875838: (1.739464371s)
--- PASS: TestInsufficientStorage (14.02s)

                                                
                                    
x
+
TestKubernetesUpgrade (212.42s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-538638 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-538638 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m7.776206874s)
version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-538638
version_upgrade_test.go:239: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-538638: (10.169607188s)
version_upgrade_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-538638 status --format={{.Host}}
version_upgrade_test.go:244: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-538638 status --format={{.Host}}: exit status 7 (84.805214ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:246: status error: exit status 7 (may be ok)
version_upgrade_test.go:255: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-538638 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0626 19:31:13.526654  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
version_upgrade_test.go:255: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-538638 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m24.911632529s)
version_upgrade_test.go:260: (dbg) Run:  kubectl --context kubernetes-upgrade-538638 version --output=json
version_upgrade_test.go:279: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:281: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-538638 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker
version_upgrade_test.go:281: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-538638 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker: exit status 106 (213.881506ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-538638] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16761
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.27.3 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-538638
	    minikube start -p kubernetes-upgrade-538638 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-5386382 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.27.3, by running:
	    
	    minikube start -p kubernetes-upgrade-538638 --kubernetes-version=v1.27.3
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:285: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:287: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-538638 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0626 19:32:11.384354  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:32:31.865112  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
version_upgrade_test.go:287: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-538638 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (46.754001048s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-538638" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-538638
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-538638: (2.381642613s)
--- PASS: TestKubernetesUpgrade (212.42s)

                                                
                                    
x
+
TestMissingContainerUpgrade (180.05s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:321: (dbg) Run:  /tmp/minikube-v1.17.0.2960861943.exe start -p missing-upgrade-047398 --memory=2200 --driver=docker  --container-runtime=docker
version_upgrade_test.go:321: (dbg) Done: /tmp/minikube-v1.17.0.2960861943.exe start -p missing-upgrade-047398 --memory=2200 --driver=docker  --container-runtime=docker: (1m35.618668991s)
version_upgrade_test.go:330: (dbg) Run:  docker stop missing-upgrade-047398
version_upgrade_test.go:330: (dbg) Done: docker stop missing-upgrade-047398: (10.358346522s)
version_upgrade_test.go:335: (dbg) Run:  docker rm missing-upgrade-047398
version_upgrade_test.go:341: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-047398 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:341: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-047398 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m10.730479199s)
helpers_test.go:175: Cleaning up "missing-upgrade-047398" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-047398
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-047398: (2.318365796s)
--- PASS: TestMissingContainerUpgrade (180.05s)

                                                
                                    
x
+
TestPause/serial/Start (73.91s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-972895 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker
E0626 19:27:36.569992  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:27:44.567631  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:27:56.895114  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-972895 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker: (1m13.906255871s)
--- PASS: TestPause/serial/Start (73.91s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (48.3s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-972895 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-972895 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (48.241019329s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (48.30s)

                                                
                                    
x
+
TestPause/serial/Pause (1.33s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-972895 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-972895 --alsologtostderr -v=5: (1.327350728s)
--- PASS: TestPause/serial/Pause (1.33s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.53s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-972895 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-972895 --output=json --layout=cluster: exit status 2 (532.984977ms)

                                                
                                                
-- stdout --
	{"Name":"pause-972895","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 14 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.30.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-972895","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.53s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.86s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-972895 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.86s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.19s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-972895 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-972895 --alsologtostderr -v=5: (1.188665222s)
--- PASS: TestPause/serial/PauseAgain (1.19s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.68s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-972895 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-972895 --alsologtostderr -v=5: (2.680805909s)
--- PASS: TestPause/serial/DeletePaused (2.68s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.29s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-972895
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-972895: exit status 1 (20.239516ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-972895: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.29s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.96s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.96s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (101.79s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:195: (dbg) Run:  /tmp/minikube-v1.17.0.2600121578.exe start -p stopped-upgrade-613243 --memory=2200 --vm-driver=docker  --container-runtime=docker
E0626 19:31:50.902187  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:50.908055  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:50.918352  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:50.938590  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:50.979292  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:51.059406  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:51.220539  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:51.540933  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:52.181754  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:53.462486  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:31:56.023250  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:32:01.143385  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
version_upgrade_test.go:195: (dbg) Done: /tmp/minikube-v1.17.0.2600121578.exe start -p stopped-upgrade-613243 --memory=2200 --vm-driver=docker  --container-runtime=docker: (58.532149757s)
version_upgrade_test.go:204: (dbg) Run:  /tmp/minikube-v1.17.0.2600121578.exe -p stopped-upgrade-613243 stop
version_upgrade_test.go:204: (dbg) Done: /tmp/minikube-v1.17.0.2600121578.exe -p stopped-upgrade-613243 stop: (1.541464255s)
version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-613243 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0626 19:32:44.567703  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:32:56.895333  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
version_upgrade_test.go:210: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-613243 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (41.71278781s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (101.79s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (2.82s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:218: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-613243
version_upgrade_test.go:218: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-613243: (2.816250468s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (2.82s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-645570 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-645570 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker: exit status 14 (75.307244ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-645570] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16761
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16761-239099/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16761-239099/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (37.12s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-645570 --driver=docker  --container-runtime=docker
E0626 19:34:34.746088  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-645570 --driver=docker  --container-runtime=docker: (36.775894085s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-645570 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (37.12s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (16.49s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-645570 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-645570 --no-kubernetes --driver=docker  --container-runtime=docker: (14.38565371s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-645570 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-645570 status -o json: exit status 2 (318.716843ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-645570","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-645570
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-645570: (1.784372306s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (16.49s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (6.89s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-645570 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-645570 --no-kubernetes --driver=docker  --container-runtime=docker: (6.894466734s)
--- PASS: TestNoKubernetes/serial/Start (6.89s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.28s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-645570 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-645570 "sudo systemctl is-active --quiet service kubelet": exit status 1 (281.046605ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.28s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.64s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.64s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.23s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-645570
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-645570: (1.234490931s)
--- PASS: TestNoKubernetes/serial/Stop (1.23s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.77s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-645570 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-645570 --driver=docker  --container-runtime=docker: (7.77060146s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.77s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.27s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-645570 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-645570 "sudo systemctl is-active --quiet service kubelet": exit status 1 (273.626462ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.27s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (137.49s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-440009 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-440009 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (2m17.489052999s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (137.49s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (87.92s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-941034 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0626 19:40:59.940459  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:41:13.525756  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:41:50.903044  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-941034 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m27.916813288s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (87.92s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (8.56s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-941034 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [d3544430-08e0-46c8-ab74-99a19a939562] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [d3544430-08e0-46c8-ab74-99a19a939562] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 8.03084186s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-941034 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (8.56s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.97s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-941034 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-941034 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.97s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (11.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-941034 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-941034 --alsologtostderr -v=3: (11.065948049s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (11.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.16s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-941034 -n no-preload-941034
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-941034 -n no-preload-941034: exit status 7 (74.524747ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-941034 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.16s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (346.95s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-941034 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0626 19:42:44.567576  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-941034 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m46.472404424s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-941034 -n no-preload-941034
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (346.95s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.51s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-440009 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [952415e2-4f0e-45a9-b0c9-f184ce0490c0] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [952415e2-4f0e-45a9-b0c9-f184ce0490c0] Running
E0626 19:42:56.895264  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.026513256s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-440009 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.51s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.78s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-440009 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-440009 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.549255652s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-440009 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.78s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (11.09s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-440009 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-440009 --alsologtostderr -v=3: (11.085298725s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (11.09s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-440009 -n old-k8s-version-440009
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-440009 -n old-k8s-version-440009: exit status 7 (76.533663ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-440009 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.17s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (455.88s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-440009 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E0626 19:44:16.570799  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:46:13.526174  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:46:50.902358  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:47:44.567117  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:47:56.894833  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:48:13.948337  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-440009 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (7m35.352900557s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-440009 -n old-k8s-version-440009
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (455.88s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (13.03s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-vdxjx" [b52c15c4-12b6-4f7c-bdbc-4abd9299cd21] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-vdxjx" [b52c15c4-12b6-4f7c-bdbc-4abd9299cd21] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 13.026012831s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (13.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.13s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-vdxjx" [b52c15c4-12b6-4f7c-bdbc-4abd9299cd21] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.008571731s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-941034 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.13s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.46s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p no-preload-941034 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.46s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.31s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-941034 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-941034 -n no-preload-941034
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-941034 -n no-preload-941034: exit status 2 (352.64488ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-941034 -n no-preload-941034
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-941034 -n no-preload-941034: exit status 2 (331.111359ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-941034 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-941034 -n no-preload-941034
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-941034 -n no-preload-941034
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.31s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (69.89s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-115011 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-115011 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m9.894086791s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (69.89s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.5s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-115011 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [f3fba64a-fe24-4446-8f26-62226ec13e34] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [f3fba64a-fe24-4446-8f26-62226ec13e34] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.027737682s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-115011 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.50s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-115011 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-115011 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.07s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (10.96s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-115011 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-115011 --alsologtostderr -v=3: (10.955392574s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (10.96s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-115011 -n embed-certs-115011
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-115011 -n embed-certs-115011: exit status 7 (73.965627ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-115011 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.17s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (350.52s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-115011 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-115011 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m49.965585068s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-115011 -n embed-certs-115011
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (350.52s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-p85bj" [1261fe19-c38c-4add-bb11-621e2e4bfaea] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.029683104s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.15s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-p85bj" [1261fe19-c38c-4add-bb11-621e2e4bfaea] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.008058291s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-440009 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.15s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.38s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p old-k8s-version-440009 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.38s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.21s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-440009 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-440009 -n old-k8s-version-440009
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-440009 -n old-k8s-version-440009: exit status 2 (382.06903ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-440009 -n old-k8s-version-440009
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-440009 -n old-k8s-version-440009: exit status 2 (345.604497ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-440009 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-440009 -n old-k8s-version-440009
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-440009 -n old-k8s-version-440009
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.21s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (63.83s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-955537 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0626 19:51:13.525454  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
E0626 19:51:50.902232  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-955537 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m3.829280474s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (63.83s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.52s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-955537 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [38a7a833-f4c0-4ead-ae29-10355fd57294] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [38a7a833-f4c0-4ead-ae29-10355fd57294] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.028560647s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-955537 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.52s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-955537 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-955537 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.00s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (11.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-955537 --alsologtostderr -v=3
E0626 19:52:20.418889  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:20.424097  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:20.434466  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:20.454620  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:20.494848  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:20.575013  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:20.735263  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:21.055472  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:21.696373  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:22.977026  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:25.537405  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:27.613641  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:52:30.658277  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-955537 --alsologtostderr -v=3: (11.06580255s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (11.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537: exit status 7 (79.074178ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-955537 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (360.54s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-955537 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0626 19:52:40.899354  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:52:44.567136  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:52:51.737643  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:51.743223  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:51.753446  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:51.773678  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:51.813923  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:51.894173  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:52.054560  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:52.374780  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:53.015647  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:54.295847  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:56.856806  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:52:56.895044  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:53:01.379963  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:53:01.977723  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:53:12.218847  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:53:32.699071  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:53:42.340290  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:54:13.659867  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:55:04.260589  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:55:35.580067  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:56:13.526306  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-955537 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m59.861295979s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (360.54s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (11.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-tm98m" [0e5d428d-9a70-4bcf-a8c9-d5d433531aab] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-tm98m" [0e5d428d-9a70-4bcf-a8c9-d5d433531aab] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 11.025381435s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (11.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.12s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-tm98m" [0e5d428d-9a70-4bcf-a8c9-d5d433531aab] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.008860425s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-115011 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.12s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.38s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p embed-certs-115011 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.38s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.22s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-115011 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-115011 -n embed-certs-115011
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-115011 -n embed-certs-115011: exit status 2 (383.421511ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-115011 -n embed-certs-115011
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-115011 -n embed-certs-115011: exit status 2 (380.017881ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-115011 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-115011 -n embed-certs-115011
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-115011 -n embed-certs-115011
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.22s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (49.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-577175 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0626 19:56:50.902898  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 19:57:20.418240  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-577175 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (49.176854492s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (49.18s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.34s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-577175 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-577175 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.343271925s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.34s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (11.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-577175 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-577175 --alsologtostderr -v=3: (11.175157969s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (11.18s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-577175 -n newest-cni-577175
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-577175 -n newest-cni-577175: exit status 7 (83.725399ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-577175 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (38.8s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-577175 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0626 19:57:39.940967  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
E0626 19:57:44.567133  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/addons-963360/client.crt: no such file or directory
E0626 19:57:48.101101  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/no-preload-941034/client.crt: no such file or directory
E0626 19:57:51.737382  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
E0626 19:57:56.894605  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-577175 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (38.29412926s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-577175 -n newest-cni-577175
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (38.80s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.58s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p newest-cni-577175 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.58s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (6.39s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-577175 --alsologtostderr -v=1
E0626 19:58:19.420956  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/old-k8s-version-440009/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p newest-cni-577175 --alsologtostderr -v=1: (1.455632471s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-577175 -n newest-cni-577175
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-577175 -n newest-cni-577175: exit status 2 (495.057909ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-577175 -n newest-cni-577175
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-577175 -n newest-cni-577175: exit status 2 (682.508411ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-577175 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p newest-cni-577175 --alsologtostderr -v=1: (1.576223912s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-577175 -n newest-cni-577175
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-577175 -n newest-cni-577175
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-577175 -n newest-cni-577175: (1.225547964s)
--- PASS: TestStartStop/group/newest-cni/serial/Pause (6.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (69.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker: (1m9.025542815s)
--- PASS: TestNetworkPlugins/group/auto/Start (69.03s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (16.04s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-l7lwb" [f3f7a5fb-d8a5-48ad-81bc-13ce2ea6bdd6] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-l7lwb" [f3f7a5fb-d8a5-48ad-81bc-13ce2ea6bdd6] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 16.03459626s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (16.04s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.17s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-l7lwb" [f3f7a5fb-d8a5-48ad-81bc-13ce2ea6bdd6] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.008374644s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-955537 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.17s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.55s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p default-k8s-diff-port-955537 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.55s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (4.72s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-955537 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537: exit status 2 (537.256064ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537: exit status 2 (496.480122ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-955537 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p default-k8s-diff-port-955537 --alsologtostderr -v=1: (1.158206906s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-955537 -n default-k8s-diff-port-955537
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (4.72s)
E0626 20:06:39.815064  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/calico-322182/client.crt: no such file or directory
E0626 20:06:40.456273  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/calico-322182/client.crt: no such file or directory
E0626 20:06:41.736577  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/calico-322182/client.crt: no such file or directory
E0626 20:06:44.297458  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/calico-322182/client.crt: no such file or directory

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (71.62s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker: (1m11.618167889s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (71.62s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-322182 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (11.55s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-fcbvz" [e91c1efa-6c8a-4d51-9e43-ecf570fc7bf5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-fcbvz" [e91c1efa-6c8a-4d51-9e43-ecf570fc7bf5] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 11.012027068s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (11.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.05s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-qkgg5" [bebc8ef1-8924-4d94-98f1-30d3434e82c0] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.044726906s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.05s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (83.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker: (1m23.257275771s)
--- PASS: TestNetworkPlugins/group/calico/Start (83.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-322182 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (11.6s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-274h9" [f00fc624-279b-45c4-b05d-de859d15b6c9] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-274h9" [f00fc624-279b-45c4-b05d-de859d15b6c9] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 11.009677166s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (11.60s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (73.52s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker
E0626 20:01:13.526109  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker: (1m13.519479704s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (73.52s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-8rmdn" [04097044-b677-4665-a9f3-d5f79b6d0579] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.032095541s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-322182 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (10.52s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-wdwdb" [de3ff56d-e9fc-4ff0-9caf-08cdaae75bec] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-wdwdb" [de3ff56d-e9fc-4ff0-9caf-08cdaae75bec] Running
E0626 20:01:50.902821  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 10.010638311s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (10.52s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-322182 "pgrep -a kubelet"
E0626 20:02:12.167368  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/default-k8s-diff-port-955537/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (12.56s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-klf6b" [fbd393dc-a02b-4338-adea-5e729444fcf5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0626 20:02:13.448900  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/default-k8s-diff-port-955537/client.crt: no such file or directory
E0626 20:02:16.009944  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/default-k8s-diff-port-955537/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-klf6b" [fbd393dc-a02b-4338-adea-5e729444fcf5] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 12.009630411s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (12.56s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (58.61s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p false-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p false-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker: (58.609213003s)
--- PASS: TestNetworkPlugins/group/false/Start (58.61s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (54.7s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker
E0626 20:02:56.895130  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/functional-453313/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker: (54.697130379s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (54.70s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/KubeletFlags (0.52s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p false-322182 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/false/KubeletFlags (0.52s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/NetCatPod (13.7s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context false-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-pf742" [c5cbf922-06f3-4b49-a756-32ba4eb38920] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-pf742" [c5cbf922-06f3-4b49-a756-32ba4eb38920] Running
E0626 20:03:32.813235  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/default-k8s-diff-port-955537/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: app=netcat healthy within 13.007414965s
--- PASS: TestNetworkPlugins/group/false/NetCatPod (13.70s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/DNS
net_test.go:175: (dbg) Run:  kubectl --context false-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/false/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Localhost (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Localhost
net_test.go:194: (dbg) Run:  kubectl --context false-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/false/Localhost (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/HairPin
net_test.go:264: (dbg) Run:  kubectl --context false-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/false/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.42s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-322182 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.42s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (12.57s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-74t72" [1441cc34-a8f7-4b59-80ed-e7ee002c62f2] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-74t72" [1441cc34-a8f7-4b59-80ed-e7ee002c62f2] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 12.015027883s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (12.57s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (68.55s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker: (1m8.547785572s)
--- PASS: TestNetworkPlugins/group/flannel/Start (68.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (96.63s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker
E0626 20:04:38.421109  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:38.426567  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:38.436797  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:38.457066  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:38.497348  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:38.577704  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:38.738042  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:39.059139  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:39.699713  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:40.980757  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:43.541137  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:48.661270  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
E0626 20:04:53.949422  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
E0626 20:04:54.734187  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/default-k8s-diff-port-955537/client.crt: no such file or directory
E0626 20:04:58.902061  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker: (1m36.627022965s)
--- PASS: TestNetworkPlugins/group/bridge/Start (96.63s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-n9c5k" [68697072-ce71-4ae9-9395-6e9702d6b0e3] Running
E0626 20:05:13.478496  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:13.483777  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:13.494042  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:13.514402  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:13.554828  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:13.635236  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:13.795730  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.030221915s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-322182 "pgrep -a kubelet"
E0626 20:05:14.115898  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (11.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-s2k68" [04830004-7002-484e-9f18-beadfccd42f6] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0626 20:05:14.756901  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:16.037146  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:18.597590  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:05:19.383128  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-s2k68" [04830004-7002-484e-9f18-beadfccd42f6] Running
E0626 20:05:23.718107  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 11.00872635s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (11.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (57.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kubenet-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker
E0626 20:05:54.438952  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/kindnet-322182/client.crt: no such file or directory
E0626 20:06:00.344270  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/auto-322182/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kubenet-322182 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker: (57.226657889s)
--- PASS: TestNetworkPlugins/group/kubenet/Start (57.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-322182 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (11.57s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-pzrb2" [9b35ba3c-a25d-43c5-832b-6b9918c2b6f0] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-pzrb2" [9b35ba3c-a25d-43c5-832b-6b9918c2b6f0] Running
E0626 20:06:13.526029  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/ingress-addon-legacy-359139/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 11.012685649s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (11.57s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/KubeletFlags (0.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kubenet-322182 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kubenet/KubeletFlags (0.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/NetCatPod (10.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kubenet-322182 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-ws5nq" [70e6d567-45fe-46f7-8c2f-04b9fbf06507] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0626 20:06:49.418278  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/calico-322182/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-ws5nq" [70e6d567-45fe-46f7-8c2f-04b9fbf06507] Running
E0626 20:06:50.902830  244486 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16761-239099/.minikube/profiles/skaffold-028220/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: app=netcat healthy within 10.007779302s
--- PASS: TestNetworkPlugins/group/kubenet/NetCatPod (10.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/DNS (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kubenet-322182 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kubenet/DNS (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kubenet-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kubenet/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kubenet-322182 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kubenet/HairPin (0.20s)

                                                
                                    

Test skip (23/318)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.27.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.27.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.27.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.52s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-262509 --alsologtostderr --driver=docker  --container-runtime=docker
aaa_download_only_test.go:234: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-262509" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-262509
--- SKIP: TestDownloadOnlyKic (0.52s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:420: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:474: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild/serial/validateImageBuildWithBuildEnv (0s)

                                                
                                                
=== RUN   TestImageBuild/serial/validateImageBuildWithBuildEnv
image_test.go:114: skipping due to https://github.com/kubernetes/minikube/issues/12431
--- SKIP: TestImageBuild/serial/validateImageBuildWithBuildEnv (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-382036" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-382036
--- SKIP: TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (3.89s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:522: 
----------------------- debugLogs start: cilium-322182 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-322182" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-322182

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-322182" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-322182"

                                                
                                                
----------------------- debugLogs end: cilium-322182 [took: 3.736449184s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-322182" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-322182
--- SKIP: TestNetworkPlugins/group/cilium (3.89s)

                                                
                                    
Copied to clipboard