Test Report: Docker_Linux_docker_arm64 16890

                    
                      dc702cb3cbb2bfe371541339d66d19e451f60279:2023-07-17:30187
                    
                

Test fail (3/319)

Order failed test Duration
25 TestAddons/parallel/Ingress 39.28
47 TestErrorSpam/setup 34.23
162 TestIngressAddonLegacy/serial/ValidateIngressAddons 51.88
x
+
TestAddons/parallel/Ingress (39.28s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:183: (dbg) Run:  kubectl --context addons-282155 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:208: (dbg) Run:  kubectl --context addons-282155 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context addons-282155 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [dff940ec-acd9-4087-b2de-d51ec0659cb8] Pending
helpers_test.go:344: "nginx" [dff940ec-acd9-4087-b2de-d51ec0659cb8] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [dff940ec-acd9-4087-b2de-d51ec0659cb8] Running
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.018005728s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context addons-282155 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.04783754s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p addons-282155 addons disable ingress-dns --alsologtostderr -v=1: (1.41824907s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p addons-282155 addons disable ingress --alsologtostderr -v=1: (7.764702052s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-282155
helpers_test.go:235: (dbg) docker inspect addons-282155:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "e58a29c4b8f763a24d99a899ced11c07263c9ff01e57bcddd4f373c445c3040b",
	        "Created": "2023-07-17T20:06:54.508060989Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1055519,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-17T20:06:54.848178592Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:f52519afe5f6d6f3ce84cbd7f651b1292638d32ca98ee43d88f2d69e113e44de",
	        "ResolvConfPath": "/var/lib/docker/containers/e58a29c4b8f763a24d99a899ced11c07263c9ff01e57bcddd4f373c445c3040b/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/e58a29c4b8f763a24d99a899ced11c07263c9ff01e57bcddd4f373c445c3040b/hostname",
	        "HostsPath": "/var/lib/docker/containers/e58a29c4b8f763a24d99a899ced11c07263c9ff01e57bcddd4f373c445c3040b/hosts",
	        "LogPath": "/var/lib/docker/containers/e58a29c4b8f763a24d99a899ced11c07263c9ff01e57bcddd4f373c445c3040b/e58a29c4b8f763a24d99a899ced11c07263c9ff01e57bcddd4f373c445c3040b-json.log",
	        "Name": "/addons-282155",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-282155:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-282155",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/21b7598e33551495e5d9d735b09b6138955dadc47300c3e4e09c53967010ec34-init/diff:/var/lib/docker/overlay2/6900946d0fdd3bfa709cdc23e339458379368aff000f0d1b8e08a5eb8d75fd8d/diff",
	                "MergedDir": "/var/lib/docker/overlay2/21b7598e33551495e5d9d735b09b6138955dadc47300c3e4e09c53967010ec34/merged",
	                "UpperDir": "/var/lib/docker/overlay2/21b7598e33551495e5d9d735b09b6138955dadc47300c3e4e09c53967010ec34/diff",
	                "WorkDir": "/var/lib/docker/overlay2/21b7598e33551495e5d9d735b09b6138955dadc47300c3e4e09c53967010ec34/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-282155",
	                "Source": "/var/lib/docker/volumes/addons-282155/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-282155",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-282155",
	                "name.minikube.sigs.k8s.io": "addons-282155",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "7b501c57fde1fa282a655c8905ae02b9f7e3c2f77424c157999e4f53a9c23b4c",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33995"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33994"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33991"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33993"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33992"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/7b501c57fde1",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-282155": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "e58a29c4b8f7",
	                        "addons-282155"
	                    ],
	                    "NetworkID": "1cc21bd311d3b16b342c4bfa12fd4cb18aa5c0170ff75c4336d6184114b21354",
	                    "EndpointID": "2e37b9ba40ec832a354bdc01814b3a8506790e2f0204d939cbd0cd18bcbd3710",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-282155 -n addons-282155
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-282155 logs -n 25: (1.838334065s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-513233   | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC |                     |
	|         | -p download-only-513233        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0   |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| start   | -o=json --download-only        | download-only-513233   | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC |                     |
	|         | -p download-only-513233        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.27.3   |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | --all                          | minikube               | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC | 17 Jul 23 20:06 UTC |
	| delete  | -p download-only-513233        | download-only-513233   | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC | 17 Jul 23 20:06 UTC |
	| delete  | -p download-only-513233        | download-only-513233   | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC | 17 Jul 23 20:06 UTC |
	| start   | --download-only -p             | download-docker-123883 | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC |                     |
	|         | download-docker-123883         |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | -p download-docker-123883      | download-docker-123883 | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC | 17 Jul 23 20:06 UTC |
	| start   | --download-only -p             | binary-mirror-282045   | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC |                     |
	|         | binary-mirror-282045           |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --binary-mirror                |                        |         |         |                     |                     |
	|         | http://127.0.0.1:46565         |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-282045        | binary-mirror-282045   | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC | 17 Jul 23 20:06 UTC |
	| start   | -p addons-282155               | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC | 17 Jul 23 20:08 UTC |
	|         | --wait=true --memory=4000      |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --addons=registry              |                        |         |         |                     |                     |
	|         | --addons=metrics-server        |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots       |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver   |                        |         |         |                     |                     |
	|         | --addons=gcp-auth              |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner         |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget      |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --addons=ingress               |                        |         |         |                     |                     |
	|         | --addons=ingress-dns           |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p       | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	|         | addons-282155                  |                        |         |         |                     |                     |
	| addons  | addons-282155 addons           | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	|         | disable metrics-server         |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| ip      | addons-282155 ip               | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	| addons  | addons-282155 addons disable   | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	|         | registry --alsologtostderr     |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p    | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	|         | addons-282155                  |                        |         |         |                     |                     |
	| addons  | enable headlamp                | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	|         | -p addons-282155               |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| ssh     | addons-282155 ssh curl -s      | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	|         | http://127.0.0.1/ -H 'Host:    |                        |         |         |                     |                     |
	|         | nginx.example.com'             |                        |         |         |                     |                     |
	| ip      | addons-282155 ip               | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	| addons  | addons-282155 addons disable   | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	|         | ingress-dns --alsologtostderr  |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | addons-282155 addons disable   | addons-282155          | jenkins | v1.30.1 | 17 Jul 23 20:09 UTC | 17 Jul 23 20:09 UTC |
	|         | ingress --alsologtostderr -v=1 |                        |         |         |                     |                     |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/17 20:06:31
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 20:06:31.875663 1055056 out.go:296] Setting OutFile to fd 1 ...
	I0717 20:06:31.875869 1055056 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:06:31.875878 1055056 out.go:309] Setting ErrFile to fd 2...
	I0717 20:06:31.875884 1055056 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:06:31.876166 1055056 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
	I0717 20:06:31.876671 1055056 out.go:303] Setting JSON to false
	I0717 20:06:31.877612 1055056 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":17335,"bootTime":1689607057,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0717 20:06:31.877681 1055056 start.go:138] virtualization:  
	I0717 20:06:31.880772 1055056 out.go:177] * [addons-282155] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0717 20:06:31.883974 1055056 out.go:177]   - MINIKUBE_LOCATION=16890
	I0717 20:06:31.886527 1055056 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:06:31.884116 1055056 notify.go:220] Checking for updates...
	I0717 20:06:31.890272 1055056 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	I0717 20:06:31.892020 1055056 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	I0717 20:06:31.893755 1055056 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 20:06:31.895531 1055056 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 20:06:31.897551 1055056 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 20:06:31.920880 1055056 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 20:06:31.920978 1055056 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:06:32.010916 1055056 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-17 20:06:31.999799041 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:06:32.011033 1055056 docker.go:294] overlay module found
	I0717 20:06:32.014083 1055056 out.go:177] * Using the docker driver based on user configuration
	I0717 20:06:32.016031 1055056 start.go:298] selected driver: docker
	I0717 20:06:32.016064 1055056 start.go:880] validating driver "docker" against <nil>
	I0717 20:06:32.016078 1055056 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 20:06:32.016696 1055056 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:06:32.076843 1055056 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-17 20:06:32.067657332 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:06:32.077005 1055056 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0717 20:06:32.077223 1055056 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0717 20:06:32.079193 1055056 out.go:177] * Using Docker driver with root privileges
	I0717 20:06:32.080733 1055056 cni.go:84] Creating CNI manager for ""
	I0717 20:06:32.080754 1055056 cni.go:149] "docker" driver + "docker" runtime found, recommending kindnet
	I0717 20:06:32.080768 1055056 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni
	I0717 20:06:32.080781 1055056 start_flags.go:319] config:
	{Name:addons-282155 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-282155 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:
cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:06:32.082821 1055056 out.go:177] * Starting control plane node addons-282155 in cluster addons-282155
	I0717 20:06:32.084525 1055056 cache.go:122] Beginning downloading kic base image for docker with docker
	I0717 20:06:32.086311 1055056 out.go:177] * Pulling base image ...
	I0717 20:06:32.088091 1055056 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0717 20:06:32.088140 1055056 preload.go:148] Found local preload: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	I0717 20:06:32.088154 1055056 cache.go:57] Caching tarball of preloaded images
	I0717 20:06:32.088174 1055056 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0717 20:06:32.088226 1055056 preload.go:174] Found /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0717 20:06:32.088236 1055056 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.3 on docker
	I0717 20:06:32.088573 1055056 profile.go:148] Saving config to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/config.json ...
	I0717 20:06:32.088601 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/config.json: {Name:mk28bc31c5fc3b6d44be2d239ff988b4710b4371 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:06:32.104828 1055056 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0717 20:06:32.104930 1055056 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0717 20:06:32.104955 1055056 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory, skipping pull
	I0717 20:06:32.104962 1055056 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in cache, skipping pull
	I0717 20:06:32.104969 1055056 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0717 20:06:32.104974 1055056 cache.go:163] Loading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 from local cache
	I0717 20:06:47.733201 1055056 cache.go:165] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 from cached tarball
	I0717 20:06:47.733242 1055056 cache.go:195] Successfully downloaded all kic artifacts
	I0717 20:06:47.733296 1055056 start.go:365] acquiring machines lock for addons-282155: {Name:mk54e73b39daa997ec072a91b5a7d44c08c1f4ea Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0717 20:06:47.733435 1055056 start.go:369] acquired machines lock for "addons-282155" in 106.051µs
	I0717 20:06:47.733464 1055056 start.go:93] Provisioning new machine with config: &{Name:addons-282155 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-282155 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServ
erIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custo
mQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0717 20:06:47.733557 1055056 start.go:125] createHost starting for "" (driver="docker")
	I0717 20:06:47.735680 1055056 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0717 20:06:47.735991 1055056 start.go:159] libmachine.API.Create for "addons-282155" (driver="docker")
	I0717 20:06:47.736017 1055056 client.go:168] LocalClient.Create starting
	I0717 20:06:47.736125 1055056 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem
	I0717 20:06:48.008202 1055056 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem
	I0717 20:06:48.312792 1055056 cli_runner.go:164] Run: docker network inspect addons-282155 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0717 20:06:48.331296 1055056 cli_runner.go:211] docker network inspect addons-282155 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0717 20:06:48.331378 1055056 network_create.go:281] running [docker network inspect addons-282155] to gather additional debugging logs...
	I0717 20:06:48.331398 1055056 cli_runner.go:164] Run: docker network inspect addons-282155
	W0717 20:06:48.348179 1055056 cli_runner.go:211] docker network inspect addons-282155 returned with exit code 1
	I0717 20:06:48.348207 1055056 network_create.go:284] error running [docker network inspect addons-282155]: docker network inspect addons-282155: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-282155 not found
	I0717 20:06:48.348220 1055056 network_create.go:286] output of [docker network inspect addons-282155]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-282155 not found
	
	** /stderr **
	I0717 20:06:48.348289 1055056 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 20:06:48.365920 1055056 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400107e740}
	I0717 20:06:48.365959 1055056 network_create.go:123] attempt to create docker network addons-282155 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0717 20:06:48.366014 1055056 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-282155 addons-282155
	I0717 20:06:48.436394 1055056 network_create.go:107] docker network addons-282155 192.168.49.0/24 created
	I0717 20:06:48.436423 1055056 kic.go:117] calculated static IP "192.168.49.2" for the "addons-282155" container
	I0717 20:06:48.436513 1055056 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0717 20:06:48.453009 1055056 cli_runner.go:164] Run: docker volume create addons-282155 --label name.minikube.sigs.k8s.io=addons-282155 --label created_by.minikube.sigs.k8s.io=true
	I0717 20:06:48.471049 1055056 oci.go:103] Successfully created a docker volume addons-282155
	I0717 20:06:48.471152 1055056 cli_runner.go:164] Run: docker run --rm --name addons-282155-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-282155 --entrypoint /usr/bin/test -v addons-282155:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib
	I0717 20:06:50.640792 1055056 cli_runner.go:217] Completed: docker run --rm --name addons-282155-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-282155 --entrypoint /usr/bin/test -v addons-282155:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib: (2.169598388s)
	I0717 20:06:50.640825 1055056 oci.go:107] Successfully prepared a docker volume addons-282155
	I0717 20:06:50.640853 1055056 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0717 20:06:50.640871 1055056 kic.go:190] Starting extracting preloaded images to volume ...
	I0717 20:06:50.640958 1055056 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-282155:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir
	I0717 20:06:54.422333 1055056 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-282155:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir: (3.781335182s)
	I0717 20:06:54.422366 1055056 kic.go:199] duration metric: took 3.781490 seconds to extract preloaded images to volume
	W0717 20:06:54.422867 1055056 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0717 20:06:54.423032 1055056 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0717 20:06:54.492142 1055056 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-282155 --name addons-282155 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-282155 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-282155 --network addons-282155 --ip 192.168.49.2 --volume addons-282155:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631
	I0717 20:06:54.858567 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Running}}
	I0717 20:06:54.885142 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:06:54.910818 1055056 cli_runner.go:164] Run: docker exec addons-282155 stat /var/lib/dpkg/alternatives/iptables
	I0717 20:06:54.984644 1055056 oci.go:144] the created container "addons-282155" has a running status.
	I0717 20:06:54.984669 1055056 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa...
	I0717 20:06:55.609045 1055056 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0717 20:06:55.640538 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:06:55.672562 1055056 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0717 20:06:55.672580 1055056 kic_runner.go:114] Args: [docker exec --privileged addons-282155 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0717 20:06:55.768458 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:06:55.795067 1055056 machine.go:88] provisioning docker machine ...
	I0717 20:06:55.795095 1055056 ubuntu.go:169] provisioning hostname "addons-282155"
	I0717 20:06:55.795160 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:55.828514 1055056 main.go:141] libmachine: Using SSH client type: native
	I0717 20:06:55.828958 1055056 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 33995 <nil> <nil>}
	I0717 20:06:55.828969 1055056 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-282155 && echo "addons-282155" | sudo tee /etc/hostname
	I0717 20:06:55.998828 1055056 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-282155
	
	I0717 20:06:55.998946 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:56.020373 1055056 main.go:141] libmachine: Using SSH client type: native
	I0717 20:06:56.020804 1055056 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 33995 <nil> <nil>}
	I0717 20:06:56.020822 1055056 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-282155' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-282155/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-282155' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0717 20:06:56.165214 1055056 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0717 20:06:56.165290 1055056 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16890-1049210/.minikube CaCertPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16890-1049210/.minikube}
	I0717 20:06:56.165325 1055056 ubuntu.go:177] setting up certificates
	I0717 20:06:56.165359 1055056 provision.go:83] configureAuth start
	I0717 20:06:56.165464 1055056 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-282155
	I0717 20:06:56.187038 1055056 provision.go:138] copyHostCerts
	I0717 20:06:56.187115 1055056 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.pem (1082 bytes)
	I0717 20:06:56.187232 1055056 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16890-1049210/.minikube/cert.pem (1123 bytes)
	I0717 20:06:56.187287 1055056 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16890-1049210/.minikube/key.pem (1679 bytes)
	I0717 20:06:56.187359 1055056 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca-key.pem org=jenkins.addons-282155 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-282155]
	I0717 20:06:56.726685 1055056 provision.go:172] copyRemoteCerts
	I0717 20:06:56.726774 1055056 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0717 20:06:56.726816 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:56.744728 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:06:56.838419 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0717 20:06:56.867532 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I0717 20:06:56.896470 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0717 20:06:56.924802 1055056 provision.go:86] duration metric: configureAuth took 759.413447ms
	I0717 20:06:56.924826 1055056 ubuntu.go:193] setting minikube options for container-runtime
	I0717 20:06:56.925047 1055056 config.go:182] Loaded profile config "addons-282155": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0717 20:06:56.925106 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:56.947655 1055056 main.go:141] libmachine: Using SSH client type: native
	I0717 20:06:56.948117 1055056 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 33995 <nil> <nil>}
	I0717 20:06:56.948133 1055056 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0717 20:06:57.077505 1055056 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0717 20:06:57.077586 1055056 ubuntu.go:71] root file system type: overlay
	I0717 20:06:57.077730 1055056 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0717 20:06:57.077830 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:57.096117 1055056 main.go:141] libmachine: Using SSH client type: native
	I0717 20:06:57.096562 1055056 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 33995 <nil> <nil>}
	I0717 20:06:57.096656 1055056 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0717 20:06:57.245680 1055056 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0717 20:06:57.245765 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:57.263925 1055056 main.go:141] libmachine: Using SSH client type: native
	I0717 20:06:57.264358 1055056 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 33995 <nil> <nil>}
	I0717 20:06:57.264376 1055056 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0717 20:06:58.106867 1055056 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-07-07 14:51:01.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-07-17 20:06:57.242417242 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0717 20:06:58.106902 1055056 machine.go:91] provisioned docker machine in 2.311817236s
	I0717 20:06:58.106912 1055056 client.go:171] LocalClient.Create took 10.370888751s
	I0717 20:06:58.106931 1055056 start.go:167] duration metric: libmachine.API.Create for "addons-282155" took 10.370940476s
	I0717 20:06:58.106941 1055056 start.go:300] post-start starting for "addons-282155" (driver="docker")
	I0717 20:06:58.106952 1055056 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0717 20:06:58.107022 1055056 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0717 20:06:58.107077 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:58.124675 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:06:58.218581 1055056 ssh_runner.go:195] Run: cat /etc/os-release
	I0717 20:06:58.223048 1055056 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0717 20:06:58.223085 1055056 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0717 20:06:58.223098 1055056 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0717 20:06:58.223105 1055056 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0717 20:06:58.223122 1055056 filesync.go:126] Scanning /home/jenkins/minikube-integration/16890-1049210/.minikube/addons for local assets ...
	I0717 20:06:58.223197 1055056 filesync.go:126] Scanning /home/jenkins/minikube-integration/16890-1049210/.minikube/files for local assets ...
	I0717 20:06:58.223224 1055056 start.go:303] post-start completed in 116.278261ms
	I0717 20:06:58.223570 1055056 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-282155
	I0717 20:06:58.242636 1055056 profile.go:148] Saving config to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/config.json ...
	I0717 20:06:58.242909 1055056 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 20:06:58.242958 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:58.260260 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:06:58.354369 1055056 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0717 20:06:58.360553 1055056 start.go:128] duration metric: createHost completed in 10.626981936s
	I0717 20:06:58.360576 1055056 start.go:83] releasing machines lock for "addons-282155", held for 10.627129202s
	I0717 20:06:58.360648 1055056 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-282155
	I0717 20:06:58.378224 1055056 ssh_runner.go:195] Run: cat /version.json
	I0717 20:06:58.378280 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:58.378547 1055056 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0717 20:06:58.378605 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:06:58.402755 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:06:58.423868 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	W0717 20:06:58.492191 1055056 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.31.0 -> Actual minikube version: v1.30.1
	I0717 20:06:58.492303 1055056 ssh_runner.go:195] Run: systemctl --version
	I0717 20:06:58.634637 1055056 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0717 20:06:58.640276 1055056 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0717 20:06:58.670313 1055056 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0717 20:06:58.670399 1055056 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0717 20:06:58.704974 1055056 cni.go:268] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0717 20:06:58.704999 1055056 start.go:469] detecting cgroup driver to use...
	I0717 20:06:58.705031 1055056 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0717 20:06:58.705167 1055056 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0717 20:06:58.725247 1055056 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0717 20:06:58.737235 1055056 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0717 20:06:58.749029 1055056 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0717 20:06:58.749118 1055056 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0717 20:06:58.761028 1055056 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 20:06:58.773305 1055056 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0717 20:06:58.784963 1055056 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 20:06:58.796959 1055056 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0717 20:06:58.808039 1055056 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0717 20:06:58.820033 1055056 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0717 20:06:58.831574 1055056 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0717 20:06:58.842338 1055056 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:06:58.937172 1055056 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0717 20:06:59.039928 1055056 start.go:469] detecting cgroup driver to use...
	I0717 20:06:59.040019 1055056 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0717 20:06:59.040097 1055056 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0717 20:06:59.055770 1055056 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0717 20:06:59.055884 1055056 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0717 20:06:59.070384 1055056 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0717 20:06:59.090671 1055056 ssh_runner.go:195] Run: which cri-dockerd
	I0717 20:06:59.095819 1055056 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0717 20:06:59.106646 1055056 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0717 20:06:59.134615 1055056 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0717 20:06:59.256990 1055056 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0717 20:06:59.371943 1055056 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0717 20:06:59.372027 1055056 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0717 20:06:59.398724 1055056 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:06:59.501392 1055056 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0717 20:06:59.773987 1055056 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0717 20:06:59.866400 1055056 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I0717 20:06:59.967379 1055056 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0717 20:07:00.077383 1055056 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:07:00.204498 1055056 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I0717 20:07:00.226437 1055056 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:07:00.341353 1055056 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
	I0717 20:07:00.424470 1055056 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I0717 20:07:00.424622 1055056 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I0717 20:07:00.429434 1055056 start.go:537] Will wait 60s for crictl version
	I0717 20:07:00.429542 1055056 ssh_runner.go:195] Run: which crictl
	I0717 20:07:00.434459 1055056 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0717 20:07:00.494887 1055056 start.go:553] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  24.0.4
	RuntimeApiVersion:  v1
	I0717 20:07:00.495002 1055056 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0717 20:07:00.521727 1055056 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0717 20:07:00.552573 1055056 out.go:204] * Preparing Kubernetes v1.27.3 on Docker 24.0.4 ...
	I0717 20:07:00.552690 1055056 cli_runner.go:164] Run: docker network inspect addons-282155 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 20:07:00.569626 1055056 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0717 20:07:00.574282 1055056 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 20:07:00.587758 1055056 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0717 20:07:00.587830 1055056 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0717 20:07:00.613453 1055056 docker.go:636] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.27.3
	registry.k8s.io/kube-controller-manager:v1.27.3
	registry.k8s.io/kube-scheduler:v1.27.3
	registry.k8s.io/kube-proxy:v1.27.3
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/etcd:3.5.7-0
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0717 20:07:00.613474 1055056 docker.go:566] Images already preloaded, skipping extraction
	I0717 20:07:00.613536 1055056 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0717 20:07:00.635804 1055056 docker.go:636] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.27.3
	registry.k8s.io/kube-controller-manager:v1.27.3
	registry.k8s.io/kube-scheduler:v1.27.3
	registry.k8s.io/kube-proxy:v1.27.3
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/etcd:3.5.7-0
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0717 20:07:00.635830 1055056 cache_images.go:84] Images are preloaded, skipping loading
	I0717 20:07:00.635890 1055056 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0717 20:07:00.700395 1055056 cni.go:84] Creating CNI manager for ""
	I0717 20:07:00.700418 1055056 cni.go:149] "docker" driver + "docker" runtime found, recommending kindnet
	I0717 20:07:00.700430 1055056 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0717 20:07:00.700451 1055056 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.27.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-282155 NodeName:addons-282155 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0717 20:07:00.700590 1055056 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "addons-282155"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.27.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0717 20:07:00.700658 1055056 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.27.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-282155 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.27.3 ClusterName:addons-282155 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0717 20:07:00.700726 1055056 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.3
	I0717 20:07:00.711385 1055056 binaries.go:44] Found k8s binaries, skipping transfer
	I0717 20:07:00.711477 1055056 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0717 20:07:00.722202 1055056 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
	I0717 20:07:00.743951 1055056 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0717 20:07:00.765856 1055056 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I0717 20:07:00.787462 1055056 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0717 20:07:00.792231 1055056 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 20:07:00.806337 1055056 certs.go:56] Setting up /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155 for IP: 192.168.49.2
	I0717 20:07:00.806376 1055056 certs.go:190] acquiring lock for shared ca certs: {Name:mk81f942d4f5c721bda50f612945e6cfc625c6b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:00.806559 1055056 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.key
	I0717 20:07:01.337380 1055056 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt ...
	I0717 20:07:01.337411 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt: {Name:mkf2733294c0d4164bdb1378188c6db07ccceacd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:01.337655 1055056 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.key ...
	I0717 20:07:01.337669 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.key: {Name:mk4ba7939c33bf27812f58aed1221ed859cbbb6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:01.337801 1055056 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.key
	I0717 20:07:01.958668 1055056 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.crt ...
	I0717 20:07:01.958700 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.crt: {Name:mkcf250f5d90f5e50e5f681e3a3b1e2967f29859 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:01.958882 1055056 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.key ...
	I0717 20:07:01.958893 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.key: {Name:mk23a9dfb029db87fe7713c8c7079d292067e7ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:01.959006 1055056 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.key
	I0717 20:07:01.959041 1055056 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt with IP's: []
	I0717 20:07:02.220733 1055056 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt ...
	I0717 20:07:02.220765 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: {Name:mk0ba36b2f37a988d2ec734db974e49efb93c878 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:02.220955 1055056 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.key ...
	I0717 20:07:02.220968 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.key: {Name:mkd5880d6f33bfa6f864fa347967966b3edb3bb5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:02.221050 1055056 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.key.dd3b5fb2
	I0717 20:07:02.221070 1055056 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0717 20:07:02.686056 1055056 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.crt.dd3b5fb2 ...
	I0717 20:07:02.686094 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.crt.dd3b5fb2: {Name:mk2a6dbdcace3e31ae50b7b23a840ebbd2aa8224 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:02.686376 1055056 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.key.dd3b5fb2 ...
	I0717 20:07:02.686392 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.key.dd3b5fb2: {Name:mk693a653fbae37131633ea64a96e9f64dd72c8d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:02.686488 1055056 certs.go:337] copying /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.crt
	I0717 20:07:02.686570 1055056 certs.go:341] copying /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.key
	I0717 20:07:02.686629 1055056 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/proxy-client.key
	I0717 20:07:02.686647 1055056 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/proxy-client.crt with IP's: []
	I0717 20:07:03.201079 1055056 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/proxy-client.crt ...
	I0717 20:07:03.201111 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/proxy-client.crt: {Name:mke6d1b2a1b432572653708220e83cd6c2b7e592 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:03.201308 1055056 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/proxy-client.key ...
	I0717 20:07:03.201321 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/proxy-client.key: {Name:mka0c4dcafc506bcb6b1b0fbd94a7353f820a953 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:03.201517 1055056 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca-key.pem (1675 bytes)
	I0717 20:07:03.201561 1055056 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem (1082 bytes)
	I0717 20:07:03.201593 1055056 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem (1123 bytes)
	I0717 20:07:03.201626 1055056 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/key.pem (1679 bytes)
	I0717 20:07:03.202215 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0717 20:07:03.231634 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0717 20:07:03.262049 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0717 20:07:03.290648 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0717 20:07:03.319860 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0717 20:07:03.348465 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0717 20:07:03.377112 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0717 20:07:03.406775 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0717 20:07:03.435045 1055056 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0717 20:07:03.463562 1055056 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0717 20:07:03.484679 1055056 ssh_runner.go:195] Run: openssl version
	I0717 20:07:03.491932 1055056 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0717 20:07:03.503895 1055056 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:07:03.508834 1055056 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 17 20:07 /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:07:03.508925 1055056 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:07:03.517876 1055056 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0717 20:07:03.530182 1055056 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0717 20:07:03.534642 1055056 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0717 20:07:03.534688 1055056 kubeadm.go:404] StartCluster: {Name:addons-282155 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-282155 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clu
ster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:07:03.534812 1055056 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0717 20:07:03.555117 1055056 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0717 20:07:03.565912 1055056 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0717 20:07:03.576677 1055056 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0717 20:07:03.576779 1055056 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0717 20:07:03.587346 1055056 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0717 20:07:03.587391 1055056 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0717 20:07:03.640232 1055056 kubeadm.go:322] [init] Using Kubernetes version: v1.27.3
	I0717 20:07:03.640289 1055056 kubeadm.go:322] [preflight] Running pre-flight checks
	I0717 20:07:03.702135 1055056 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0717 20:07:03.702206 1055056 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1039-aws
	I0717 20:07:03.702244 1055056 kubeadm.go:322] OS: Linux
	I0717 20:07:03.702291 1055056 kubeadm.go:322] CGROUPS_CPU: enabled
	I0717 20:07:03.702340 1055056 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0717 20:07:03.702388 1055056 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0717 20:07:03.702436 1055056 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0717 20:07:03.702485 1055056 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0717 20:07:03.702534 1055056 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0717 20:07:03.702582 1055056 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0717 20:07:03.702631 1055056 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0717 20:07:03.702678 1055056 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0717 20:07:03.783539 1055056 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0717 20:07:03.783643 1055056 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0717 20:07:03.783805 1055056 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0717 20:07:04.128908 1055056 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0717 20:07:04.132328 1055056 out.go:204]   - Generating certificates and keys ...
	I0717 20:07:04.132462 1055056 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0717 20:07:04.132531 1055056 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0717 20:07:04.725844 1055056 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0717 20:07:05.360545 1055056 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0717 20:07:05.789107 1055056 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0717 20:07:06.832475 1055056 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0717 20:07:07.350754 1055056 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0717 20:07:07.351195 1055056 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-282155 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0717 20:07:07.872747 1055056 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0717 20:07:07.873172 1055056 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-282155 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0717 20:07:08.019657 1055056 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0717 20:07:08.223461 1055056 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0717 20:07:09.309947 1055056 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0717 20:07:09.310288 1055056 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0717 20:07:10.330782 1055056 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0717 20:07:10.962228 1055056 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0717 20:07:11.206936 1055056 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0717 20:07:11.578574 1055056 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0717 20:07:11.593287 1055056 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0717 20:07:11.594212 1055056 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0717 20:07:11.594259 1055056 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0717 20:07:11.708761 1055056 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0717 20:07:11.711138 1055056 out.go:204]   - Booting up control plane ...
	I0717 20:07:11.711243 1055056 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0717 20:07:11.720812 1055056 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0717 20:07:11.720887 1055056 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0717 20:07:11.720964 1055056 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0717 20:07:11.721109 1055056 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0717 20:07:20.222402 1055056 kubeadm.go:322] [apiclient] All control plane components are healthy after 8.502170 seconds
	I0717 20:07:20.222517 1055056 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0717 20:07:20.238024 1055056 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0717 20:07:20.764936 1055056 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0717 20:07:20.765383 1055056 kubeadm.go:322] [mark-control-plane] Marking the node addons-282155 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0717 20:07:21.276655 1055056 kubeadm.go:322] [bootstrap-token] Using token: 8fejqo.6tqsp5ot8faf43nj
	I0717 20:07:21.278726 1055056 out.go:204]   - Configuring RBAC rules ...
	I0717 20:07:21.278846 1055056 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0717 20:07:21.286121 1055056 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0717 20:07:21.294990 1055056 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0717 20:07:21.299108 1055056 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0717 20:07:21.303521 1055056 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0717 20:07:21.307646 1055056 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0717 20:07:21.323007 1055056 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0717 20:07:21.615921 1055056 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0717 20:07:21.700326 1055056 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0717 20:07:21.701831 1055056 kubeadm.go:322] 
	I0717 20:07:21.701904 1055056 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0717 20:07:21.701915 1055056 kubeadm.go:322] 
	I0717 20:07:21.701989 1055056 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0717 20:07:21.701997 1055056 kubeadm.go:322] 
	I0717 20:07:21.702022 1055056 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0717 20:07:21.704941 1055056 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0717 20:07:21.705000 1055056 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0717 20:07:21.705007 1055056 kubeadm.go:322] 
	I0717 20:07:21.705059 1055056 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0717 20:07:21.705067 1055056 kubeadm.go:322] 
	I0717 20:07:21.705112 1055056 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0717 20:07:21.705121 1055056 kubeadm.go:322] 
	I0717 20:07:21.705170 1055056 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0717 20:07:21.705245 1055056 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0717 20:07:21.705314 1055056 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0717 20:07:21.705322 1055056 kubeadm.go:322] 
	I0717 20:07:21.705589 1055056 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0717 20:07:21.705674 1055056 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0717 20:07:21.705683 1055056 kubeadm.go:322] 
	I0717 20:07:21.705951 1055056 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 8fejqo.6tqsp5ot8faf43nj \
	I0717 20:07:21.706056 1055056 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:181497bd6535e587f825fba4d8b5a5b0421f9351d7fa54688ed979dfd295018f \
	I0717 20:07:21.706252 1055056 kubeadm.go:322] 	--control-plane 
	I0717 20:07:21.706266 1055056 kubeadm.go:322] 
	I0717 20:07:21.706528 1055056 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0717 20:07:21.706540 1055056 kubeadm.go:322] 
	I0717 20:07:21.706821 1055056 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 8fejqo.6tqsp5ot8faf43nj \
	I0717 20:07:21.707105 1055056 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:181497bd6535e587f825fba4d8b5a5b0421f9351d7fa54688ed979dfd295018f 
	I0717 20:07:21.711081 1055056 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1039-aws\n", err: exit status 1
	I0717 20:07:21.711200 1055056 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0717 20:07:21.711215 1055056 cni.go:84] Creating CNI manager for ""
	I0717 20:07:21.711228 1055056 cni.go:149] "docker" driver + "docker" runtime found, recommending kindnet
	I0717 20:07:21.713777 1055056 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0717 20:07:21.715723 1055056 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0717 20:07:21.725463 1055056 cni.go:188] applying CNI manifest using /var/lib/minikube/binaries/v1.27.3/kubectl ...
	I0717 20:07:21.725479 1055056 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0717 20:07:21.757206 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0717 20:07:22.784370 1055056 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.27.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: (1.02713125s)
	I0717 20:07:22.784403 1055056 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0717 20:07:22.784483 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:22.784518 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=46c8e7c4243e42e98d29628785c0523fbabbd9b5 minikube.k8s.io/name=addons-282155 minikube.k8s.io/updated_at=2023_07_17T20_07_22_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:22.920335 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:22.920398 1055056 ops.go:34] apiserver oom_adj: -16
	I0717 20:07:23.571840 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:24.072277 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:24.571330 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:25.071471 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:25.572110 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:26.071693 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:26.571850 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:27.071919 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:27.572074 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:28.071843 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:28.572069 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:29.071481 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:29.571388 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:30.072070 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:30.571286 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:31.071637 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:31.571451 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:32.072014 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:32.571372 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:33.071858 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:33.572115 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:34.071569 1055056 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:07:34.278006 1055056 kubeadm.go:1081] duration metric: took 11.49358164s to wait for elevateKubeSystemPrivileges.
	I0717 20:07:34.278034 1055056 kubeadm.go:406] StartCluster complete in 30.743347573s
	I0717 20:07:34.278050 1055056 settings.go:142] acquiring lock: {Name:mk4d7865d9994a87a1c670ae96776b659d86982f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:34.278161 1055056 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/16890-1049210/kubeconfig
	I0717 20:07:34.278624 1055056 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/kubeconfig: {Name:mk275af4b6bc52dcf9ea47b27f78d374307de569 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:07:34.279880 1055056 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0717 20:07:34.280130 1055056 config.go:182] Loaded profile config "addons-282155": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0717 20:07:34.280267 1055056 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]
	I0717 20:07:34.280399 1055056 addons.go:69] Setting volumesnapshots=true in profile "addons-282155"
	I0717 20:07:34.280413 1055056 addons.go:231] Setting addon volumesnapshots=true in "addons-282155"
	I0717 20:07:34.280497 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.280966 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.282485 1055056 addons.go:69] Setting ingress=true in profile "addons-282155"
	I0717 20:07:34.282503 1055056 addons.go:231] Setting addon ingress=true in "addons-282155"
	I0717 20:07:34.282591 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.283141 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.283219 1055056 addons.go:69] Setting cloud-spanner=true in profile "addons-282155"
	I0717 20:07:34.283230 1055056 addons.go:231] Setting addon cloud-spanner=true in "addons-282155"
	I0717 20:07:34.283257 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.283638 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.283759 1055056 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-282155"
	I0717 20:07:34.283790 1055056 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-282155"
	I0717 20:07:34.283825 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.284188 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.284508 1055056 addons.go:69] Setting default-storageclass=true in profile "addons-282155"
	I0717 20:07:34.284525 1055056 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-282155"
	I0717 20:07:34.284774 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.284837 1055056 addons.go:69] Setting gcp-auth=true in profile "addons-282155"
	I0717 20:07:34.284848 1055056 mustload.go:65] Loading cluster: addons-282155
	I0717 20:07:34.284989 1055056 config.go:182] Loaded profile config "addons-282155": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0717 20:07:34.285177 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.285238 1055056 addons.go:69] Setting metrics-server=true in profile "addons-282155"
	I0717 20:07:34.285247 1055056 addons.go:231] Setting addon metrics-server=true in "addons-282155"
	I0717 20:07:34.285273 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.285607 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.285664 1055056 addons.go:69] Setting ingress-dns=true in profile "addons-282155"
	I0717 20:07:34.285672 1055056 addons.go:231] Setting addon ingress-dns=true in "addons-282155"
	I0717 20:07:34.285701 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.286032 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.286084 1055056 addons.go:69] Setting inspektor-gadget=true in profile "addons-282155"
	I0717 20:07:34.286091 1055056 addons.go:231] Setting addon inspektor-gadget=true in "addons-282155"
	I0717 20:07:34.286111 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.286436 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.286493 1055056 addons.go:69] Setting registry=true in profile "addons-282155"
	I0717 20:07:34.286501 1055056 addons.go:231] Setting addon registry=true in "addons-282155"
	I0717 20:07:34.286524 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.287000 1055056 addons.go:69] Setting storage-provisioner=true in profile "addons-282155"
	I0717 20:07:34.287036 1055056 addons.go:231] Setting addon storage-provisioner=true in "addons-282155"
	I0717 20:07:34.287090 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.300382 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.300860 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.379815 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0717 20:07:34.392875 1055056 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0717 20:07:34.392947 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0717 20:07:34.393048 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	W0717 20:07:34.402490 1055056 kapi.go:245] failed rescaling "coredns" deployment in "kube-system" namespace and "addons-282155" context to 1 replicas: non-retryable failure while rescaling coredns deployment: Operation cannot be fulfilled on deployments.apps "coredns": the object has been modified; please apply your changes to the latest version and try again
	E0717 20:07:34.402574 1055056 start.go:219] Unable to scale down deployment "coredns" in namespace "kube-system" to 1 replica: non-retryable failure while rescaling coredns deployment: Operation cannot be fulfilled on deployments.apps "coredns": the object has been modified; please apply your changes to the latest version and try again
	I0717 20:07:34.402610 1055056 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0717 20:07:34.404791 1055056 out.go:177] * Verifying Kubernetes components...
	I0717 20:07:34.414929 1055056 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 20:07:34.458992 1055056 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.8.1
	I0717 20:07:34.465613 1055056 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0717 20:07:34.506174 1055056 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0717 20:07:34.519127 1055056 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0717 20:07:34.519189 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16083 bytes)
	I0717 20:07:34.519268 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.529982 1055056 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I0717 20:07:34.532026 1055056 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0717 20:07:34.532044 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0717 20:07:34.532112 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.535395 1055056 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.7
	I0717 20:07:34.542883 1055056 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
	I0717 20:07:34.542908 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1003 bytes)
	I0717 20:07:34.542973 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.584579 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0717 20:07:34.587885 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0717 20:07:34.591687 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0717 20:07:34.594141 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0717 20:07:34.596446 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0717 20:07:34.600697 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0717 20:07:34.600265 1055056 addons.go:231] Setting addon default-storageclass=true in "addons-282155"
	I0717 20:07:34.602867 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.603328 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:34.605672 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0717 20:07:34.620276 1055056 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0717 20:07:34.633884 1055056 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0717 20:07:34.633951 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0717 20:07:34.634049 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.631784 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:34.641798 1055056 out.go:177]   - Using image docker.io/registry:2.8.1
	I0717 20:07:34.643647 1055056 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I0717 20:07:34.645544 1055056 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.3
	I0717 20:07:34.647271 1055056 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0717 20:07:34.647288 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0717 20:07:34.647369 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.645807 1055056 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
	I0717 20:07:34.647459 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I0717 20:07:34.647485 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.667804 1055056 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 20:07:34.669892 1055056 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:07:34.669915 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0717 20:07:34.669982 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.688106 1055056 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.18.1
	I0717 20:07:34.691825 1055056 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0717 20:07:34.691847 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0717 20:07:34.691935 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.709827 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.711170 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.799425 1055056 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0717 20:07:34.809228 1055056 node_ready.go:35] waiting up to 6m0s for node "addons-282155" to be "Ready" ...
	I0717 20:07:34.814787 1055056 node_ready.go:49] node "addons-282155" has status "Ready":"True"
	I0717 20:07:34.814855 1055056 node_ready.go:38] duration metric: took 5.54553ms waiting for node "addons-282155" to be "Ready" ...
	I0717 20:07:34.814878 1055056 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 20:07:34.841532 1055056 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0717 20:07:34.841604 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0717 20:07:34.841694 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:34.853229 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.854289 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.873243 1055056 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:34.875443 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.897444 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.918266 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.918458 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.922140 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:34.940120 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:35.276277 1055056 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0717 20:07:35.276339 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0717 20:07:35.459237 1055056 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0717 20:07:35.459260 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0717 20:07:35.510569 1055056 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
	I0717 20:07:35.510632 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0717 20:07:35.540723 1055056 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0717 20:07:35.540787 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0717 20:07:35.849976 1055056 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0717 20:07:35.850007 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0717 20:07:35.851390 1055056 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0717 20:07:35.851408 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0717 20:07:35.986853 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0717 20:07:35.995295 1055056 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0717 20:07:35.995328 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0717 20:07:35.999006 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0717 20:07:35.999119 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0717 20:07:36.060292 1055056 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0717 20:07:36.060317 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0717 20:07:36.179860 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:07:36.209336 1055056 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0717 20:07:36.209361 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0717 20:07:36.213782 1055056 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0717 20:07:36.213813 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0717 20:07:36.281600 1055056 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
	I0717 20:07:36.281630 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0717 20:07:36.297444 1055056 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0717 20:07:36.297473 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0717 20:07:36.322197 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0717 20:07:36.349619 1055056 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0717 20:07:36.349640 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0717 20:07:36.427243 1055056 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0717 20:07:36.427265 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0717 20:07:36.560598 1055056 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0717 20:07:36.560621 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0717 20:07:36.648858 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0717 20:07:36.706484 1055056 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0717 20:07:36.706507 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0717 20:07:36.809805 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0717 20:07:36.832860 1055056 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0717 20:07:36.832884 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0717 20:07:36.899230 1055056 pod_ready.go:102] pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace has status "Ready":"False"
	I0717 20:07:36.979509 1055056 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0717 20:07:36.979541 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0717 20:07:37.012066 1055056 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0717 20:07:37.012094 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0717 20:07:37.145405 1055056 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0717 20:07:37.145446 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0717 20:07:37.302660 1055056 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0717 20:07:37.302693 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0717 20:07:37.388931 1055056 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0717 20:07:37.388954 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0717 20:07:37.521408 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0717 20:07:37.686276 1055056 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
	I0717 20:07:37.686300 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0717 20:07:37.747506 1055056 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0717 20:07:37.747536 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0717 20:07:37.921995 1055056 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0717 20:07:37.922028 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I0717 20:07:37.931396 1055056 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.131891614s)
	I0717 20:07:37.931434 1055056 start.go:917] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0717 20:07:37.970764 1055056 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0717 20:07:37.970787 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0717 20:07:38.102692 1055056 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0717 20:07:38.102725 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0717 20:07:38.130033 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0717 20:07:38.310228 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0717 20:07:39.408145 1055056 pod_ready.go:102] pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace has status "Ready":"False"
	I0717 20:07:41.510222 1055056 pod_ready.go:102] pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace has status "Ready":"False"
	I0717 20:07:41.522069 1055056 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0717 20:07:41.522152 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:41.552007 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:42.266351 1055056 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0717 20:07:42.601748 1055056 addons.go:231] Setting addon gcp-auth=true in "addons-282155"
	I0717 20:07:42.601797 1055056 host.go:66] Checking if "addons-282155" exists ...
	I0717 20:07:42.602229 1055056 cli_runner.go:164] Run: docker container inspect addons-282155 --format={{.State.Status}}
	I0717 20:07:42.629006 1055056 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0717 20:07:42.629103 1055056 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-282155
	I0717 20:07:42.667290 1055056 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33995 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/addons-282155/id_rsa Username:docker}
	I0717 20:07:44.013398 1055056 pod_ready.go:102] pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace has status "Ready":"False"
	I0717 20:07:44.152680 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.165788741s)
	I0717 20:07:44.153137 1055056 addons.go:467] Verifying addon ingress=true in "addons-282155"
	I0717 20:07:44.152769 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.15363163s)
	I0717 20:07:44.152818 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.153779018s)
	I0717 20:07:44.152861 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.972977758s)
	I0717 20:07:44.152886 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (7.830667901s)
	I0717 20:07:44.152910 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.504028294s)
	I0717 20:07:44.153221 1055056 addons.go:467] Verifying addon registry=true in "addons-282155"
	I0717 20:07:44.156046 1055056 out.go:177] * Verifying registry addon...
	I0717 20:07:44.153042 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.63160694s)
	I0717 20:07:44.153096 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.023032885s)
	I0717 20:07:44.152959 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.343127623s)
	I0717 20:07:44.158778 1055056 addons.go:467] Verifying addon metrics-server=true in "addons-282155"
	I0717 20:07:44.158811 1055056 out.go:177] * Verifying ingress addon...
	W0717 20:07:44.159041 1055056 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0717 20:07:44.160807 1055056 retry.go:31] will retry after 217.422813ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0717 20:07:44.159550 1055056 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0717 20:07:44.161431 1055056 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0717 20:07:44.179594 1055056 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0717 20:07:44.179621 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:44.190773 1055056 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0717 20:07:44.190842 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:44.379044 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0717 20:07:44.690213 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:44.714206 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:45.201883 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:45.223897 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:45.702509 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:45.743891 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:46.189354 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:46.206541 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:46.409078 1055056 pod_ready.go:102] pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace has status "Ready":"False"
	I0717 20:07:46.691008 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:46.718556 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:47.041803 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (8.731522722s)
	I0717 20:07:47.041851 1055056 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-282155"
	I0717 20:07:47.041899 1055056 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (4.412863757s)
	I0717 20:07:47.045920 1055056 out.go:177] * Verifying csi-hostpath-driver addon...
	I0717 20:07:47.048448 1055056 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0717 20:07:47.049328 1055056 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0717 20:07:47.052940 1055056 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I0717 20:07:47.054851 1055056 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0717 20:07:47.054917 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0717 20:07:47.091726 1055056 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0717 20:07:47.091755 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:47.172205 1055056 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0717 20:07:47.172273 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0717 20:07:47.191006 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:47.196247 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:47.429208 1055056 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0717 20:07:47.429270 1055056 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)
	I0717 20:07:47.549651 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.170540361s)
	I0717 20:07:47.605853 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:47.631677 1055056 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0717 20:07:47.689374 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:47.702286 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:48.155366 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:48.192850 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:48.198974 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:48.603924 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:48.693703 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:48.707790 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:48.902075 1055056 pod_ready.go:102] pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace has status "Ready":"False"
	I0717 20:07:49.105631 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:49.187745 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:49.196376 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:49.598995 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:49.685400 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:49.697792 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:50.041035 1055056 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (2.409198856s)
	I0717 20:07:50.042734 1055056 addons.go:467] Verifying addon gcp-auth=true in "addons-282155"
	I0717 20:07:50.050627 1055056 out.go:177] * Verifying gcp-auth addon...
	I0717 20:07:50.054011 1055056 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0717 20:07:50.061694 1055056 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0717 20:07:50.061720 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:50.104066 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:50.185794 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:50.197476 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:50.570033 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:50.598823 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:50.685235 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:50.697702 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:51.068573 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:51.104282 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:51.185474 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:51.197009 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:51.399248 1055056 pod_ready.go:102] pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace has status "Ready":"False"
	I0717 20:07:51.566218 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:51.597343 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:51.684995 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:51.697231 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:52.065375 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:52.098191 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:52.184489 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:52.196178 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:52.403141 1055056 pod_ready.go:92] pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace has status "Ready":"True"
	I0717 20:07:52.403166 1055056 pod_ready.go:81] duration metric: took 17.526215837s waiting for pod "coredns-5d78c9869d-2l7r2" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.403179 1055056 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-d6pkg" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.581783 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:52.609961 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:52.694631 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:52.705546 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:52.922562 1055056 pod_ready.go:92] pod "coredns-5d78c9869d-d6pkg" in "kube-system" namespace has status "Ready":"True"
	I0717 20:07:52.922591 1055056 pod_ready.go:81] duration metric: took 519.403813ms waiting for pod "coredns-5d78c9869d-d6pkg" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.922630 1055056 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-282155" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.931434 1055056 pod_ready.go:92] pod "etcd-addons-282155" in "kube-system" namespace has status "Ready":"True"
	I0717 20:07:52.931458 1055056 pod_ready.go:81] duration metric: took 8.815715ms waiting for pod "etcd-addons-282155" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.931471 1055056 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-282155" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.942322 1055056 pod_ready.go:92] pod "kube-apiserver-addons-282155" in "kube-system" namespace has status "Ready":"True"
	I0717 20:07:52.942344 1055056 pod_ready.go:81] duration metric: took 10.865683ms waiting for pod "kube-apiserver-addons-282155" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.942357 1055056 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-282155" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.961880 1055056 pod_ready.go:92] pod "kube-controller-manager-addons-282155" in "kube-system" namespace has status "Ready":"True"
	I0717 20:07:52.961901 1055056 pod_ready.go:81] duration metric: took 19.535732ms waiting for pod "kube-controller-manager-addons-282155" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:52.961913 1055056 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-xlgnr" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:53.066600 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:53.097929 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:53.190246 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:53.203566 1055056 pod_ready.go:92] pod "kube-proxy-xlgnr" in "kube-system" namespace has status "Ready":"True"
	I0717 20:07:53.203598 1055056 pod_ready.go:81] duration metric: took 241.674866ms waiting for pod "kube-proxy-xlgnr" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:53.203649 1055056 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-282155" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:53.206396 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:53.566261 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:53.596514 1055056 pod_ready.go:92] pod "kube-scheduler-addons-282155" in "kube-system" namespace has status "Ready":"True"
	I0717 20:07:53.596580 1055056 pod_ready.go:81] duration metric: took 392.909567ms waiting for pod "kube-scheduler-addons-282155" in "kube-system" namespace to be "Ready" ...
	I0717 20:07:53.596610 1055056 pod_ready.go:38] duration metric: took 18.781706611s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 20:07:53.596642 1055056 api_server.go:52] waiting for apiserver process to appear ...
	I0717 20:07:53.596722 1055056 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 20:07:53.599213 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:53.635361 1055056 api_server.go:72] duration metric: took 19.232692058s to wait for apiserver process to appear ...
	I0717 20:07:53.635430 1055056 api_server.go:88] waiting for apiserver healthz status ...
	I0717 20:07:53.635460 1055056 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0717 20:07:53.646173 1055056 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0717 20:07:53.647943 1055056 api_server.go:141] control plane version: v1.27.3
	I0717 20:07:53.648004 1055056 api_server.go:131] duration metric: took 12.55469ms to wait for apiserver health ...
	I0717 20:07:53.648041 1055056 system_pods.go:43] waiting for kube-system pods to appear ...
	I0717 20:07:53.685141 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:53.697439 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:53.803924 1055056 system_pods.go:59] 18 kube-system pods found
	I0717 20:07:53.803994 1055056 system_pods.go:61] "coredns-5d78c9869d-2l7r2" [28c5e983-7885-4301-8c34-11b5c3bf9ae1] Running
	I0717 20:07:53.804017 1055056 system_pods.go:61] "coredns-5d78c9869d-d6pkg" [ea7afdf2-6470-494b-b49f-1707eaa444d1] Running
	I0717 20:07:53.804040 1055056 system_pods.go:61] "csi-hostpath-attacher-0" [bd6e74cb-322a-46f9-9aa8-d11857318055] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0717 20:07:53.804064 1055056 system_pods.go:61] "csi-hostpath-resizer-0" [57cf2132-a957-4e72-9cbb-db654c72bb48] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0717 20:07:53.804097 1055056 system_pods.go:61] "csi-hostpathplugin-fhkr5" [b010161e-ad63-4bb9-81a4-a082cda36888] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0717 20:07:53.804119 1055056 system_pods.go:61] "etcd-addons-282155" [6756b0bd-e147-47be-8d04-040157680cc7] Running
	I0717 20:07:53.804137 1055056 system_pods.go:61] "kindnet-pwpmq" [46d39c86-2253-4f02-b355-392b3ad2bd14] Running
	I0717 20:07:53.804155 1055056 system_pods.go:61] "kube-apiserver-addons-282155" [5b886441-8dda-498b-aa01-6fa958a8a082] Running
	I0717 20:07:53.804175 1055056 system_pods.go:61] "kube-controller-manager-addons-282155" [7b9a5a4c-4455-43ab-895f-8f101123e13a] Running
	I0717 20:07:53.804197 1055056 system_pods.go:61] "kube-ingress-dns-minikube" [de2527e8-e4ec-4823-85f6-9ea6ecfdff28] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0717 20:07:53.804218 1055056 system_pods.go:61] "kube-proxy-xlgnr" [b33bf66a-2717-4a03-9ade-76892366f202] Running
	I0717 20:07:53.804237 1055056 system_pods.go:61] "kube-scheduler-addons-282155" [2e31ab3e-2700-4fe4-adc3-66cb77524459] Running
	I0717 20:07:53.804256 1055056 system_pods.go:61] "metrics-server-844d8db974-gt9sk" [e0688d50-3734-4add-b6f4-20213ee09034] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0717 20:07:53.804277 1055056 system_pods.go:61] "registry-2p97m" [daf16004-5af6-400c-80ae-9740f80d8a2c] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0717 20:07:53.804298 1055056 system_pods.go:61] "registry-proxy-nz9l9" [5ac5fbf2-3eaf-495a-b138-dd47c872b0e5] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0717 20:07:53.804321 1055056 system_pods.go:61] "snapshot-controller-75bbb956b9-bh9f8" [b8ac9812-2ec9-4ef8-83ac-3bddfc45f61f] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0717 20:07:53.804798 1055056 system_pods.go:61] "snapshot-controller-75bbb956b9-ktp7s" [f0b6194d-aca6-4b6c-bd3f-0dbcfa3542b0] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0717 20:07:53.804823 1055056 system_pods.go:61] "storage-provisioner" [fd4963cc-7120-4c93-ba63-3ffbc426aeb1] Running
	I0717 20:07:53.804842 1055056 system_pods.go:74] duration metric: took 156.78261ms to wait for pod list to return data ...
	I0717 20:07:53.804862 1055056 default_sa.go:34] waiting for default service account to be created ...
	I0717 20:07:53.995030 1055056 default_sa.go:45] found service account: "default"
	I0717 20:07:53.995058 1055056 default_sa.go:55] duration metric: took 190.178165ms for default service account to be created ...
	I0717 20:07:53.995068 1055056 system_pods.go:116] waiting for k8s-apps to be running ...
	I0717 20:07:54.065969 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:54.098635 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:54.185084 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:54.197732 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:54.205663 1055056 system_pods.go:86] 18 kube-system pods found
	I0717 20:07:54.205696 1055056 system_pods.go:89] "coredns-5d78c9869d-2l7r2" [28c5e983-7885-4301-8c34-11b5c3bf9ae1] Running
	I0717 20:07:54.205704 1055056 system_pods.go:89] "coredns-5d78c9869d-d6pkg" [ea7afdf2-6470-494b-b49f-1707eaa444d1] Running
	I0717 20:07:54.205714 1055056 system_pods.go:89] "csi-hostpath-attacher-0" [bd6e74cb-322a-46f9-9aa8-d11857318055] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0717 20:07:54.205724 1055056 system_pods.go:89] "csi-hostpath-resizer-0" [57cf2132-a957-4e72-9cbb-db654c72bb48] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0717 20:07:54.205733 1055056 system_pods.go:89] "csi-hostpathplugin-fhkr5" [b010161e-ad63-4bb9-81a4-a082cda36888] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0717 20:07:54.205743 1055056 system_pods.go:89] "etcd-addons-282155" [6756b0bd-e147-47be-8d04-040157680cc7] Running
	I0717 20:07:54.205750 1055056 system_pods.go:89] "kindnet-pwpmq" [46d39c86-2253-4f02-b355-392b3ad2bd14] Running
	I0717 20:07:54.205760 1055056 system_pods.go:89] "kube-apiserver-addons-282155" [5b886441-8dda-498b-aa01-6fa958a8a082] Running
	I0717 20:07:54.205766 1055056 system_pods.go:89] "kube-controller-manager-addons-282155" [7b9a5a4c-4455-43ab-895f-8f101123e13a] Running
	I0717 20:07:54.205773 1055056 system_pods.go:89] "kube-ingress-dns-minikube" [de2527e8-e4ec-4823-85f6-9ea6ecfdff28] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0717 20:07:54.205782 1055056 system_pods.go:89] "kube-proxy-xlgnr" [b33bf66a-2717-4a03-9ade-76892366f202] Running
	I0717 20:07:54.205788 1055056 system_pods.go:89] "kube-scheduler-addons-282155" [2e31ab3e-2700-4fe4-adc3-66cb77524459] Running
	I0717 20:07:54.205795 1055056 system_pods.go:89] "metrics-server-844d8db974-gt9sk" [e0688d50-3734-4add-b6f4-20213ee09034] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0717 20:07:54.205806 1055056 system_pods.go:89] "registry-2p97m" [daf16004-5af6-400c-80ae-9740f80d8a2c] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0717 20:07:54.205815 1055056 system_pods.go:89] "registry-proxy-nz9l9" [5ac5fbf2-3eaf-495a-b138-dd47c872b0e5] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0717 20:07:54.205824 1055056 system_pods.go:89] "snapshot-controller-75bbb956b9-bh9f8" [b8ac9812-2ec9-4ef8-83ac-3bddfc45f61f] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0717 20:07:54.205837 1055056 system_pods.go:89] "snapshot-controller-75bbb956b9-ktp7s" [f0b6194d-aca6-4b6c-bd3f-0dbcfa3542b0] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0717 20:07:54.205843 1055056 system_pods.go:89] "storage-provisioner" [fd4963cc-7120-4c93-ba63-3ffbc426aeb1] Running
	I0717 20:07:54.205854 1055056 system_pods.go:126] duration metric: took 210.780727ms to wait for k8s-apps to be running ...
	I0717 20:07:54.205864 1055056 system_svc.go:44] waiting for kubelet service to be running ....
	I0717 20:07:54.205921 1055056 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 20:07:54.222544 1055056 system_svc.go:56] duration metric: took 16.671332ms WaitForService to wait for kubelet.
	I0717 20:07:54.222567 1055056 kubeadm.go:581] duration metric: took 19.819903127s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0717 20:07:54.222586 1055056 node_conditions.go:102] verifying NodePressure condition ...
	I0717 20:07:54.395230 1055056 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0717 20:07:54.395258 1055056 node_conditions.go:123] node cpu capacity is 2
	I0717 20:07:54.395272 1055056 node_conditions.go:105] duration metric: took 172.680528ms to run NodePressure ...
	I0717 20:07:54.395283 1055056 start.go:228] waiting for startup goroutines ...
	I0717 20:07:54.565443 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:54.598087 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:54.684622 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:54.696237 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:55.065690 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:55.099409 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:55.184726 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:55.195628 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:55.565626 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:55.597570 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:55.684777 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:55.696536 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:56.065654 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:56.097119 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:56.185209 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:56.195935 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:56.566673 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:56.598273 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:56.685044 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:56.695666 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:57.065667 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:57.097928 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:57.184410 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:57.196417 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:57.566346 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:57.598146 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:57.685477 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:57.696564 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:58.066029 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:58.098089 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:58.184866 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:58.195441 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:58.565679 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:58.597470 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:58.685114 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:58.699111 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:59.078032 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:59.098783 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:59.185037 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:59.196125 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:07:59.566046 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:07:59.597497 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:07:59.685167 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:07:59.696591 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:00.067616 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:00.102938 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:00.188045 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:00.198465 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:00.565756 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:00.597483 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:00.684789 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:00.696164 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:01.066291 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:01.097460 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:01.185592 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:01.196358 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:01.566293 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:01.599227 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:01.685624 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:01.695890 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:02.066062 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:02.098310 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:02.185949 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:02.198044 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:02.566775 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:02.598385 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:02.686076 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:02.705825 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:03.067596 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:03.098764 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:03.184475 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:03.197095 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:03.572445 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:03.598850 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:03.685515 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:03.701577 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:04.066526 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:04.100776 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:04.185310 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:04.197425 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:04.567112 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:04.600324 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:04.685767 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:04.698022 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:05.066760 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:05.101043 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:05.185551 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:05.196846 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:05.565974 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:05.606721 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:05.685928 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:05.696812 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:06.066477 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:06.098864 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:06.184123 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:06.196329 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:06.565095 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:06.597797 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:06.685484 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:06.697153 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:07.065737 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:07.098014 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:07.184823 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:07.196302 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:07.565447 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:07.598042 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:07.684526 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:07.696551 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:08.066333 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:08.097998 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:08.184461 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:08.196074 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:08.566227 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:08.600041 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:08.684769 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:08.696722 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 20:08:09.066838 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:09.100325 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:09.186429 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:09.197370 1055056 kapi.go:107] duration metric: took 25.037815732s to wait for kubernetes.io/minikube-addons=registry ...
	I0717 20:08:09.566399 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:09.597602 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:09.685237 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:10.076004 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:10.099073 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:10.185006 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:10.565964 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:10.597330 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:10.685417 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:11.065942 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:11.098535 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:11.184001 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:11.566020 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:11.599223 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:11.684613 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:12.066013 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:12.097924 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:12.184652 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:12.565590 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:12.598455 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:12.684927 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:13.066203 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:13.103530 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:13.184517 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:13.565317 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:13.612186 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:13.690133 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:14.066233 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:14.098414 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:14.185497 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:14.565625 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:14.598157 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:14.684862 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:15.066275 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:15.099482 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:15.186323 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:15.566511 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:15.598268 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:15.685133 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:16.066345 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:16.097730 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:16.184867 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:16.565966 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:16.597378 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:16.685633 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:17.065478 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:17.097698 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:17.184597 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:17.565778 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:17.598458 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:17.684787 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:18.065783 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:18.097783 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:18.187370 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:18.566231 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:18.599325 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:18.687832 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:19.065776 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:19.103442 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:19.184482 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:19.565357 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:19.597974 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:19.684540 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:20.066304 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:20.102300 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:20.184659 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:20.565685 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:20.597853 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:20.684044 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:21.066064 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:21.102520 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:21.184623 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:21.565105 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:21.597816 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:21.684252 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:22.065593 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:22.098162 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:22.184567 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:22.566824 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:22.603617 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:22.685734 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:23.066066 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:23.098569 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:23.185366 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:23.567654 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:23.599399 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:23.685303 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:24.067066 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:24.098280 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:24.185044 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:24.566885 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:24.598560 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:24.684472 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:25.065857 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:25.097782 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:25.185185 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:25.568717 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:25.598052 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:25.684662 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:26.066517 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:26.097812 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:26.188870 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:26.565966 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:26.597861 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:26.684401 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:27.066369 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:27.099300 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:27.185769 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:27.565674 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:27.598465 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:27.687847 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:28.065908 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:28.097521 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:28.184685 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:28.565502 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:28.597632 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:28.684333 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:29.065922 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:29.098418 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:29.184732 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:29.566881 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:29.597817 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:29.684282 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:30.066358 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:30.098728 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:30.184632 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:30.565522 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:30.600265 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:30.685540 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:31.066086 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:31.099654 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:31.184644 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:31.565508 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:31.597561 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:31.683835 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:32.068830 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:32.097941 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:32.185242 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:32.566447 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:32.597905 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:32.683980 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:33.066510 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:33.098784 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:33.184070 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:33.568929 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:33.597669 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:33.684977 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:34.067338 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:34.101583 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:34.184803 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:34.565951 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:34.598128 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:34.685745 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:35.066425 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:35.098890 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:35.184587 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:35.565924 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:35.599232 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:35.685526 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:36.066591 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:36.099985 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:36.190591 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:36.565324 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:36.597588 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 20:08:36.685409 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:37.065859 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:37.097506 1055056 kapi.go:107] duration metric: took 50.048174843s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0717 20:08:37.185015 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:37.566157 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:37.684605 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:38.065567 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:38.184225 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:38.566072 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:38.684144 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:39.066412 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:39.184362 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:39.565808 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:39.684824 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:40.065729 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:40.185433 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:40.566212 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:40.684829 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:41.067347 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:41.185969 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:41.566259 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:41.685661 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:42.066446 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:42.185500 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:42.566860 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:42.685144 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:43.066282 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:43.184053 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:43.565932 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:43.685317 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:44.065184 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:44.184082 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:44.565845 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:44.685198 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:45.066687 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:45.185409 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:45.565909 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:45.684332 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:46.066329 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:46.184832 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:46.565895 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:46.684556 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:47.065468 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:47.183828 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:47.565487 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:47.683979 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:48.066148 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:48.184217 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:48.566527 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:48.684598 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:49.066225 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:49.185490 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:49.565555 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:49.684644 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:50.065752 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:50.184650 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:50.565910 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:50.683995 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:51.066201 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:51.184897 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:51.565926 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:51.684586 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:52.066244 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:52.185328 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:52.565068 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:52.684568 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:53.065424 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:53.183840 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:53.565918 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:53.684460 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:54.066060 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:54.185352 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:54.566037 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:54.684537 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:55.066277 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:55.184559 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:55.566389 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:55.685594 1055056 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 20:08:56.068484 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:56.184460 1055056 kapi.go:107] duration metric: took 1m12.0230255s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0717 20:08:56.566135 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:57.070363 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:57.565339 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:58.066469 1055056 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 20:08:58.565916 1055056 kapi.go:107] duration metric: took 1m8.511905139s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0717 20:08:58.568186 1055056 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-282155 cluster.
	I0717 20:08:58.570093 1055056 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0717 20:08:58.571814 1055056 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0717 20:08:58.573812 1055056 out.go:177] * Enabled addons: default-storageclass, ingress-dns, storage-provisioner, cloud-spanner, metrics-server, inspektor-gadget, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I0717 20:08:58.576143 1055056 addons.go:502] enable addons completed in 1m24.295874105s: enabled=[default-storageclass ingress-dns storage-provisioner cloud-spanner metrics-server inspektor-gadget volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I0717 20:08:58.576198 1055056 start.go:233] waiting for cluster config update ...
	I0717 20:08:58.576222 1055056 start.go:242] writing updated cluster config ...
	I0717 20:08:58.576538 1055056 ssh_runner.go:195] Run: rm -f paused
	I0717 20:08:58.644394 1055056 start.go:578] kubectl: 1.27.3, cluster: 1.27.3 (minor skew: 0)
	I0717 20:08:58.646876 1055056 out.go:177] * Done! kubectl is now configured to use "addons-282155" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Jul 17 20:09:11 addons-282155 dockerd[1096]: time="2023-07-17T20:09:11.182219133Z" level=info msg="ignoring event" container=06829cd5aa045dd9bcbff4ed3a71b3632f2e3fbc26002203b921e6c2ae483bf2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:11 addons-282155 dockerd[1096]: time="2023-07-17T20:09:11.273695517Z" level=info msg="ignoring event" container=5bff66b0d1c79e799d60b58d296a33aadd2220fe864d7b37aeaebf3d77b5f1b4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:12 addons-282155 dockerd[1096]: time="2023-07-17T20:09:12.664331812Z" level=info msg="ignoring event" container=be55c2cbde3c5fe9d8c03f79650ad2b6313e31da87103c972abcc38d08a7200e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:13 addons-282155 dockerd[1096]: time="2023-07-17T20:09:13.622028665Z" level=info msg="ignoring event" container=31da8b70b9a165371d4e35194c31b84e04d66869ac89ffbc86f54c9450f0dea2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:13 addons-282155 dockerd[1096]: time="2023-07-17T20:09:13.686703624Z" level=info msg="ignoring event" container=3825a6f4a4bd70606e8aeb8f9bdac6fdc2d7919ebe7c076a7a3a800a765584b8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:13 addons-282155 dockerd[1096]: time="2023-07-17T20:09:13.841573703Z" level=info msg="ignoring event" container=30ef84eec41cd310846ddc2f2f4af0be840454b762c2c471849b8f90b8a8842e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:13 addons-282155 dockerd[1096]: time="2023-07-17T20:09:13.929516304Z" level=info msg="ignoring event" container=b549a08a6b5d3a6503ab6e20ec3d84fde4f6c62ad62bc0c689d901d1919a01f5 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:15 addons-282155 cri-dockerd[1306]: time="2023-07-17T20:09:15Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/f8c55136dfb496da48877588df800f560c54d330bf31b2b62191c40596876be8/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	Jul 17 20:09:16 addons-282155 dockerd[1096]: time="2023-07-17T20:09:16.194438705Z" level=info msg="ignoring event" container=292ac2c2c0adece75c90b082174c05e46c7a751f017663ca907367219dc4e740 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:16 addons-282155 dockerd[1096]: time="2023-07-17T20:09:16.358495879Z" level=info msg="ignoring event" container=8737fd8bde8680e2a57777b12f10a55afc0fe82c4cb1355569a0d8adaf4fda29 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:17 addons-282155 cri-dockerd[1306]: time="2023-07-17T20:09:17Z" level=info msg="Stop pulling image docker.io/nginx:alpine: Status: Downloaded newer image for nginx:alpine"
	Jul 17 20:09:23 addons-282155 cri-dockerd[1306]: time="2023-07-17T20:09:23Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/78efc8937375cd606a9cc1a76643db4e514c3e447f942403c7fd33f23a436eec/resolv.conf as [nameserver 10.96.0.10 search headlamp.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	Jul 17 20:09:23 addons-282155 dockerd[1096]: time="2023-07-17T20:09:23.333572537Z" level=warning msg="reference for unknown type: " digest="sha256:67ba87b88218563eec9684525904936609713b02dcbcf4390cd055766217ed45" remote="ghcr.io/headlamp-k8s/headlamp@sha256:67ba87b88218563eec9684525904936609713b02dcbcf4390cd055766217ed45"
	Jul 17 20:09:25 addons-282155 dockerd[1096]: time="2023-07-17T20:09:25.362212141Z" level=info msg="ignoring event" container=0b6725703fb64ba905c6835f153d9488884f93bd233687f38c0db397c2b5e70b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:25 addons-282155 cri-dockerd[1306]: time="2023-07-17T20:09:25Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/c649e438859aae9dbfc5daae58cbb1c2c0de6d7a7fdab733c821549e60337f52/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	Jul 17 20:09:27 addons-282155 cri-dockerd[1306]: time="2023-07-17T20:09:27Z" level=info msg="Stop pulling image ghcr.io/headlamp-k8s/headlamp:v0.18.0@sha256:67ba87b88218563eec9684525904936609713b02dcbcf4390cd055766217ed45: Status: Downloaded newer image for ghcr.io/headlamp-k8s/headlamp@sha256:67ba87b88218563eec9684525904936609713b02dcbcf4390cd055766217ed45"
	Jul 17 20:09:29 addons-282155 cri-dockerd[1306]: time="2023-07-17T20:09:29Z" level=info msg="Stop pulling image gcr.io/google-samples/hello-app:1.0: Status: Downloaded newer image for gcr.io/google-samples/hello-app:1.0"
	Jul 17 20:09:29 addons-282155 dockerd[1096]: time="2023-07-17T20:09:29.457406178Z" level=info msg="ignoring event" container=ffa35aadf0b28ee6633fa23038112447ccec64ea8975bd2b94e9423a0028c492 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:29 addons-282155 dockerd[1096]: time="2023-07-17T20:09:29.668656846Z" level=info msg="ignoring event" container=a08299f037e6e20f0363855c6233a79332522b34cc9954939fd8ea47a42e1a97 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:40 addons-282155 dockerd[1096]: time="2023-07-17T20:09:40.886401410Z" level=info msg="ignoring event" container=bdc0733b27fe53be955f780d2047904be4c2ebf4c2e20b155c92e1081c75ac3d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:43 addons-282155 dockerd[1096]: time="2023-07-17T20:09:43.552589735Z" level=info msg="Container failed to exit within 1s of signal 15 - using the force" container=5d1fbecfd70230d6371482e5f634aa54ee10aa173df50e53f8b54925044c1c08
	Jul 17 20:09:43 addons-282155 dockerd[1096]: time="2023-07-17T20:09:43.629406314Z" level=info msg="ignoring event" container=5d1fbecfd70230d6371482e5f634aa54ee10aa173df50e53f8b54925044c1c08 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:43 addons-282155 dockerd[1096]: time="2023-07-17T20:09:43.744504942Z" level=info msg="ignoring event" container=ff85d191520a3973b7908a3d66e03dd0eef192886d0b31d7a15e2049cf98e1e7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:46 addons-282155 dockerd[1096]: time="2023-07-17T20:09:46.955565015Z" level=info msg="ignoring event" container=9605b5ecbabece668a7b6ff9a1147192a189e541c620d3bca64a3e8441bb2bd9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:09:50 addons-282155 cri-dockerd[1306]: time="2023-07-17T20:09:50Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/56d0a14d4074d2413d61de8cc769b58c570fada263eebad37ae112062e279f1e/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                                                        CREATED              STATE               NAME                                     ATTEMPT             POD ID              POD
	9605b5ecbabec       13753a81eccfd                                                                                                                                4 seconds ago        Exited              hello-world-app                          2                   c649e438859aa       hello-world-app-65bdb79f98-v4q7p
	a982352c9019e       ghcr.io/headlamp-k8s/headlamp@sha256:67ba87b88218563eec9684525904936609713b02dcbcf4390cd055766217ed45                                        23 seconds ago       Running             headlamp                                 0                   78efc8937375c       headlamp-66f6498c69-ssp2s
	47f754e9aaace       nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6                                                                33 seconds ago       Running             nginx                                    0                   f8c55136dfb49       nginx
	965da4ad70b3a       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf                                 54 seconds ago       Running             gcp-auth                                 0                   6a05d4e80929e       gcp-auth-58478865f7-8hn8b
	caf39c37553f3       registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f                          About a minute ago   Running             csi-snapshotter                          0                   8d0b8ef1231f1       csi-hostpathplugin-fhkr5
	6fa8b68e120e8       registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8                          About a minute ago   Running             csi-provisioner                          0                   8d0b8ef1231f1       csi-hostpathplugin-fhkr5
	c0b6942f0b877       registry.k8s.io/sig-storage/livenessprobe@sha256:cacee2b5c36dd59d4c7e8469c05c9e4ef53ecb2df9025fa8c10cdaf61bce62f0                            About a minute ago   Running             liveness-probe                           0                   8d0b8ef1231f1       csi-hostpathplugin-fhkr5
	a34767377641e       registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5                           About a minute ago   Running             hostpath                                 0                   8d0b8ef1231f1       csi-hostpathplugin-fhkr5
	1ed7bfac68a16       registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f1c25991bac2fbb7f5fcf91ed9438df31e30edee6bed5a780464238aa09ad24c                About a minute ago   Running             node-driver-registrar                    0                   8d0b8ef1231f1       csi-hostpathplugin-fhkr5
	bf367ca4461f7       registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b                             About a minute ago   Running             csi-attacher                             0                   eb666357db751       csi-hostpath-attacher-0
	31f938b9d2b4a       registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7                              About a minute ago   Running             csi-resizer                              0                   98c11e11a0390       csi-hostpath-resizer-0
	b4916cbe9ca06       registry.k8s.io/sig-storage/csi-external-health-monitor-controller@sha256:80b9ba94aa2afe24553d69bd165a6a51552d1582d68618ec00d3b804a7d9193c   About a minute ago   Running             csi-external-health-monitor-controller   0                   8d0b8ef1231f1       csi-hostpathplugin-fhkr5
	75271d2487425       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:543c40fd093964bc9ab509d3e791f9989963021f1e9e4c9c7b6700b02bfb227b                   About a minute ago   Exited              patch                                    0                   845a2fbdc570b       ingress-nginx-admission-patch-g2b8r
	631d0c7294437       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:543c40fd093964bc9ab509d3e791f9989963021f1e9e4c9c7b6700b02bfb227b                   About a minute ago   Exited              create                                   0                   722cbf473dc7b       ingress-nginx-admission-create-nn69x
	86cda35b0c817       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280                      About a minute ago   Running             volume-snapshot-controller               0                   060e1a2a20c39       snapshot-controller-75bbb956b9-ktp7s
	1facbd9092272       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280                      About a minute ago   Running             volume-snapshot-controller               0                   f594efbd6fb8f       snapshot-controller-75bbb956b9-bh9f8
	27c610ea070a6       97e04611ad434                                                                                                                                About a minute ago   Running             coredns                                  1                   71fff3dfacbf7       coredns-5d78c9869d-d6pkg
	5919df0112f3f       97e04611ad434                                                                                                                                2 minutes ago        Running             coredns                                  1                   61ec4ea501f73       coredns-5d78c9869d-2l7r2
	9d9431b9a1f27       ba04bb24b9575                                                                                                                                2 minutes ago        Running             storage-provisioner                      0                   0d36eb577edce       storage-provisioner
	74a91bb2a3668       kindest/kindnetd@sha256:6c00e28db008c2afa67d9ee085c86184ec9ae5281d5ae1bd15006746fb9a1974                                                     2 minutes ago        Running             kindnet-cni                              0                   f053fd2525452       kindnet-pwpmq
	7584f536b896c       97e04611ad434                                                                                                                                2 minutes ago        Exited              coredns                                  0                   240dedf7b7a9e       coredns-5d78c9869d-d6pkg
	ca0de60bb440b       97e04611ad434                                                                                                                                2 minutes ago        Exited              coredns                                  0                   32d01d847200f       coredns-5d78c9869d-2l7r2
	ee10dbc55a858       fb73e92641fd5                                                                                                                                2 minutes ago        Running             kube-proxy                               0                   4454e44941fd4       kube-proxy-xlgnr
	a33f893087082       39dfb036b0986                                                                                                                                2 minutes ago        Running             kube-apiserver                           0                   f6f3f2eb86ff0       kube-apiserver-addons-282155
	531721af67b64       bcb9e554eaab6                                                                                                                                2 minutes ago        Running             kube-scheduler                           0                   3a53cf6d8018b       kube-scheduler-addons-282155
	c371df10dfaab       24bc64e911039                                                                                                                                2 minutes ago        Running             etcd                                     0                   b1f4b5d4c35c0       etcd-addons-282155
	cb0ac545e91ea       ab3683b584ae5                                                                                                                                2 minutes ago        Running             kube-controller-manager                  0                   7e89be0a41d8f       kube-controller-manager-addons-282155
	
	* 
	* ==> coredns [27c610ea070a] <==
	* .:53
	[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
	CoreDNS-1.10.1
	linux/arm64, go1.20, 055b2c3
	[INFO] Reloading
	[INFO] plugin/reload: Running configuration SHA512 = 05e3eaddc414b2d71a69b2e2bc6f2681fc1f4d04bcdd3acc1a41457bb7db518208b95ddfc4c9fffedc59c25a8faf458be1af4915a4a3c0d6777cb7a346bc5d86
	[INFO] Reloading complete
	[INFO] 127.0.0.1:51985 - 53611 "HINFO IN 8750950107366445934.557546118649981317. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.027921588s
	[INFO] 10.244.0.18:39792 - 31244 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00014519s
	[INFO] 10.244.0.18:35957 - 58493 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.003386205s
	[INFO] 10.244.0.18:52936 - 63490 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.003243141s
	[INFO] 10.244.0.18:43659 - 36413 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.00099154s
	[INFO] 10.244.0.19:32796 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000249239s
	[INFO] 10.244.0.17:38897 - 46096 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000184377s
	[INFO] 10.244.0.17:38897 - 57280 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000155134s
	[INFO] 10.244.0.17:38897 - 52454 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000127942s
	[INFO] 10.244.0.17:38897 - 9677 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000326933s
	[INFO] 10.244.0.17:38897 - 24899 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000128648s
	[INFO] 10.244.0.17:38897 - 52258 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000169583s
	[INFO] 10.244.0.17:38897 - 22307 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001799555s
	[INFO] 10.244.0.17:38897 - 58503 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002320556s
	[INFO] 10.244.0.17:38897 - 62871 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.00011488s
	
	* 
	* ==> coredns [5919df0112f3] <==
	* [INFO] 10.244.0.17:33811 - 54161 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000130158s
	[INFO] 10.244.0.17:33811 - 28497 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000111196s
	[INFO] 10.244.0.17:33811 - 1925 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00010752s
	[INFO] 10.244.0.17:33811 - 58717 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00011744s
	[INFO] 10.244.0.17:33811 - 11514 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002598234s
	[INFO] 10.244.0.17:33811 - 26229 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.004915246s
	[INFO] 10.244.0.17:33811 - 56315 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000124218s
	[INFO] 10.244.0.17:43828 - 19611 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000139249s
	[INFO] 10.244.0.17:43828 - 30778 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000152032s
	[INFO] 10.244.0.17:37354 - 7546 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000061079s
	[INFO] 10.244.0.17:37354 - 2623 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000091028s
	[INFO] 10.244.0.17:43828 - 42461 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00007314s
	[INFO] 10.244.0.17:37354 - 59999 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000055122s
	[INFO] 10.244.0.17:43828 - 45438 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000057075s
	[INFO] 10.244.0.17:43828 - 27589 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000044274s
	[INFO] 10.244.0.17:37354 - 15468 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000044094s
	[INFO] 10.244.0.17:37354 - 9952 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000048607s
	[INFO] 10.244.0.17:43828 - 53489 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000052037s
	[INFO] 10.244.0.17:37354 - 41951 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000041592s
	[INFO] 10.244.0.17:43828 - 2736 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.005900664s
	[INFO] 10.244.0.17:37354 - 42601 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.005408103s
	[INFO] 10.244.0.17:43828 - 48726 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002204224s
	[INFO] 10.244.0.17:37354 - 48197 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001616376s
	[INFO] 10.244.0.17:37354 - 53169 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000053399s
	[INFO] 10.244.0.17:43828 - 3936 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000100422s
	
	* 
	* ==> coredns [7584f536b896] <==
	* [INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
	CoreDNS-1.10.1
	linux/arm64, go1.20, 055b2c3
	[INFO] plugin/health: Going into lameduck mode for 5s
	[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: network is unreachable
	[ERROR] plugin/errors: 2 3827957461068021534.3955389872160053388. HINFO: dial udp 192.168.49.1:53: connect: network is unreachable
	[ERROR] plugin/errors: 2 3827957461068021534.3955389872160053388. HINFO: dial udp 192.168.49.1:53: connect: network is unreachable
	
	* 
	* ==> coredns [ca0de60bb440] <==
	* [INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
	CoreDNS-1.10.1
	linux/arm64, go1.20, 055b2c3
	[INFO] plugin/health: Going into lameduck mode for 5s
	[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: network is unreachable
	[ERROR] plugin/errors: 2 7691449039677172756.9099289081042588512. HINFO: dial udp 192.168.49.1:53: connect: network is unreachable
	[ERROR] plugin/errors: 2 7691449039677172756.9099289081042588512. HINFO: dial udp 192.168.49.1:53: connect: network is unreachable
	
	* 
	* ==> describe nodes <==
	* Name:               addons-282155
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-282155
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=46c8e7c4243e42e98d29628785c0523fbabbd9b5
	                    minikube.k8s.io/name=addons-282155
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_07_17T20_07_22_0700
	                    minikube.k8s.io/version=v1.30.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-282155
	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-282155"}
	                    kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 17 Jul 2023 20:07:18 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-282155
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 17 Jul 2023 20:09:45 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 17 Jul 2023 20:09:25 +0000   Mon, 17 Jul 2023 20:07:14 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 17 Jul 2023 20:09:25 +0000   Mon, 17 Jul 2023 20:07:14 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 17 Jul 2023 20:09:25 +0000   Mon, 17 Jul 2023 20:07:14 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 17 Jul 2023 20:09:25 +0000   Mon, 17 Jul 2023 20:07:22 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-282155
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	System Info:
	  Machine ID:                 bd71b6909bde45719ede40b371163b62
	  System UUID:                4165d794-56d1-44de-ac2b-2a10eec3cf9b
	  Boot ID:                    b82ddf7c-3e5c-4bee-beb9-2ca767fc047e
	  Kernel Version:             5.15.0-1039-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.4
	  Kubelet Version:            v1.27.3
	  Kube-Proxy Version:         v1.27.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (19 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-65bdb79f98-v4q7p         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         37s
	  default                     task-pv-pod                              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2s
	  gcp-auth                    gcp-auth-58478865f7-8hn8b                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m2s
	  headlamp                    headlamp-66f6498c69-ssp2s                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         29s
	  kube-system                 coredns-5d78c9869d-2l7r2                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     2m17s
	  kube-system                 coredns-5d78c9869d-d6pkg                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     2m17s
	  kube-system                 csi-hostpath-attacher-0                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m5s
	  kube-system                 csi-hostpath-resizer-0                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m4s
	  kube-system                 csi-hostpathplugin-fhkr5                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m5s
	  kube-system                 etcd-addons-282155                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         2m29s
	  kube-system                 kindnet-pwpmq                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      2m17s
	  kube-system                 kube-apiserver-addons-282155             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m29s
	  kube-system                 kube-controller-manager-addons-282155    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m32s
	  kube-system                 kube-proxy-xlgnr                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m17s
	  kube-system                 kube-scheduler-addons-282155             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m29s
	  kube-system                 snapshot-controller-75bbb956b9-bh9f8     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m10s
	  kube-system                 snapshot-controller-75bbb956b9-ktp7s     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m10s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m12s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%!)(MISSING)  100m (5%!)(MISSING)
	  memory             290Mi (3%!)(MISSING)  390Mi (4%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 2m15s  kube-proxy       
	  Normal  Starting                 2m30s  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m30s  kubelet          Node addons-282155 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m30s  kubelet          Node addons-282155 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m30s  kubelet          Node addons-282155 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             2m30s  kubelet          Node addons-282155 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  2m30s  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                2m29s  kubelet          Node addons-282155 status is now: NodeReady
	  Normal  RegisteredNode           2m18s  node-controller  Node addons-282155 event: Registered Node addons-282155 in Controller
	
	* 
	* ==> dmesg <==
	* [  +0.001050] FS-Cache: O-key=[8] '253e5c0100000000'
	[  +0.000696] FS-Cache: N-cookie c=0000003d [p=00000039 fl=2 nc=0 na=1]
	[  +0.000884] FS-Cache: N-cookie d=000000000ec8a001{9p.inode} n=0000000045325351
	[  +0.000995] FS-Cache: N-key=[8] '253e5c0100000000'
	[  +0.323341] FS-Cache: Duplicate cookie detected
	[  +0.000675] FS-Cache: O-cookie c=0000003a [p=00000039 fl=226 nc=0 na=1]
	[  +0.000924] FS-Cache: O-cookie d=000000000ec8a001{9p.inode} n=000000000e81f5b3
	[  +0.001092] FS-Cache: O-key=[8] '233e5c0100000000'
	[  +0.000682] FS-Cache: N-cookie c=0000003e [p=00000039 fl=2 nc=0 na=1]
	[  +0.000895] FS-Cache: N-cookie d=000000000ec8a001{9p.inode} n=00000000a2585c06
	[  +0.001006] FS-Cache: N-key=[8] '233e5c0100000000'
	[  +0.001687] FS-Cache: Duplicate cookie detected
	[  +0.000680] FS-Cache: O-cookie c=0000003b [p=00000039 fl=226 nc=0 na=1]
	[  +0.000930] FS-Cache: O-cookie d=000000000ec8a001{9p.inode} n=000000003de8c4a0
	[  +0.001036] FS-Cache: O-key=[8] '253e5c0100000000'
	[  +0.000763] FS-Cache: N-cookie c=0000003f [p=00000039 fl=2 nc=0 na=1]
	[  +0.000920] FS-Cache: N-cookie d=000000000ec8a001{9p.inode} n=00000000b5678fd7
	[  +0.001002] FS-Cache: N-key=[8] '253e5c0100000000'
	[  +0.001513] FS-Cache: Duplicate cookie detected
	[  +0.000707] FS-Cache: O-cookie c=0000003c [p=00000039 fl=226 nc=0 na=1]
	[  +0.000934] FS-Cache: O-cookie d=000000000ec8a001{9p.inode} n=0000000082d58596
	[  +0.001017] FS-Cache: O-key=[8] '243e5c0100000000'
	[  +0.000681] FS-Cache: N-cookie c=00000040 [p=00000039 fl=2 nc=0 na=1]
	[  +0.000924] FS-Cache: N-cookie d=000000000ec8a001{9p.inode} n=00000000c5282cab
	[  +0.001000] FS-Cache: N-key=[8] '243e5c0100000000'
	
	* 
	* ==> etcd [c371df10dfaa] <==
	* {"level":"info","ts":"2023-07-17T20:07:14.070Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-07-17T20:07:14.070Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-07-17T20:07:14.070Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-07-17T20:07:14.070Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-07-17T20:07:14.070Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-07-17T20:07:14.071Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2023-07-17T20:07:14.071Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-07-17T20:07:14.731Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-07-17T20:07:14.731Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-07-17T20:07:14.732Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-07-17T20:07:14.732Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-07-17T20:07:14.732Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-07-17T20:07:14.732Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-07-17T20:07:14.732Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-07-17T20:07:14.735Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-17T20:07:14.742Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-282155 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-07-17T20:07:14.742Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-07-17T20:07:14.742Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-17T20:07:14.742Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-17T20:07:14.742Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-17T20:07:14.742Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-07-17T20:07:14.744Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2023-07-17T20:07:14.742Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-07-17T20:07:14.744Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2023-07-17T20:07:14.760Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.49.2:2379"}
	
	* 
	* ==> gcp-auth [965da4ad70b3] <==
	* 2023/07/17 20:08:57 GCP Auth Webhook started!
	2023/07/17 20:09:08 Ready to marshal response ...
	2023/07/17 20:09:08 Ready to write response ...
	2023/07/17 20:09:14 Ready to marshal response ...
	2023/07/17 20:09:14 Ready to write response ...
	2023/07/17 20:09:22 Ready to marshal response ...
	2023/07/17 20:09:22 Ready to write response ...
	2023/07/17 20:09:22 Ready to marshal response ...
	2023/07/17 20:09:22 Ready to write response ...
	2023/07/17 20:09:22 Ready to marshal response ...
	2023/07/17 20:09:22 Ready to write response ...
	2023/07/17 20:09:24 Ready to marshal response ...
	2023/07/17 20:09:24 Ready to write response ...
	2023/07/17 20:09:49 Ready to marshal response ...
	2023/07/17 20:09:49 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  20:09:51 up  4:52,  0 users,  load average: 2.40, 3.10, 2.92
	Linux addons-282155 5.15.0-1039-aws #44~20.04.1-Ubuntu SMP Thu Jun 22 12:21:08 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kindnet [74a91bb2a366] <==
	* I0717 20:07:47.848292       1 main.go:227] handling current node
	I0717 20:07:57.859305       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:07:57.859344       1 main.go:227] handling current node
	I0717 20:08:07.871399       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:08:07.871429       1 main.go:227] handling current node
	I0717 20:08:17.876056       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:08:17.876083       1 main.go:227] handling current node
	I0717 20:08:27.888349       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:08:27.888375       1 main.go:227] handling current node
	I0717 20:08:37.892929       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:08:37.892958       1 main.go:227] handling current node
	I0717 20:08:47.903523       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:08:47.903553       1 main.go:227] handling current node
	I0717 20:08:57.907813       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:08:57.907841       1 main.go:227] handling current node
	I0717 20:09:07.920442       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:09:07.920471       1 main.go:227] handling current node
	I0717 20:09:17.932856       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:09:17.932891       1 main.go:227] handling current node
	I0717 20:09:27.940410       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:09:27.940437       1 main.go:227] handling current node
	I0717 20:09:37.944085       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:09:37.944115       1 main.go:227] handling current node
	I0717 20:09:47.955211       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 20:09:47.955245       1 main.go:227] handling current node
	
	* 
	* ==> kube-apiserver [a33f89308708] <==
	* I0717 20:07:46.728895       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
	I0717 20:07:46.959603       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-resizer" clusterIPs=map[IPv4:10.109.16.205]
	I0717 20:07:49.774657       1 alloc.go:330] "allocated clusterIPs" service="gcp-auth/gcp-auth" clusterIPs=map[IPv4:10.102.125.27]
	E0717 20:08:09.900551       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.4.34:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.4.34:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.101.4.34:443: connect: connection refused
	E0717 20:08:09.902780       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.4.34:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.4.34:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.101.4.34:443: connect: connection refused
	I0717 20:08:09.903300       1 handler_discovery.go:325] DiscoveryManager: Failed to download discovery for kube-system/metrics-server:443: 503 error trying to reach service: dial tcp 10.101.4.34:443: connect: connection refused
	I0717 20:08:09.903334       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	E0717 20:08:09.906741       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.4.34:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.4.34:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.101.4.34:443: connect: connection refused
	E0717 20:08:09.928733       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.4.34:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.4.34:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.101.4.34:443: connect: connection refused
	I0717 20:08:10.079346       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0717 20:08:18.332798       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	http2: server: error reading preface from client 192.168.49.1:52768: read tcp 192.168.49.2:8443->192.168.49.1:52768: read: connection reset by peer
	E0717 20:09:10.919402       1 handler_proxy.go:144] error resolving kube-system/metrics-server: service "metrics-server" not found
	W0717 20:09:10.919431       1 handler_proxy.go:100] no RequestInfo found in the context
	E0717 20:09:10.919463       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0717 20:09:10.919471       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0717 20:09:10.953503       1 controller.go:132] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
	I0717 20:09:14.401786       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
	I0717 20:09:14.777602       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs=map[IPv4:10.104.129.98]
	I0717 20:09:15.794479       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	I0717 20:09:15.806267       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W0717 20:09:16.838037       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I0717 20:09:22.633152       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs=map[IPv4:10.109.216.149]
	I0717 20:09:25.050204       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs=map[IPv4:10.97.193.3]
	
	* 
	* ==> kube-controller-manager [cb0ac545e91e] <==
	* I0717 20:09:00.179606       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch
	E0717 20:09:16.840304       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource
	W0717 20:09:18.094534       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0717 20:09:18.094575       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0717 20:09:19.924919       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0717 20:09:19.924958       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0717 20:09:22.665406       1 event.go:307] "Event occurred" object="headlamp/headlamp" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set headlamp-66f6498c69 to 1"
	I0717 20:09:22.702691       1 event.go:307] "Event occurred" object="headlamp/headlamp-66f6498c69" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: headlamp-66f6498c69-ssp2s"
	W0717 20:09:24.200538       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0717 20:09:24.200575       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0717 20:09:24.694209       1 event.go:307] "Event occurred" object="default/hello-world-app" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-world-app-65bdb79f98 to 1"
	I0717 20:09:24.724056       1 event.go:307] "Event occurred" object="default/hello-world-app-65bdb79f98" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-world-app-65bdb79f98-v4q7p"
	I0717 20:09:25.931450       1 namespace_controller.go:182] "Namespace has been deleted" namespace="gadget"
	I0717 20:09:33.597631       1 shared_informer.go:311] Waiting for caches to sync for resource quota
	I0717 20:09:33.597667       1 shared_informer.go:318] Caches are synced for resource quota
	I0717 20:09:34.064780       1 shared_informer.go:311] Waiting for caches to sync for garbage collector
	I0717 20:09:34.064831       1 shared_informer.go:318] Caches are synced for garbage collector
	I0717 20:09:34.077091       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0717 20:09:34.078495       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	W0717 20:09:36.988060       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0717 20:09:36.988096       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0717 20:09:42.478976       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-create
	I0717 20:09:42.503323       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-patch
	I0717 20:09:48.316585       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0717 20:09:48.387116       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	
	* 
	* ==> kube-proxy [ee10dbc55a85] <==
	* I0717 20:07:35.721072       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0717 20:07:35.721169       1 server_others.go:110] "Detected node IP" address="192.168.49.2"
	I0717 20:07:35.721191       1 server_others.go:554] "Using iptables proxy"
	I0717 20:07:35.760662       1 server_others.go:192] "Using iptables Proxier"
	I0717 20:07:35.760699       1 server_others.go:199] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0717 20:07:35.760708       1 server_others.go:200] "Creating dualStackProxier for iptables"
	I0717 20:07:35.760726       1 server_others.go:484] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, defaulting to no-op detect-local for IPv6"
	I0717 20:07:35.760788       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0717 20:07:35.761322       1 server.go:658] "Version info" version="v1.27.3"
	I0717 20:07:35.761343       1 server.go:660] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0717 20:07:35.765361       1 config.go:188] "Starting service config controller"
	I0717 20:07:35.765412       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0717 20:07:35.765436       1 config.go:97] "Starting endpoint slice config controller"
	I0717 20:07:35.765441       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0717 20:07:35.769649       1 config.go:315] "Starting node config controller"
	I0717 20:07:35.769663       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0717 20:07:35.866408       1 shared_informer.go:318] Caches are synced for service config
	I0717 20:07:35.867832       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0717 20:07:35.870146       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [531721af67b6] <==
	* W0717 20:07:18.599244       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0717 20:07:18.599267       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W0717 20:07:18.599446       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0717 20:07:18.599595       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0717 20:07:18.599314       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0717 20:07:18.599629       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0717 20:07:18.599525       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0717 20:07:18.599667       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0717 20:07:19.396949       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0717 20:07:19.397209       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0717 20:07:19.476592       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0717 20:07:19.476860       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0717 20:07:19.485578       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0717 20:07:19.485825       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0717 20:07:19.527509       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0717 20:07:19.527776       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0717 20:07:19.554303       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0717 20:07:19.554572       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0717 20:07:19.574455       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0717 20:07:19.574583       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0717 20:07:19.592549       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0717 20:07:19.592765       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0717 20:07:19.652703       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0717 20:07:19.652929       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	I0717 20:07:20.042106       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Jul 17 20:09:43 addons-282155 kubelet[2330]: I0717 20:09:43.833441    2330 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=0ef5dccc-7f4d-4780-9df6-93d7d8cadcf0 path="/var/lib/kubelet/pods/0ef5dccc-7f4d-4780-9df6-93d7d8cadcf0/volumes"
	Jul 17 20:09:43 addons-282155 kubelet[2330]: I0717 20:09:43.877909    2330 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fljsh\" (UniqueName: \"kubernetes.io/projected/c81fbdf1-21cd-46c9-a32c-1318828027b8-kube-api-access-fljsh\") pod \"c81fbdf1-21cd-46c9-a32c-1318828027b8\" (UID: \"c81fbdf1-21cd-46c9-a32c-1318828027b8\") "
	Jul 17 20:09:43 addons-282155 kubelet[2330]: I0717 20:09:43.877964    2330 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c81fbdf1-21cd-46c9-a32c-1318828027b8-webhook-cert\") pod \"c81fbdf1-21cd-46c9-a32c-1318828027b8\" (UID: \"c81fbdf1-21cd-46c9-a32c-1318828027b8\") "
	Jul 17 20:09:43 addons-282155 kubelet[2330]: I0717 20:09:43.880967    2330 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c81fbdf1-21cd-46c9-a32c-1318828027b8-kube-api-access-fljsh" (OuterVolumeSpecName: "kube-api-access-fljsh") pod "c81fbdf1-21cd-46c9-a32c-1318828027b8" (UID: "c81fbdf1-21cd-46c9-a32c-1318828027b8"). InnerVolumeSpecName "kube-api-access-fljsh". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 17 20:09:43 addons-282155 kubelet[2330]: I0717 20:09:43.885989    2330 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c81fbdf1-21cd-46c9-a32c-1318828027b8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c81fbdf1-21cd-46c9-a32c-1318828027b8" (UID: "c81fbdf1-21cd-46c9-a32c-1318828027b8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 17 20:09:43 addons-282155 kubelet[2330]: I0717 20:09:43.978283    2330 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-fljsh\" (UniqueName: \"kubernetes.io/projected/c81fbdf1-21cd-46c9-a32c-1318828027b8-kube-api-access-fljsh\") on node \"addons-282155\" DevicePath \"\""
	Jul 17 20:09:43 addons-282155 kubelet[2330]: I0717 20:09:43.978324    2330 reconciler_common.go:300] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c81fbdf1-21cd-46c9-a32c-1318828027b8-webhook-cert\") on node \"addons-282155\" DevicePath \"\""
	Jul 17 20:09:45 addons-282155 kubelet[2330]: I0717 20:09:45.835144    2330 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=c81fbdf1-21cd-46c9-a32c-1318828027b8 path="/var/lib/kubelet/pods/c81fbdf1-21cd-46c9-a32c-1318828027b8/volumes"
	Jul 17 20:09:46 addons-282155 kubelet[2330]: I0717 20:09:46.817054    2330 scope.go:115] "RemoveContainer" containerID="a08299f037e6e20f0363855c6233a79332522b34cc9954939fd8ea47a42e1a97"
	Jul 17 20:09:47 addons-282155 kubelet[2330]: I0717 20:09:47.884974    2330 scope.go:115] "RemoveContainer" containerID="a08299f037e6e20f0363855c6233a79332522b34cc9954939fd8ea47a42e1a97"
	Jul 17 20:09:47 addons-282155 kubelet[2330]: I0717 20:09:47.885299    2330 scope.go:115] "RemoveContainer" containerID="9605b5ecbabece668a7b6ff9a1147192a189e541c620d3bca64a3e8441bb2bd9"
	Jul 17 20:09:47 addons-282155 kubelet[2330]: E0717 20:09:47.893162    2330 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 20s restarting failed container=hello-world-app pod=hello-world-app-65bdb79f98-v4q7p_default(e426d26a-7d7b-4c81-abf8-f511834346d8)\"" pod="default/hello-world-app-65bdb79f98-v4q7p" podUID=e426d26a-7d7b-4c81-abf8-f511834346d8
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.520723    2330 topology_manager.go:212] "Topology Admit Handler"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: E0717 20:09:49.520813    2330 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="de2527e8-e4ec-4823-85f6-9ea6ecfdff28" containerName="minikube-ingress-dns"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: E0717 20:09:49.520826    2330 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="de2527e8-e4ec-4823-85f6-9ea6ecfdff28" containerName="minikube-ingress-dns"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: E0717 20:09:49.520835    2330 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="c81fbdf1-21cd-46c9-a32c-1318828027b8" containerName="controller"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: E0717 20:09:49.520845    2330 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="de2527e8-e4ec-4823-85f6-9ea6ecfdff28" containerName="minikube-ingress-dns"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.520882    2330 memory_manager.go:346] "RemoveStaleState removing state" podUID="de2527e8-e4ec-4823-85f6-9ea6ecfdff28" containerName="minikube-ingress-dns"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.520891    2330 memory_manager.go:346] "RemoveStaleState removing state" podUID="de2527e8-e4ec-4823-85f6-9ea6ecfdff28" containerName="minikube-ingress-dns"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.520899    2330 memory_manager.go:346] "RemoveStaleState removing state" podUID="c81fbdf1-21cd-46c9-a32c-1318828027b8" containerName="controller"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.520907    2330 memory_manager.go:346] "RemoveStaleState removing state" podUID="de2527e8-e4ec-4823-85f6-9ea6ecfdff28" containerName="minikube-ingress-dns"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.714568    2330 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/03bbc113-ece9-4d64-bed7-17f046e9af7a-gcp-creds\") pod \"task-pv-pod\" (UID: \"03bbc113-ece9-4d64-bed7-17f046e9af7a\") " pod="default/task-pv-pod"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.714632    2330 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whpqj\" (UniqueName: \"kubernetes.io/projected/03bbc113-ece9-4d64-bed7-17f046e9af7a-kube-api-access-whpqj\") pod \"task-pv-pod\" (UID: \"03bbc113-ece9-4d64-bed7-17f046e9af7a\") " pod="default/task-pv-pod"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.714684    2330 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-fcb629cb-a7ff-4520-a025-a7c9295121b9\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^e1746b46-24dd-11ee-bd9b-b2d260550797\") pod \"task-pv-pod\" (UID: \"03bbc113-ece9-4d64-bed7-17f046e9af7a\") " pod="default/task-pv-pod"
	Jul 17 20:09:49 addons-282155 kubelet[2330]: I0717 20:09:49.848998    2330 operation_generator.go:661] "MountVolume.MountDevice succeeded for volume \"pvc-fcb629cb-a7ff-4520-a025-a7c9295121b9\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^e1746b46-24dd-11ee-bd9b-b2d260550797\") pod \"task-pv-pod\" (UID: \"03bbc113-ece9-4d64-bed7-17f046e9af7a\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/hostpath.csi.k8s.io/43e464c8f7c0c8b4c06c0e85ba9090023b51f7a212f072ac653d1c8ee28b7159/globalmount\"" pod="default/task-pv-pod"
	
	* 
	* ==> storage-provisioner [9d9431b9a1f2] <==
	* I0717 20:07:40.382947       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0717 20:07:40.424349       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0717 20:07:40.424728       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0717 20:07:40.435255       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0717 20:07:40.435669       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-282155_58c900e6-b55a-48ad-bca4-4ceb1fa4f0d4!
	I0717 20:07:40.436638       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fcaad342-a9d7-4f16-9825-1cfdf7caa57c", APIVersion:"v1", ResourceVersion:"509", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-282155_58c900e6-b55a-48ad-bca4-4ceb1fa4f0d4 became leader
	I0717 20:07:40.543901       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-282155_58c900e6-b55a-48ad-bca4-4ceb1fa4f0d4!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-282155 -n addons-282155
helpers_test.go:261: (dbg) Run:  kubectl --context addons-282155 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: task-pv-pod
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Ingress]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context addons-282155 describe pod task-pv-pod
helpers_test.go:282: (dbg) kubectl --context addons-282155 describe pod task-pv-pod:

                                                
                                                
-- stdout --
	Name:             task-pv-pod
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             addons-282155/192.168.49.2
	Start Time:       Mon, 17 Jul 2023 20:09:49 +0000
	Labels:           app=task-pv-pod
	Annotations:      <none>
	Status:           Pending
	IP:               
	IPs:              <none>
	Containers:
	  task-pv-container:
	    Container ID:   
	    Image:          docker.io/nginx
	    Image ID:       
	    Port:           80/TCP
	    Host Port:      0/TCP
	    State:          Waiting
	      Reason:       ContainerCreating
	    Ready:          False
	    Restart Count:  0
	    Environment:
	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json
	      PROJECT_ID:                      this_is_fake
	      GCP_PROJECT:                     this_is_fake
	      GCLOUD_PROJECT:                  this_is_fake
	      GOOGLE_CLOUD_PROJECT:            this_is_fake
	      CLOUDSDK_CORE_PROJECT:           this_is_fake
	    Mounts:
	      /google-app-creds.json from gcp-creds (ro)
	      /usr/share/nginx/html from task-pv-storage (rw)
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-whpqj (ro)
	Conditions:
	  Type              Status
	  Initialized       True 
	  Ready             False 
	  ContainersReady   False 
	  PodScheduled      True 
	Volumes:
	  task-pv-storage:
	    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
	    ClaimName:  hpvc
	    ReadOnly:   false
	  kube-api-access-whpqj:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	  gcp-creds:
	    Type:          HostPath (bare host directory volume)
	    Path:          /var/lib/minikube/google_application_credentials.json
	    HostPathType:  File
	QoS Class:         BestEffort
	Node-Selectors:    <none>
	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type    Reason     Age   From               Message
	  ----    ------     ----  ----               -------
	  Normal  Scheduled  3s    default-scheduler  Successfully assigned default/task-pv-pod to addons-282155
	  Normal  Pulling    2s    kubelet            Pulling image "docker.io/nginx"

                                                
                                                
-- /stdout --
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (39.28s)

                                                
                                    
x
+
TestErrorSpam/setup (34.23s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-729477 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-729477 --driver=docker  --container-runtime=docker
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-729477 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-729477 --driver=docker  --container-runtime=docker: (34.228086643s)
error_spam_test.go:96: unexpected stderr: "! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.31.0 -> Actual minikube version: v1.30.1"
error_spam_test.go:110: minikube stdout:
* [nospam-729477] minikube v1.30.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=16890
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on user configuration
* Using Docker driver with root privileges
* Starting control plane node nospam-729477 in cluster nospam-729477
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2250MB) ...
* Preparing Kubernetes v1.27.3 on Docker 24.0.4 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring CNI (Container Networking Interface) ...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Verifying Kubernetes components...
* Enabled addons: default-storageclass, storage-provisioner
* Done! kubectl is now configured to use "nospam-729477" cluster and "default" namespace by default
error_spam_test.go:111: minikube stderr:
! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.31.0 -> Actual minikube version: v1.30.1
--- FAIL: TestErrorSpam/setup (34.23s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (51.88s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-845621 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:183: (dbg) Done: kubectl --context ingress-addon-legacy-845621 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (8.329045584s)
addons_test.go:208: (dbg) Run:  kubectl --context ingress-addon-legacy-845621 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context ingress-addon-legacy-845621 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [e75ee218-9e32-4ca9-a060-d1e43be4ccbe] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [e75ee218-9e32-4ca9-a060-d1e43be4ccbe] Running
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 8.008072509s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-845621 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context ingress-addon-legacy-845621 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-845621 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.021766982s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-845621 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-845621 addons disable ingress-dns --alsologtostderr -v=1: (9.722498687s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-845621 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-845621 addons disable ingress --alsologtostderr -v=1: (7.497801464s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-845621
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-845621:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0fd2511f2f87d84cc5818b4d84f55dbce534a6dac24b0fe7359c754deedaa9e2",
	        "Created": "2023-07-17T20:16:27.864358793Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1102176,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-17T20:16:28.197525232Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:f52519afe5f6d6f3ce84cbd7f651b1292638d32ca98ee43d88f2d69e113e44de",
	        "ResolvConfPath": "/var/lib/docker/containers/0fd2511f2f87d84cc5818b4d84f55dbce534a6dac24b0fe7359c754deedaa9e2/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0fd2511f2f87d84cc5818b4d84f55dbce534a6dac24b0fe7359c754deedaa9e2/hostname",
	        "HostsPath": "/var/lib/docker/containers/0fd2511f2f87d84cc5818b4d84f55dbce534a6dac24b0fe7359c754deedaa9e2/hosts",
	        "LogPath": "/var/lib/docker/containers/0fd2511f2f87d84cc5818b4d84f55dbce534a6dac24b0fe7359c754deedaa9e2/0fd2511f2f87d84cc5818b4d84f55dbce534a6dac24b0fe7359c754deedaa9e2-json.log",
	        "Name": "/ingress-addon-legacy-845621",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ingress-addon-legacy-845621:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "ingress-addon-legacy-845621",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/c4e87ab66235a0e58bcc3d0c01610e4e9a62bda6e9c8e2513067ea57a3fa4ddf-init/diff:/var/lib/docker/overlay2/6900946d0fdd3bfa709cdc23e339458379368aff000f0d1b8e08a5eb8d75fd8d/diff",
	                "MergedDir": "/var/lib/docker/overlay2/c4e87ab66235a0e58bcc3d0c01610e4e9a62bda6e9c8e2513067ea57a3fa4ddf/merged",
	                "UpperDir": "/var/lib/docker/overlay2/c4e87ab66235a0e58bcc3d0c01610e4e9a62bda6e9c8e2513067ea57a3fa4ddf/diff",
	                "WorkDir": "/var/lib/docker/overlay2/c4e87ab66235a0e58bcc3d0c01610e4e9a62bda6e9c8e2513067ea57a3fa4ddf/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-845621",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-845621/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-845621",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-845621",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-845621",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "f6242340c4b117a3c6d2085c1edf84ce81649a535ac91a7447c521a40dd98793",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34015"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34014"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34011"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34013"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34012"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/f6242340c4b1",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-845621": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "0fd2511f2f87",
	                        "ingress-addon-legacy-845621"
	                    ],
	                    "NetworkID": "0497ec4b3709075786861a96f7ff5e9a2ac02ac02c9628ed43e2df66de4a83c6",
	                    "EndpointID": "fed96372c79d890492c47a97b136cb424380b542bd23e5476882e37032138738",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p ingress-addon-legacy-845621 -n ingress-addon-legacy-845621
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-845621 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-845621 logs -n 25: (1.019879481s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	|    Command     |                   Args                   |           Profile           |  User   | Version |     Start Time      |      End Time       |
	|----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| service        | functional-964765 service                | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | hello-node --url                         |                             |         |         |                     |                     |
	| update-context | functional-964765                        | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| update-context | functional-964765                        | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| update-context | functional-964765                        | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| image          | functional-964765                        | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | image ls --format yaml                   |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| ssh            | functional-964765 ssh pgrep              | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC |                     |
	|                | buildkitd                                |                             |         |         |                     |                     |
	| image          | functional-964765 image build -t         | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | localhost/my-image:functional-964765     |                             |         |         |                     |                     |
	|                | testdata/build --alsologtostderr         |                             |         |         |                     |                     |
	| image          | functional-964765 image ls               | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	| image          | functional-964765                        | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | image ls --format json                   |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| image          | functional-964765                        | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | image ls --format table                  |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| image          | functional-964765                        | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	|                | image ls --format short                  |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| delete         | -p functional-964765                     | functional-964765           | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:15 UTC |
	| start          | -p image-687264                          | image-687264                | jenkins | v1.30.1 | 17 Jul 23 20:15 UTC | 17 Jul 23 20:16 UTC |
	|                | --driver=docker                          |                             |         |         |                     |                     |
	|                | --container-runtime=docker               |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-687264                | jenkins | v1.30.1 | 17 Jul 23 20:16 UTC | 17 Jul 23 20:16 UTC |
	|                | ./testdata/image-build/test-normal       |                             |         |         |                     |                     |
	|                | -p image-687264                          |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-687264                | jenkins | v1.30.1 | 17 Jul 23 20:16 UTC | 17 Jul 23 20:16 UTC |
	|                | --build-opt=build-arg=ENV_A=test_env_str |                             |         |         |                     |                     |
	|                | --build-opt=no-cache                     |                             |         |         |                     |                     |
	|                | ./testdata/image-build/test-arg -p       |                             |         |         |                     |                     |
	|                | image-687264                             |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-687264                | jenkins | v1.30.1 | 17 Jul 23 20:16 UTC | 17 Jul 23 20:16 UTC |
	|                | ./testdata/image-build/test-normal       |                             |         |         |                     |                     |
	|                | --build-opt=no-cache -p                  |                             |         |         |                     |                     |
	|                | image-687264                             |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-687264                | jenkins | v1.30.1 | 17 Jul 23 20:16 UTC | 17 Jul 23 20:16 UTC |
	|                | -f inner/Dockerfile                      |                             |         |         |                     |                     |
	|                | ./testdata/image-build/test-f            |                             |         |         |                     |                     |
	|                | -p image-687264                          |                             |         |         |                     |                     |
	| delete         | -p image-687264                          | image-687264                | jenkins | v1.30.1 | 17 Jul 23 20:16 UTC | 17 Jul 23 20:16 UTC |
	| start          | -p ingress-addon-legacy-845621           | ingress-addon-legacy-845621 | jenkins | v1.30.1 | 17 Jul 23 20:16 UTC | 17 Jul 23 20:17 UTC |
	|                | --kubernetes-version=v1.18.20            |                             |         |         |                     |                     |
	|                | --memory=4096 --wait=true                |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	|                | -v=5 --driver=docker                     |                             |         |         |                     |                     |
	|                | --container-runtime=docker               |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-845621              | ingress-addon-legacy-845621 | jenkins | v1.30.1 | 17 Jul 23 20:17 UTC | 17 Jul 23 20:18 UTC |
	|                | addons enable ingress                    |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-845621              | ingress-addon-legacy-845621 | jenkins | v1.30.1 | 17 Jul 23 20:18 UTC | 17 Jul 23 20:18 UTC |
	|                | addons enable ingress-dns                |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |
	| ssh            | ingress-addon-legacy-845621              | ingress-addon-legacy-845621 | jenkins | v1.30.1 | 17 Jul 23 20:18 UTC | 17 Jul 23 20:18 UTC |
	|                | ssh curl -s http://127.0.0.1/            |                             |         |         |                     |                     |
	|                | -H 'Host: nginx.example.com'             |                             |         |         |                     |                     |
	| ip             | ingress-addon-legacy-845621 ip           | ingress-addon-legacy-845621 | jenkins | v1.30.1 | 17 Jul 23 20:18 UTC | 17 Jul 23 20:18 UTC |
	| addons         | ingress-addon-legacy-845621              | ingress-addon-legacy-845621 | jenkins | v1.30.1 | 17 Jul 23 20:18 UTC | 17 Jul 23 20:18 UTC |
	|                | addons disable ingress-dns               |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-845621              | ingress-addon-legacy-845621 | jenkins | v1.30.1 | 17 Jul 23 20:18 UTC | 17 Jul 23 20:18 UTC |
	|                | addons disable ingress                   |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |
	|----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/17 20:16:08
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 20:16:08.096280 1101719 out.go:296] Setting OutFile to fd 1 ...
	I0717 20:16:08.096788 1101719 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:16:08.096826 1101719 out.go:309] Setting ErrFile to fd 2...
	I0717 20:16:08.096846 1101719 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:16:08.097269 1101719 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
	I0717 20:16:08.097860 1101719 out.go:303] Setting JSON to false
	I0717 20:16:08.099088 1101719 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":17911,"bootTime":1689607057,"procs":318,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0717 20:16:08.099213 1101719 start.go:138] virtualization:  
	I0717 20:16:08.101975 1101719 out.go:177] * [ingress-addon-legacy-845621] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0717 20:16:08.104418 1101719 out.go:177]   - MINIKUBE_LOCATION=16890
	I0717 20:16:08.106375 1101719 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:16:08.104574 1101719 notify.go:220] Checking for updates...
	I0717 20:16:08.110067 1101719 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	I0717 20:16:08.112456 1101719 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	I0717 20:16:08.114202 1101719 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 20:16:08.115988 1101719 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 20:16:08.118081 1101719 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 20:16:08.142814 1101719 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 20:16:08.142914 1101719 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:16:08.215346 1101719 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-07-17 20:16:08.204748065 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:16:08.215451 1101719 docker.go:294] overlay module found
	I0717 20:16:08.217501 1101719 out.go:177] * Using the docker driver based on user configuration
	I0717 20:16:08.219324 1101719 start.go:298] selected driver: docker
	I0717 20:16:08.219339 1101719 start.go:880] validating driver "docker" against <nil>
	I0717 20:16:08.219353 1101719 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 20:16:08.219986 1101719 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:16:08.287161 1101719 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-07-17 20:16:08.277703724 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:16:08.287326 1101719 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0717 20:16:08.287545 1101719 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0717 20:16:08.289549 1101719 out.go:177] * Using Docker driver with root privileges
	I0717 20:16:08.291025 1101719 cni.go:84] Creating CNI manager for ""
	I0717 20:16:08.291052 1101719 cni.go:168] CNI unnecessary in this configuration, recommending no CNI
	I0717 20:16:08.291064 1101719 start_flags.go:319] config:
	{Name:ingress-addon-legacy-845621 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-845621 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:doc
ker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:16:08.293210 1101719 out.go:177] * Starting control plane node ingress-addon-legacy-845621 in cluster ingress-addon-legacy-845621
	I0717 20:16:08.294988 1101719 cache.go:122] Beginning downloading kic base image for docker with docker
	I0717 20:16:08.296829 1101719 out.go:177] * Pulling base image ...
	I0717 20:16:08.298853 1101719 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0717 20:16:08.298943 1101719 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0717 20:16:08.316728 1101719 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon, skipping pull
	I0717 20:16:08.316750 1101719 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in daemon, skipping load
	I0717 20:16:08.370346 1101719 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I0717 20:16:08.370371 1101719 cache.go:57] Caching tarball of preloaded images
	I0717 20:16:08.370531 1101719 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0717 20:16:08.372498 1101719 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I0717 20:16:08.374092 1101719 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0717 20:16:08.492058 1101719 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4?checksum=md5:c8c260b886393123ce9d312d8ac2379e -> /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I0717 20:16:20.671614 1101719 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0717 20:16:20.671739 1101719 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0717 20:16:21.712539 1101719 cache.go:60] Finished verifying existence of preloaded tar for  v1.18.20 on docker
	I0717 20:16:21.712897 1101719 profile.go:148] Saving config to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/config.json ...
	I0717 20:16:21.712932 1101719 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/config.json: {Name:mk20c37ef27625654ab889fc61206ed8ec20b687 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:16:21.713103 1101719 cache.go:195] Successfully downloaded all kic artifacts
	I0717 20:16:21.713144 1101719 start.go:365] acquiring machines lock for ingress-addon-legacy-845621: {Name:mk09ed22b4f3ab91a03ce04b320a7b4946f80091 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0717 20:16:21.713200 1101719 start.go:369] acquired machines lock for "ingress-addon-legacy-845621" in 43.389µs
	I0717 20:16:21.713220 1101719 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-845621 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-845621 Namespace:default APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0717 20:16:21.713285 1101719 start.go:125] createHost starting for "" (driver="docker")
	I0717 20:16:21.716607 1101719 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I0717 20:16:21.716870 1101719 start.go:159] libmachine.API.Create for "ingress-addon-legacy-845621" (driver="docker")
	I0717 20:16:21.716899 1101719 client.go:168] LocalClient.Create starting
	I0717 20:16:21.716966 1101719 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem
	I0717 20:16:21.717003 1101719 main.go:141] libmachine: Decoding PEM data...
	I0717 20:16:21.717022 1101719 main.go:141] libmachine: Parsing certificate...
	I0717 20:16:21.717077 1101719 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem
	I0717 20:16:21.717097 1101719 main.go:141] libmachine: Decoding PEM data...
	I0717 20:16:21.717113 1101719 main.go:141] libmachine: Parsing certificate...
	I0717 20:16:21.717462 1101719 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-845621 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0717 20:16:21.737111 1101719 cli_runner.go:211] docker network inspect ingress-addon-legacy-845621 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0717 20:16:21.737185 1101719 network_create.go:281] running [docker network inspect ingress-addon-legacy-845621] to gather additional debugging logs...
	I0717 20:16:21.737205 1101719 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-845621
	W0717 20:16:21.752965 1101719 cli_runner.go:211] docker network inspect ingress-addon-legacy-845621 returned with exit code 1
	I0717 20:16:21.752997 1101719 network_create.go:284] error running [docker network inspect ingress-addon-legacy-845621]: docker network inspect ingress-addon-legacy-845621: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-845621 not found
	I0717 20:16:21.753011 1101719 network_create.go:286] output of [docker network inspect ingress-addon-legacy-845621]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-845621 not found
	
	** /stderr **
	I0717 20:16:21.753070 1101719 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 20:16:21.769646 1101719 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000c91720}
	I0717 20:16:21.769682 1101719 network_create.go:123] attempt to create docker network ingress-addon-legacy-845621 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0717 20:16:21.769740 1101719 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-845621 ingress-addon-legacy-845621
	I0717 20:16:21.838436 1101719 network_create.go:107] docker network ingress-addon-legacy-845621 192.168.49.0/24 created
	I0717 20:16:21.838471 1101719 kic.go:117] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-845621" container
	I0717 20:16:21.838549 1101719 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0717 20:16:21.857566 1101719 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-845621 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-845621 --label created_by.minikube.sigs.k8s.io=true
	I0717 20:16:21.878001 1101719 oci.go:103] Successfully created a docker volume ingress-addon-legacy-845621
	I0717 20:16:21.878085 1101719 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-845621-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-845621 --entrypoint /usr/bin/test -v ingress-addon-legacy-845621:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib
	I0717 20:16:23.213203 1101719 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-845621-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-845621 --entrypoint /usr/bin/test -v ingress-addon-legacy-845621:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib: (1.335072133s)
	I0717 20:16:23.213234 1101719 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-845621
	I0717 20:16:23.213261 1101719 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0717 20:16:23.213279 1101719 kic.go:190] Starting extracting preloaded images to volume ...
	I0717 20:16:23.213357 1101719 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-845621:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir
	I0717 20:16:27.790004 1101719 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-845621:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir: (4.576600665s)
	I0717 20:16:27.790040 1101719 kic.go:199] duration metric: took 4.576756 seconds to extract preloaded images to volume
	W0717 20:16:27.790180 1101719 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0717 20:16:27.790288 1101719 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0717 20:16:27.848937 1101719 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-845621 --name ingress-addon-legacy-845621 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-845621 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-845621 --network ingress-addon-legacy-845621 --ip 192.168.49.2 --volume ingress-addon-legacy-845621:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631
	I0717 20:16:28.206849 1101719 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-845621 --format={{.State.Running}}
	I0717 20:16:28.228038 1101719 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-845621 --format={{.State.Status}}
	I0717 20:16:28.252129 1101719 cli_runner.go:164] Run: docker exec ingress-addon-legacy-845621 stat /var/lib/dpkg/alternatives/iptables
	I0717 20:16:28.339569 1101719 oci.go:144] the created container "ingress-addon-legacy-845621" has a running status.
	I0717 20:16:28.339594 1101719 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa...
	I0717 20:16:29.047118 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0717 20:16:29.047194 1101719 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0717 20:16:29.071532 1101719 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-845621 --format={{.State.Status}}
	I0717 20:16:29.108236 1101719 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0717 20:16:29.108255 1101719 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-845621 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0717 20:16:29.207053 1101719 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-845621 --format={{.State.Status}}
	I0717 20:16:29.230960 1101719 machine.go:88] provisioning docker machine ...
	I0717 20:16:29.230991 1101719 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-845621"
	I0717 20:16:29.231066 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:29.249114 1101719 main.go:141] libmachine: Using SSH client type: native
	I0717 20:16:29.249562 1101719 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34015 <nil> <nil>}
	I0717 20:16:29.249575 1101719 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-845621 && echo "ingress-addon-legacy-845621" | sudo tee /etc/hostname
	I0717 20:16:29.405786 1101719 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-845621
	
	I0717 20:16:29.405939 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:29.425356 1101719 main.go:141] libmachine: Using SSH client type: native
	I0717 20:16:29.425776 1101719 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34015 <nil> <nil>}
	I0717 20:16:29.425795 1101719 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-845621' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-845621/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-845621' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0717 20:16:29.564739 1101719 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0717 20:16:29.564767 1101719 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16890-1049210/.minikube CaCertPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16890-1049210/.minikube}
	I0717 20:16:29.564814 1101719 ubuntu.go:177] setting up certificates
	I0717 20:16:29.564824 1101719 provision.go:83] configureAuth start
	I0717 20:16:29.564897 1101719 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-845621
	I0717 20:16:29.582264 1101719 provision.go:138] copyHostCerts
	I0717 20:16:29.582310 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.pem
	I0717 20:16:29.582342 1101719 exec_runner.go:144] found /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.pem, removing ...
	I0717 20:16:29.582353 1101719 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.pem
	I0717 20:16:29.582429 1101719 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.pem (1082 bytes)
	I0717 20:16:29.582509 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/16890-1049210/.minikube/cert.pem
	I0717 20:16:29.582531 1101719 exec_runner.go:144] found /home/jenkins/minikube-integration/16890-1049210/.minikube/cert.pem, removing ...
	I0717 20:16:29.582536 1101719 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16890-1049210/.minikube/cert.pem
	I0717 20:16:29.582566 1101719 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16890-1049210/.minikube/cert.pem (1123 bytes)
	I0717 20:16:29.582613 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/16890-1049210/.minikube/key.pem
	I0717 20:16:29.582634 1101719 exec_runner.go:144] found /home/jenkins/minikube-integration/16890-1049210/.minikube/key.pem, removing ...
	I0717 20:16:29.582642 1101719 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16890-1049210/.minikube/key.pem
	I0717 20:16:29.582667 1101719 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16890-1049210/.minikube/key.pem (1679 bytes)
	I0717 20:16:29.582714 1101719 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-845621 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-845621]
	I0717 20:16:29.808134 1101719 provision.go:172] copyRemoteCerts
	I0717 20:16:29.808223 1101719 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0717 20:16:29.808267 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:29.830160 1101719 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34015 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa Username:docker}
	I0717 20:16:29.926136 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0717 20:16:29.926198 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)
	I0717 20:16:29.953429 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0717 20:16:29.953494 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0717 20:16:29.980680 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0717 20:16:29.980786 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0717 20:16:30.014610 1101719 provision.go:86] duration metric: configureAuth took 449.766606ms
	I0717 20:16:30.014682 1101719 ubuntu.go:193] setting minikube options for container-runtime
	I0717 20:16:30.014941 1101719 config.go:182] Loaded profile config "ingress-addon-legacy-845621": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I0717 20:16:30.015033 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:30.036213 1101719 main.go:141] libmachine: Using SSH client type: native
	I0717 20:16:30.036677 1101719 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34015 <nil> <nil>}
	I0717 20:16:30.036693 1101719 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0717 20:16:30.169860 1101719 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0717 20:16:30.169882 1101719 ubuntu.go:71] root file system type: overlay
	I0717 20:16:30.170008 1101719 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0717 20:16:30.170088 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:30.191102 1101719 main.go:141] libmachine: Using SSH client type: native
	I0717 20:16:30.191576 1101719 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34015 <nil> <nil>}
	I0717 20:16:30.191659 1101719 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0717 20:16:30.337903 1101719 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0717 20:16:30.337986 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:30.355451 1101719 main.go:141] libmachine: Using SSH client type: native
	I0717 20:16:30.355905 1101719 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34015 <nil> <nil>}
	I0717 20:16:30.355931 1101719 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0717 20:16:31.156482 1101719 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-07-07 14:51:01.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-07-17 20:16:30.334023968 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0717 20:16:31.156508 1101719 machine.go:91] provisioned docker machine in 1.925530329s
	I0717 20:16:31.156518 1101719 client.go:171] LocalClient.Create took 9.439613692s
	I0717 20:16:31.156529 1101719 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-845621" took 9.439658771s
	I0717 20:16:31.156537 1101719 start.go:300] post-start starting for "ingress-addon-legacy-845621" (driver="docker")
	I0717 20:16:31.156546 1101719 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0717 20:16:31.156609 1101719 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0717 20:16:31.156650 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:31.175038 1101719 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34015 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa Username:docker}
	I0717 20:16:31.274304 1101719 ssh_runner.go:195] Run: cat /etc/os-release
	I0717 20:16:31.278304 1101719 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0717 20:16:31.278339 1101719 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0717 20:16:31.278351 1101719 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0717 20:16:31.278357 1101719 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0717 20:16:31.278372 1101719 filesync.go:126] Scanning /home/jenkins/minikube-integration/16890-1049210/.minikube/addons for local assets ...
	I0717 20:16:31.278434 1101719 filesync.go:126] Scanning /home/jenkins/minikube-integration/16890-1049210/.minikube/files for local assets ...
	I0717 20:16:31.278519 1101719 filesync.go:149] local asset: /home/jenkins/minikube-integration/16890-1049210/.minikube/files/etc/ssl/certs/10545612.pem -> 10545612.pem in /etc/ssl/certs
	I0717 20:16:31.278531 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/files/etc/ssl/certs/10545612.pem -> /etc/ssl/certs/10545612.pem
	I0717 20:16:31.278632 1101719 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0717 20:16:31.288558 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/files/etc/ssl/certs/10545612.pem --> /etc/ssl/certs/10545612.pem (1708 bytes)
	I0717 20:16:31.315455 1101719 start.go:303] post-start completed in 158.90423ms
	I0717 20:16:31.315964 1101719 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-845621
	I0717 20:16:31.332937 1101719 profile.go:148] Saving config to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/config.json ...
	I0717 20:16:31.333206 1101719 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 20:16:31.333256 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:31.349872 1101719 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34015 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa Username:docker}
	I0717 20:16:31.441915 1101719 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0717 20:16:31.447862 1101719 start.go:128] duration metric: createHost completed in 9.734560578s
	I0717 20:16:31.447885 1101719 start.go:83] releasing machines lock for "ingress-addon-legacy-845621", held for 9.734675778s
	I0717 20:16:31.447966 1101719 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-845621
	I0717 20:16:31.466465 1101719 ssh_runner.go:195] Run: cat /version.json
	I0717 20:16:31.466520 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:31.466763 1101719 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0717 20:16:31.466819 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:16:31.490371 1101719 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34015 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa Username:docker}
	I0717 20:16:31.495946 1101719 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34015 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa Username:docker}
	W0717 20:16:31.580137 1101719 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.31.0 -> Actual minikube version: v1.30.1
	I0717 20:16:31.580215 1101719 ssh_runner.go:195] Run: systemctl --version
	I0717 20:16:31.719866 1101719 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0717 20:16:31.725648 1101719 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0717 20:16:31.758038 1101719 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0717 20:16:31.758132 1101719 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0717 20:16:31.779551 1101719 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0717 20:16:31.801455 1101719 cni.go:314] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0717 20:16:31.801524 1101719 start.go:469] detecting cgroup driver to use...
	I0717 20:16:31.801570 1101719 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0717 20:16:31.801726 1101719 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0717 20:16:31.821299 1101719 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0717 20:16:31.834487 1101719 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0717 20:16:31.848035 1101719 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0717 20:16:31.848142 1101719 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0717 20:16:31.860050 1101719 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 20:16:31.872149 1101719 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0717 20:16:31.883622 1101719 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 20:16:31.895181 1101719 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0717 20:16:31.906655 1101719 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0717 20:16:31.918570 1101719 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0717 20:16:31.928971 1101719 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0717 20:16:31.939071 1101719 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:16:32.044738 1101719 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0717 20:16:32.154278 1101719 start.go:469] detecting cgroup driver to use...
	I0717 20:16:32.154325 1101719 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0717 20:16:32.154410 1101719 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0717 20:16:32.174237 1101719 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0717 20:16:32.174342 1101719 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0717 20:16:32.193096 1101719 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock
	" | sudo tee /etc/crictl.yaml"
	I0717 20:16:32.216140 1101719 ssh_runner.go:195] Run: which cri-dockerd
	I0717 20:16:32.220991 1101719 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0717 20:16:32.235217 1101719 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0717 20:16:32.270234 1101719 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0717 20:16:32.383662 1101719 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0717 20:16:32.495640 1101719 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0717 20:16:32.495670 1101719 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0717 20:16:32.523116 1101719 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:16:32.625232 1101719 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0717 20:16:32.903652 1101719 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0717 20:16:32.930569 1101719 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0717 20:16:32.960978 1101719 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 24.0.4 ...
	I0717 20:16:32.961114 1101719 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-845621 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 20:16:32.977819 1101719 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0717 20:16:32.982392 1101719 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 20:16:32.995556 1101719 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0717 20:16:32.995625 1101719 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0717 20:16:33.018187 1101719 docker.go:636] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I0717 20:16:33.018230 1101719 docker.go:642] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I0717 20:16:33.018295 1101719 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0717 20:16:33.030596 1101719 ssh_runner.go:195] Run: which lz4
	I0717 20:16:33.035088 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4
	I0717 20:16:33.035261 1101719 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0717 20:16:33.040128 1101719 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0717 20:16:33.040168 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (459739018 bytes)
	I0717 20:16:35.042005 1101719 docker.go:600] Took 2.006797 seconds to copy over tarball
	I0717 20:16:35.042112 1101719 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0717 20:16:37.463493 1101719 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.421337897s)
	I0717 20:16:37.463530 1101719 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0717 20:16:37.545666 1101719 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0717 20:16:37.556025 1101719 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)
	I0717 20:16:37.576749 1101719 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:16:37.680871 1101719 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0717 20:16:39.158326 1101719 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.477419411s)
	I0717 20:16:39.158428 1101719 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0717 20:16:39.179867 1101719 docker.go:636] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I0717 20:16:39.179891 1101719 docker.go:642] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I0717 20:16:39.179899 1101719 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0717 20:16:39.181394 1101719 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I0717 20:16:39.181595 1101719 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I0717 20:16:39.181787 1101719 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0717 20:16:39.181858 1101719 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I0717 20:16:39.181923 1101719 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I0717 20:16:39.182163 1101719 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I0717 20:16:39.182232 1101719 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 20:16:39.182289 1101719 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I0717 20:16:39.182396 1101719 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I0717 20:16:39.182794 1101719 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I0717 20:16:39.183669 1101719 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I0717 20:16:39.183752 1101719 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	I0717 20:16:39.183861 1101719 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	I0717 20:16:39.183886 1101719 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 20:16:39.183937 1101719 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0717 20:16:39.184150 1101719 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	W0717 20:16:39.650791 1101719 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0717 20:16:39.651012 1101719 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20
	W0717 20:16:39.657971 1101719 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0717 20:16:39.658222 1101719 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20
	W0717 20:16:39.665879 1101719 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing
	I0717 20:16:39.666089 1101719 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0
	W0717 20:16:39.667395 1101719 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0717 20:16:39.667541 1101719 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20
	W0717 20:16:39.667714 1101719 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing
	I0717 20:16:39.667833 1101719 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7
	I0717 20:16:39.676630 1101719 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime
	I0717 20:16:39.676675 1101719 docker.go:316] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I0717 20:16:39.676720 1101719 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20
	W0717 20:16:39.685354 1101719 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0717 20:16:39.685528 1101719 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20
	I0717 20:16:39.708578 1101719 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2
	I0717 20:16:39.728099 1101719 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime
	I0717 20:16:39.728141 1101719 docker.go:316] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I0717 20:16:39.728187 1101719 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20
	I0717 20:16:39.758340 1101719 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime
	I0717 20:16:39.758377 1101719 docker.go:316] Removing image: registry.k8s.io/etcd:3.4.3-0
	I0717 20:16:39.758389 1101719 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime
	I0717 20:16:39.758417 1101719 docker.go:316] Removing image: registry.k8s.io/coredns:1.6.7
	I0717 20:16:39.758425 1101719 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0
	I0717 20:16:39.758451 1101719 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7
	I0717 20:16:39.773208 1101719 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20
	I0717 20:16:39.773530 1101719 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime
	I0717 20:16:39.773573 1101719 docker.go:316] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0717 20:16:39.773622 1101719 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I0717 20:16:39.786998 1101719 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime
	I0717 20:16:39.787042 1101719 docker.go:316] Removing image: registry.k8s.io/pause:3.2
	I0717 20:16:39.787091 1101719 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2
	I0717 20:16:39.787308 1101719 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime
	I0717 20:16:39.787335 1101719 docker.go:316] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I0717 20:16:39.787367 1101719 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20
	I0717 20:16:39.813204 1101719 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20
	W0717 20:16:39.848903 1101719 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0717 20:16:39.849060 1101719 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 20:16:39.858225 1101719 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0
	I0717 20:16:39.858283 1101719 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20
	I0717 20:16:39.858554 1101719 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7
	I0717 20:16:39.872435 1101719 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20
	I0717 20:16:39.872779 1101719 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2
	I0717 20:16:39.886423 1101719 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0717 20:16:39.886471 1101719 docker.go:316] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 20:16:39.886544 1101719 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 20:16:39.922797 1101719 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0717 20:16:39.922872 1101719 cache_images.go:92] LoadImages completed in 742.961452ms
	W0717 20:16:39.922940 1101719 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20: no such file or directory
	I0717 20:16:39.922995 1101719 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0717 20:16:39.985784 1101719 cni.go:84] Creating CNI manager for ""
	I0717 20:16:39.985809 1101719 cni.go:168] CNI unnecessary in this configuration, recommending no CNI
	I0717 20:16:39.985818 1101719 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0717 20:16:39.985835 1101719 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-845621 NodeName:ingress-addon-legacy-845621 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.
crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0717 20:16:39.985981 1101719 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /var/run/dockershim.sock
	  name: "ingress-addon-legacy-845621"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0717 20:16:39.986052 1101719 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-845621 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-845621 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0717 20:16:39.986122 1101719 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I0717 20:16:39.996624 1101719 binaries.go:44] Found k8s binaries, skipping transfer
	I0717 20:16:39.996699 1101719 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0717 20:16:40.009122 1101719 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (354 bytes)
	I0717 20:16:40.034268 1101719 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I0717 20:16:40.057508 1101719 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2124 bytes)
	I0717 20:16:40.079561 1101719 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0717 20:16:40.084801 1101719 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 20:16:40.100323 1101719 certs.go:56] Setting up /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621 for IP: 192.168.49.2
	I0717 20:16:40.100355 1101719 certs.go:190] acquiring lock for shared ca certs: {Name:mk81f942d4f5c721bda50f612945e6cfc625c6b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:16:40.100571 1101719 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.key
	I0717 20:16:40.100621 1101719 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.key
	I0717 20:16:40.100672 1101719 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.key
	I0717 20:16:40.100686 1101719 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt with IP's: []
	I0717 20:16:40.528980 1101719 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt ...
	I0717 20:16:40.529012 1101719 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: {Name:mk6a3724530b41ac6cd6d339711aa4d4a5e17258 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:16:40.529211 1101719 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.key ...
	I0717 20:16:40.529224 1101719 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.key: {Name:mk2e8e701e47272fd6c6413a68ae826446828c44 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:16:40.529317 1101719 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.key.dd3b5fb2
	I0717 20:16:40.529333 1101719 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0717 20:16:40.755464 1101719 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.crt.dd3b5fb2 ...
	I0717 20:16:40.755492 1101719 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.crt.dd3b5fb2: {Name:mka43a48627b98a2b327d5873db25995705d1c1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:16:40.755678 1101719 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.key.dd3b5fb2 ...
	I0717 20:16:40.755690 1101719 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.key.dd3b5fb2: {Name:mk4c2dc04da8cdcb538d085ad9df6f49b5ba782c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:16:40.755785 1101719 certs.go:337] copying /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.crt
	I0717 20:16:40.755863 1101719 certs.go:341] copying /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.key
	I0717 20:16:40.755925 1101719 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.key
	I0717 20:16:40.755942 1101719 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.crt with IP's: []
	I0717 20:16:41.586200 1101719 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.crt ...
	I0717 20:16:41.586230 1101719 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.crt: {Name:mk4285d1048375084c2b72b8e8ba5a8c9281b8c1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:16:41.586418 1101719 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.key ...
	I0717 20:16:41.586432 1101719 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.key: {Name:mkfe186257afd9ffa4b6b98d7a2d8863ae343cc6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:16:41.586508 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0717 20:16:41.586530 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0717 20:16:41.586542 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0717 20:16:41.586559 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0717 20:16:41.586571 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0717 20:16:41.586583 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0717 20:16:41.586604 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0717 20:16:41.586621 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0717 20:16:41.586678 1101719 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/1054561.pem (1338 bytes)
	W0717 20:16:41.586720 1101719 certs.go:433] ignoring /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/1054561_empty.pem, impossibly tiny 0 bytes
	I0717 20:16:41.586733 1101719 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca-key.pem (1675 bytes)
	I0717 20:16:41.586765 1101719 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/ca.pem (1082 bytes)
	I0717 20:16:41.586796 1101719 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/cert.pem (1123 bytes)
	I0717 20:16:41.586824 1101719 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/certs/key.pem (1679 bytes)
	I0717 20:16:41.586871 1101719 certs.go:437] found cert: /home/jenkins/minikube-integration/16890-1049210/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/16890-1049210/.minikube/files/etc/ssl/certs/10545612.pem (1708 bytes)
	I0717 20:16:41.586904 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/files/etc/ssl/certs/10545612.pem -> /usr/share/ca-certificates/10545612.pem
	I0717 20:16:41.586921 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:16:41.586935 1101719 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/1054561.pem -> /usr/share/ca-certificates/1054561.pem
	I0717 20:16:41.587501 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0717 20:16:41.617528 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0717 20:16:41.647968 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0717 20:16:41.676754 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0717 20:16:41.705029 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0717 20:16:41.733278 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0717 20:16:41.761076 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0717 20:16:41.788629 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0717 20:16:41.816233 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/files/etc/ssl/certs/10545612.pem --> /usr/share/ca-certificates/10545612.pem (1708 bytes)
	I0717 20:16:41.843935 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0717 20:16:41.872351 1101719 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16890-1049210/.minikube/certs/1054561.pem --> /usr/share/ca-certificates/1054561.pem (1338 bytes)
	I0717 20:16:41.903185 1101719 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0717 20:16:41.924273 1101719 ssh_runner.go:195] Run: openssl version
	I0717 20:16:41.932209 1101719 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10545612.pem && ln -fs /usr/share/ca-certificates/10545612.pem /etc/ssl/certs/10545612.pem"
	I0717 20:16:41.945321 1101719 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10545612.pem
	I0717 20:16:41.950096 1101719 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Jul 17 20:11 /usr/share/ca-certificates/10545612.pem
	I0717 20:16:41.950184 1101719 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10545612.pem
	I0717 20:16:41.959150 1101719 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/10545612.pem /etc/ssl/certs/3ec20f2e.0"
	I0717 20:16:41.970811 1101719 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0717 20:16:41.982444 1101719 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:16:41.987147 1101719 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 17 20:07 /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:16:41.987229 1101719 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:16:41.995792 1101719 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0717 20:16:42.009179 1101719 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1054561.pem && ln -fs /usr/share/ca-certificates/1054561.pem /etc/ssl/certs/1054561.pem"
	I0717 20:16:42.021855 1101719 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1054561.pem
	I0717 20:16:42.026993 1101719 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Jul 17 20:11 /usr/share/ca-certificates/1054561.pem
	I0717 20:16:42.027105 1101719 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1054561.pem
	I0717 20:16:42.036098 1101719 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1054561.pem /etc/ssl/certs/51391683.0"
	I0717 20:16:42.047923 1101719 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0717 20:16:42.052743 1101719 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0717 20:16:42.052824 1101719 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-845621 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-845621 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMe
trics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:16:42.052975 1101719 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0717 20:16:42.074413 1101719 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0717 20:16:42.086772 1101719 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0717 20:16:42.098759 1101719 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0717 20:16:42.098874 1101719 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0717 20:16:42.111178 1101719 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0717 20:16:42.111231 1101719 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0717 20:16:42.173679 1101719 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I0717 20:16:42.174084 1101719 kubeadm.go:322] [preflight] Running pre-flight checks
	I0717 20:16:42.399555 1101719 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0717 20:16:42.399630 1101719 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1039-aws
	I0717 20:16:42.399679 1101719 kubeadm.go:322] DOCKER_VERSION: 24.0.4
	I0717 20:16:42.399734 1101719 kubeadm.go:322] OS: Linux
	I0717 20:16:42.399777 1101719 kubeadm.go:322] CGROUPS_CPU: enabled
	I0717 20:16:42.399856 1101719 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0717 20:16:42.399922 1101719 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0717 20:16:42.399973 1101719 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0717 20:16:42.400065 1101719 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0717 20:16:42.400144 1101719 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0717 20:16:42.492994 1101719 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0717 20:16:42.493121 1101719 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0717 20:16:42.493259 1101719 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0717 20:16:42.699154 1101719 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0717 20:16:42.700870 1101719 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0717 20:16:42.701018 1101719 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0717 20:16:42.813072 1101719 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0717 20:16:42.817239 1101719 out.go:204]   - Generating certificates and keys ...
	I0717 20:16:42.817330 1101719 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0717 20:16:42.817401 1101719 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0717 20:16:43.169843 1101719 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0717 20:16:43.546067 1101719 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0717 20:16:44.029064 1101719 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0717 20:16:45.316476 1101719 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0717 20:16:45.496157 1101719 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0717 20:16:45.496577 1101719 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-845621 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0717 20:16:45.741638 1101719 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0717 20:16:45.742041 1101719 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-845621 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0717 20:16:46.097193 1101719 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0717 20:16:46.388669 1101719 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0717 20:16:46.796702 1101719 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0717 20:16:46.797087 1101719 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0717 20:16:47.052288 1101719 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0717 20:16:47.741387 1101719 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0717 20:16:48.073014 1101719 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0717 20:16:48.754255 1101719 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0717 20:16:48.755313 1101719 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0717 20:16:48.757644 1101719 out.go:204]   - Booting up control plane ...
	I0717 20:16:48.757755 1101719 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0717 20:16:48.765242 1101719 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0717 20:16:48.767592 1101719 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0717 20:16:48.769450 1101719 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0717 20:16:48.772963 1101719 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0717 20:17:01.276584 1101719 kubeadm.go:322] [apiclient] All control plane components are healthy after 12.503009 seconds
	I0717 20:17:01.276732 1101719 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0717 20:17:01.293608 1101719 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I0717 20:17:01.822995 1101719 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0717 20:17:01.823141 1101719 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-845621 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I0717 20:17:02.334071 1101719 kubeadm.go:322] [bootstrap-token] Using token: a7vizl.8ppwydtr15o68p87
	I0717 20:17:02.336174 1101719 out.go:204]   - Configuring RBAC rules ...
	I0717 20:17:02.336305 1101719 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0717 20:17:02.342333 1101719 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0717 20:17:02.352091 1101719 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0717 20:17:02.355905 1101719 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0717 20:17:02.362200 1101719 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0717 20:17:02.366203 1101719 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0717 20:17:02.376417 1101719 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0717 20:17:02.666872 1101719 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0717 20:17:02.761855 1101719 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0717 20:17:02.763977 1101719 kubeadm.go:322] 
	I0717 20:17:02.764056 1101719 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0717 20:17:02.764067 1101719 kubeadm.go:322] 
	I0717 20:17:02.764140 1101719 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0717 20:17:02.764149 1101719 kubeadm.go:322] 
	I0717 20:17:02.764173 1101719 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0717 20:17:02.764428 1101719 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0717 20:17:02.764483 1101719 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0717 20:17:02.764494 1101719 kubeadm.go:322] 
	I0717 20:17:02.764544 1101719 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0717 20:17:02.764617 1101719 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0717 20:17:02.764686 1101719 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0717 20:17:02.764692 1101719 kubeadm.go:322] 
	I0717 20:17:02.764772 1101719 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0717 20:17:02.764847 1101719 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0717 20:17:02.764867 1101719 kubeadm.go:322] 
	I0717 20:17:02.764950 1101719 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token a7vizl.8ppwydtr15o68p87 \
	I0717 20:17:02.765054 1101719 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:181497bd6535e587f825fba4d8b5a5b0421f9351d7fa54688ed979dfd295018f \
	I0717 20:17:02.765084 1101719 kubeadm.go:322]     --control-plane 
	I0717 20:17:02.765089 1101719 kubeadm.go:322] 
	I0717 20:17:02.765332 1101719 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0717 20:17:02.765347 1101719 kubeadm.go:322] 
	I0717 20:17:02.765429 1101719 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token a7vizl.8ppwydtr15o68p87 \
	I0717 20:17:02.765540 1101719 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:181497bd6535e587f825fba4d8b5a5b0421f9351d7fa54688ed979dfd295018f 
	I0717 20:17:02.770187 1101719 kubeadm.go:322] W0717 20:16:42.172558    1659 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I0717 20:17:02.770383 1101719 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
	I0717 20:17:02.770510 1101719 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.4. Latest validated version: 19.03
	I0717 20:17:02.770714 1101719 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1039-aws\n", err: exit status 1
	I0717 20:17:02.770816 1101719 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0717 20:17:02.770937 1101719 kubeadm.go:322] W0717 20:16:48.765450    1659 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0717 20:17:02.771075 1101719 kubeadm.go:322] W0717 20:16:48.767925    1659 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0717 20:17:02.771094 1101719 cni.go:84] Creating CNI manager for ""
	I0717 20:17:02.771121 1101719 cni.go:168] CNI unnecessary in this configuration, recommending no CNI
	I0717 20:17:02.771148 1101719 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0717 20:17:02.771303 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:02.771389 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=46c8e7c4243e42e98d29628785c0523fbabbd9b5 minikube.k8s.io/name=ingress-addon-legacy-845621 minikube.k8s.io/updated_at=2023_07_17T20_17_02_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:02.794747 1101719 ops.go:34] apiserver oom_adj: -16
	I0717 20:17:03.338894 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:03.975083 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:04.474547 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:04.975323 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:05.474577 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:05.974739 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:06.475297 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:06.974783 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:07.474826 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:07.975487 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:08.475241 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:08.975401 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:09.474521 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:09.974741 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:10.475085 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:10.975418 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:11.474517 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:11.974452 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:12.475001 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:12.975257 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:13.475033 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:13.974839 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:14.474484 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:14.975080 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:15.474937 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:15.974987 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:16.474535 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:16.975391 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:17.475475 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:17.975006 1101719 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:17:18.155647 1101719 kubeadm.go:1081] duration metric: took 15.384406388s to wait for elevateKubeSystemPrivileges.
	I0717 20:17:18.155682 1101719 kubeadm.go:406] StartCluster complete in 36.102861413s
	I0717 20:17:18.155719 1101719 settings.go:142] acquiring lock: {Name:mk4d7865d9994a87a1c670ae96776b659d86982f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:17:18.155784 1101719 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/16890-1049210/kubeconfig
	I0717 20:17:18.156474 1101719 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/kubeconfig: {Name:mk275af4b6bc52dcf9ea47b27f78d374307de569 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:17:18.157168 1101719 kapi.go:59] client config for ingress-addon-legacy-845621: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt", KeyFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.key", CAFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6910), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0717 20:17:18.158575 1101719 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0717 20:17:18.158836 1101719 config.go:182] Loaded profile config "ingress-addon-legacy-845621": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I0717 20:17:18.158878 1101719 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
	I0717 20:17:18.158938 1101719 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-845621"
	I0717 20:17:18.158957 1101719 addons.go:231] Setting addon storage-provisioner=true in "ingress-addon-legacy-845621"
	I0717 20:17:18.159011 1101719 host.go:66] Checking if "ingress-addon-legacy-845621" exists ...
	I0717 20:17:18.159468 1101719 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-845621 --format={{.State.Status}}
	I0717 20:17:18.160152 1101719 cert_rotation.go:137] Starting client certificate rotation controller
	I0717 20:17:18.160195 1101719 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-845621"
	I0717 20:17:18.160214 1101719 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-845621"
	I0717 20:17:18.160483 1101719 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-845621 --format={{.State.Status}}
	I0717 20:17:18.230386 1101719 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 20:17:18.228934 1101719 kapi.go:59] client config for ingress-addon-legacy-845621: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt", KeyFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.key", CAFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6910), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0717 20:17:18.232978 1101719 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:17:18.232992 1101719 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0717 20:17:18.233045 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:17:18.248692 1101719 addons.go:231] Setting addon default-storageclass=true in "ingress-addon-legacy-845621"
	I0717 20:17:18.248737 1101719 host.go:66] Checking if "ingress-addon-legacy-845621" exists ...
	I0717 20:17:18.249179 1101719 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-845621 --format={{.State.Status}}
	I0717 20:17:18.255640 1101719 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34015 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa Username:docker}
	I0717 20:17:18.278412 1101719 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0717 20:17:18.278431 1101719 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0717 20:17:18.278497 1101719 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-845621
	I0717 20:17:18.308203 1101719 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34015 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/ingress-addon-legacy-845621/id_rsa Username:docker}
	I0717 20:17:18.463146 1101719 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0717 20:17:18.697951 1101719 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-845621" context rescaled to 1 replicas
	I0717 20:17:18.698035 1101719 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0717 20:17:18.700643 1101719 out.go:177] * Verifying Kubernetes components...
	I0717 20:17:18.703754 1101719 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 20:17:18.784851 1101719 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0717 20:17:18.869646 1101719 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:17:19.090937 1101719 kapi.go:59] client config for ingress-addon-legacy-845621: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt", KeyFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.key", CAFile:"/home/jenkins/minikube-integration/16890-1049210/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6910), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0717 20:17:19.091241 1101719 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-845621" to be "Ready" ...
	I0717 20:17:19.096168 1101719 start.go:917] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0717 20:17:19.100991 1101719 node_ready.go:49] node "ingress-addon-legacy-845621" has status "Ready":"True"
	I0717 20:17:19.101021 1101719 node_ready.go:38] duration metric: took 9.743993ms waiting for node "ingress-addon-legacy-845621" to be "Ready" ...
	I0717 20:17:19.101032 1101719 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 20:17:19.111480 1101719 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-c5xqq" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:19.347960 1101719 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
	I0717 20:17:19.350327 1101719 addons.go:502] enable addons completed in 1.191439847s: enabled=[default-storageclass storage-provisioner]
	I0717 20:17:21.123604 1101719 pod_ready.go:97] error getting pod "coredns-66bff467f8-c5xqq" in "kube-system" namespace (skipping!): pods "coredns-66bff467f8-c5xqq" not found
	I0717 20:17:21.123632 1101719 pod_ready.go:81] duration metric: took 2.012117933s waiting for pod "coredns-66bff467f8-c5xqq" in "kube-system" namespace to be "Ready" ...
	E0717 20:17:21.123643 1101719 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-66bff467f8-c5xqq" in "kube-system" namespace (skipping!): pods "coredns-66bff467f8-c5xqq" not found
	I0717 20:17:21.123650 1101719 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:23.139223 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:25.638972 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:28.139486 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:30.638527 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:33.139741 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:35.638775 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:38.139134 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:40.139335 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:42.638715 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:45.139566 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:47.638547 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:49.649001 1101719 pod_ready.go:102] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"False"
	I0717 20:17:50.639315 1101719 pod_ready.go:92] pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace has status "Ready":"True"
	I0717 20:17:50.639341 1101719 pod_ready.go:81] duration metric: took 29.515682628s waiting for pod "coredns-66bff467f8-qvlnr" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.639352 1101719 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-845621" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.644269 1101719 pod_ready.go:92] pod "etcd-ingress-addon-legacy-845621" in "kube-system" namespace has status "Ready":"True"
	I0717 20:17:50.644293 1101719 pod_ready.go:81] duration metric: took 4.93324ms waiting for pod "etcd-ingress-addon-legacy-845621" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.644303 1101719 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-845621" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.649375 1101719 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-845621" in "kube-system" namespace has status "Ready":"True"
	I0717 20:17:50.649403 1101719 pod_ready.go:81] duration metric: took 5.092107ms waiting for pod "kube-apiserver-ingress-addon-legacy-845621" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.649414 1101719 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-845621" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.654264 1101719 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-845621" in "kube-system" namespace has status "Ready":"True"
	I0717 20:17:50.654290 1101719 pod_ready.go:81] duration metric: took 4.868133ms waiting for pod "kube-controller-manager-ingress-addon-legacy-845621" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.654303 1101719 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4jhz5" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.659150 1101719 pod_ready.go:92] pod "kube-proxy-4jhz5" in "kube-system" namespace has status "Ready":"True"
	I0717 20:17:50.659182 1101719 pod_ready.go:81] duration metric: took 4.867139ms waiting for pod "kube-proxy-4jhz5" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.659193 1101719 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-845621" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:50.834546 1101719 request.go:628] Waited for 175.287784ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-845621
	I0717 20:17:51.034669 1101719 request.go:628] Waited for 197.34431ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-845621
	I0717 20:17:51.038059 1101719 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-845621" in "kube-system" namespace has status "Ready":"True"
	I0717 20:17:51.038084 1101719 pod_ready.go:81] duration metric: took 378.882052ms waiting for pod "kube-scheduler-ingress-addon-legacy-845621" in "kube-system" namespace to be "Ready" ...
	I0717 20:17:51.038092 1101719 pod_ready.go:38] duration metric: took 31.937049952s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 20:17:51.038111 1101719 api_server.go:52] waiting for apiserver process to appear ...
	I0717 20:17:51.038170 1101719 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 20:17:51.052263 1101719 api_server.go:72] duration metric: took 32.354179723s to wait for apiserver process to appear ...
	I0717 20:17:51.052286 1101719 api_server.go:88] waiting for apiserver healthz status ...
	I0717 20:17:51.052302 1101719 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0717 20:17:51.061705 1101719 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0717 20:17:51.062721 1101719 api_server.go:141] control plane version: v1.18.20
	I0717 20:17:51.062755 1101719 api_server.go:131] duration metric: took 10.461449ms to wait for apiserver health ...
	I0717 20:17:51.062768 1101719 system_pods.go:43] waiting for kube-system pods to appear ...
	I0717 20:17:51.234118 1101719 request.go:628] Waited for 171.269399ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0717 20:17:51.240912 1101719 system_pods.go:59] 7 kube-system pods found
	I0717 20:17:51.240941 1101719 system_pods.go:61] "coredns-66bff467f8-qvlnr" [29821c16-ee1e-4fec-8f40-4ef5cefe1c15] Running
	I0717 20:17:51.240949 1101719 system_pods.go:61] "etcd-ingress-addon-legacy-845621" [e4ad0e6b-396c-4134-a92d-0d54d296b2b4] Running
	I0717 20:17:51.240956 1101719 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-845621" [784fe009-c833-4fe7-a8f7-a3ee51389c73] Running
	I0717 20:17:51.240961 1101719 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-845621" [551aff93-f439-4261-8701-ee3c1583daa5] Running
	I0717 20:17:51.240966 1101719 system_pods.go:61] "kube-proxy-4jhz5" [b6db1c97-d972-434d-a7e4-dac83e9e9b80] Running
	I0717 20:17:51.240971 1101719 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-845621" [c32f4cb3-e190-447b-9a23-11a3f48f00f8] Running
	I0717 20:17:51.240976 1101719 system_pods.go:61] "storage-provisioner" [8b887c14-4313-4e86-ad84-e7d4e6df0d5b] Running
	I0717 20:17:51.240987 1101719 system_pods.go:74] duration metric: took 178.212721ms to wait for pod list to return data ...
	I0717 20:17:51.240995 1101719 default_sa.go:34] waiting for default service account to be created ...
	I0717 20:17:51.434428 1101719 request.go:628] Waited for 193.338988ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I0717 20:17:51.436905 1101719 default_sa.go:45] found service account: "default"
	I0717 20:17:51.436930 1101719 default_sa.go:55] duration metric: took 195.926195ms for default service account to be created ...
	I0717 20:17:51.436941 1101719 system_pods.go:116] waiting for k8s-apps to be running ...
	I0717 20:17:51.634356 1101719 request.go:628] Waited for 197.347707ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0717 20:17:51.640050 1101719 system_pods.go:86] 7 kube-system pods found
	I0717 20:17:51.640083 1101719 system_pods.go:89] "coredns-66bff467f8-qvlnr" [29821c16-ee1e-4fec-8f40-4ef5cefe1c15] Running
	I0717 20:17:51.640092 1101719 system_pods.go:89] "etcd-ingress-addon-legacy-845621" [e4ad0e6b-396c-4134-a92d-0d54d296b2b4] Running
	I0717 20:17:51.640097 1101719 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-845621" [784fe009-c833-4fe7-a8f7-a3ee51389c73] Running
	I0717 20:17:51.640103 1101719 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-845621" [551aff93-f439-4261-8701-ee3c1583daa5] Running
	I0717 20:17:51.640108 1101719 system_pods.go:89] "kube-proxy-4jhz5" [b6db1c97-d972-434d-a7e4-dac83e9e9b80] Running
	I0717 20:17:51.640114 1101719 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-845621" [c32f4cb3-e190-447b-9a23-11a3f48f00f8] Running
	I0717 20:17:51.640121 1101719 system_pods.go:89] "storage-provisioner" [8b887c14-4313-4e86-ad84-e7d4e6df0d5b] Running
	I0717 20:17:51.640130 1101719 system_pods.go:126] duration metric: took 203.183273ms to wait for k8s-apps to be running ...
	I0717 20:17:51.640142 1101719 system_svc.go:44] waiting for kubelet service to be running ....
	I0717 20:17:51.640210 1101719 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 20:17:51.658744 1101719 system_svc.go:56] duration metric: took 18.591561ms WaitForService to wait for kubelet.
	I0717 20:17:51.658772 1101719 kubeadm.go:581] duration metric: took 32.960698314s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0717 20:17:51.658792 1101719 node_conditions.go:102] verifying NodePressure condition ...
	I0717 20:17:51.834103 1101719 request.go:628] Waited for 175.233974ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I0717 20:17:51.837011 1101719 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0717 20:17:51.837043 1101719 node_conditions.go:123] node cpu capacity is 2
	I0717 20:17:51.837056 1101719 node_conditions.go:105] duration metric: took 178.257596ms to run NodePressure ...
	I0717 20:17:51.837067 1101719 start.go:228] waiting for startup goroutines ...
	I0717 20:17:51.837073 1101719 start.go:233] waiting for cluster config update ...
	I0717 20:17:51.837090 1101719 start.go:242] writing updated cluster config ...
	I0717 20:17:51.837383 1101719 ssh_runner.go:195] Run: rm -f paused
	I0717 20:17:51.897763 1101719 start.go:578] kubectl: 1.27.3, cluster: 1.18.20 (minor skew: 9)
	I0717 20:17:51.899902 1101719 out.go:177] 
	W0717 20:17:51.901411 1101719 out.go:239] ! /usr/local/bin/kubectl is version 1.27.3, which may have incompatibilities with Kubernetes 1.18.20.
	I0717 20:17:51.903018 1101719 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I0717 20:17:51.904385 1101719 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-845621" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Jul 17 20:16:39 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:16:39.155947050Z" level=info msg="API listen on [::]:2376"
	Jul 17 20:16:39 ingress-addon-legacy-845621 systemd[1]: Started Docker Application Container Engine.
	Jul 17 20:17:18 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:18.733661878Z" level=info msg="ignoring event" container=4a709e4e0c2c2965f2793201b1321e5e44728bf042319da4e59670e3aafeadab module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:17:20 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:20.358256707Z" level=info msg="ignoring event" container=f527e59acf146cdc46905851fd542de08f28572370a0cb4aed4a81d4660b28a4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:17:53 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:53.361359614Z" level=warning msg="reference for unknown type: " digest="sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7" remote="docker.io/jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7"
	Jul 17 20:17:54 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:54.888919416Z" level=info msg="ignoring event" container=ed5b75f2aa39f52d64caf64dd2d0c99fa902ee3fa95620b62b5e32cfaa3de4cc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:17:54 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:54.927490984Z" level=info msg="ignoring event" container=5a15427f0772132810af684369b742f067bb0567b3f2b240fa586fefcfae2ad9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:17:55 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:55.107309317Z" level=info msg="ignoring event" container=396ac8a2f94a7d975a4c9ceea7a69def73bfc77175c6a5d9ec8a5e234a2186ae module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:17:55 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:55.239203899Z" level=info msg="ignoring event" container=e5eefe2d1869ebd4dc75d371e0f540c2975261a2752c405ba5df0176fb9575bc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:17:56 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:56.106153421Z" level=info msg="ignoring event" container=6c0b56da6aeafc0338e4f63c3c3d57007c0d4072dbcda92736fb046fc8593816 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:17:56 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:17:56.964367803Z" level=warning msg="reference for unknown type: " digest="sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324" remote="registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324"
	Jul 17 20:18:04 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:04.261919621Z" level=warning msg="Published ports are discarded when using host network mode"
	Jul 17 20:18:04 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:04.282793354Z" level=warning msg="Published ports are discarded when using host network mode"
	Jul 17 20:18:04 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:04.430094638Z" level=warning msg="reference for unknown type: " digest="sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" remote="docker.io/cryptexlabs/minikube-ingress-dns@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab"
	Jul 17 20:18:10 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:10.475571130Z" level=info msg="ignoring event" container=140330faeeb5cbb9dec083706bc7400e57c112926374769b415fe943a668bc3b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:18:11 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:11.353058565Z" level=info msg="ignoring event" container=d411de77325c8369f9ebaa892cf0d1b5d81675174f95f3a2eeae647cfe74e834 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:18:23 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:23.870636536Z" level=info msg="ignoring event" container=1885a57f8c14447f7b3824a0200f76999ae0685cedc8cf795f56448d72645637 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:18:24 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:24.747027596Z" level=info msg="ignoring event" container=034a615cd94ea851c739be7fef60e28f7c7a5f17bb9266bcaf7909dc4dc3287e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:18:26 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:26.460334729Z" level=info msg="ignoring event" container=6d58529fbe180b8865d774d689dd48cfb8add116521a0dbfbee0c0fb3b26705f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:18:38 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:38.378216245Z" level=info msg="ignoring event" container=f26268f768aefab9a8e0476b760832449fc8488612d2260af24df84e2eab8444 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:18:39 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:39.442001813Z" level=info msg="ignoring event" container=f4798236c42d286eec7c48f092525431280954d79d295439cb2dc7468c458160 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:18:49 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:49.223994360Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=69e9c4f00de9eb068683b9e40f99ea9e76b65b9255afc2b4cc9ba6b880e991e0
	Jul 17 20:18:49 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:49.253685721Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=69e9c4f00de9eb068683b9e40f99ea9e76b65b9255afc2b4cc9ba6b880e991e0
	Jul 17 20:18:49 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:49.303555053Z" level=info msg="ignoring event" container=69e9c4f00de9eb068683b9e40f99ea9e76b65b9255afc2b4cc9ba6b880e991e0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 17 20:18:49 ingress-addon-legacy-845621 dockerd[1303]: time="2023-07-17T20:18:49.369352441Z" level=info msg="ignoring event" container=939e6c5589a7cd944e97b112615e2d74abe858e6ca5175a204a2a357150e1c91 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                              CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	f4798236c42d2       13753a81eccfd                                                                                                      15 seconds ago       Exited              hello-world-app           2                   72b6548bb7d02       hello-world-app-5f5d8b66bb-hj9g8
	8416b76a4fd77       nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6                                      39 seconds ago       Running             nginx                     0                   0f87837ad01af       nginx
	69e9c4f00de9e       registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324   53 seconds ago       Exited              controller                0                   939e6c5589a7c       ingress-nginx-controller-7fcf777cb7-khw8l
	e5eefe2d1869e       a883f7fc35610                                                                                                      59 seconds ago       Exited              patch                     1                   6c0b56da6aeaf       ingress-nginx-admission-patch-2rn69
	5a15427f07721       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              create                    0                   396ac8a2f94a7       ingress-nginx-admission-create-8mc9d
	fe20361e10520       gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944    About a minute ago   Running             storage-provisioner       0                   f27113ad69af3       storage-provisioner
	8d32530c6d156       565297bc6f7d4                                                                                                      About a minute ago   Running             kube-proxy                0                   bc95f9b4ae901       kube-proxy-4jhz5
	4bc5eb8445510       6e17ba78cf3eb                                                                                                      About a minute ago   Running             coredns                   0                   e62287a242e0a       coredns-66bff467f8-qvlnr
	85c009bf2af55       095f37015706d                                                                                                      2 minutes ago        Running             kube-scheduler            0                   868e6cdcc7d0d       kube-scheduler-ingress-addon-legacy-845621
	d398df7fb9655       ab707b0a0ea33                                                                                                      2 minutes ago        Running             etcd                      0                   412b838472870       etcd-ingress-addon-legacy-845621
	542bfa3d1f407       68a4fac29a865                                                                                                      2 minutes ago        Running             kube-controller-manager   0                   10ef9960d1d6f       kube-controller-manager-ingress-addon-legacy-845621
	1de5005bfe2dd       2694cf044d665                                                                                                      2 minutes ago        Running             kube-apiserver            0                   d769526bfa800       kube-apiserver-ingress-addon-legacy-845621
	
	* 
	* ==> coredns [4bc5eb844551] <==
	* [INFO] 172.17.0.1:15003 - 16694 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000102449s
	[INFO] 172.17.0.1:13967 - 21688 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000290831s
	[INFO] 172.17.0.1:8615 - 14283 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000194141s
	[INFO] 172.17.0.1:15003 - 20341 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002055802s
	[INFO] 172.17.0.1:13967 - 15467 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000050806s
	[INFO] 172.17.0.1:8615 - 39543 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000071516s
	[INFO] 172.17.0.1:8615 - 30312 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000056919s
	[INFO] 172.17.0.1:8615 - 7366 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000075224s
	[INFO] 172.17.0.1:13967 - 43166 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001198162s
	[INFO] 172.17.0.1:15003 - 19200 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00246486s
	[INFO] 172.17.0.1:15003 - 5111 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000162453s
	[INFO] 172.17.0.1:15482 - 5553 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000058618s
	[INFO] 172.17.0.1:15482 - 51340 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000074043s
	[INFO] 172.17.0.1:8615 - 59864 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001590645s
	[INFO] 172.17.0.1:13967 - 51680 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001165488s
	[INFO] 172.17.0.1:15482 - 25134 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000257986s
	[INFO] 172.17.0.1:8615 - 11785 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00117819s
	[INFO] 172.17.0.1:13967 - 28456 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000048804s
	[INFO] 172.17.0.1:15482 - 59772 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00012407s
	[INFO] 172.17.0.1:8615 - 3779 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000168221s
	[INFO] 172.17.0.1:15482 - 38948 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000047557s
	[INFO] 172.17.0.1:15482 - 4066 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000048787s
	[INFO] 172.17.0.1:15482 - 62133 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001152607s
	[INFO] 172.17.0.1:15482 - 20634 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001044554s
	[INFO] 172.17.0.1:15482 - 57068 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000055934s
	
	* 
	* ==> describe nodes <==
	* Name:               ingress-addon-legacy-845621
	Roles:              master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=ingress-addon-legacy-845621
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=46c8e7c4243e42e98d29628785c0523fbabbd9b5
	                    minikube.k8s.io/name=ingress-addon-legacy-845621
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_07_17T20_17_02_0700
	                    minikube.k8s.io/version=v1.30.1
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 17 Jul 2023 20:16:59 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-845621
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 17 Jul 2023 20:18:46 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 17 Jul 2023 20:18:36 +0000   Mon, 17 Jul 2023 20:16:53 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 17 Jul 2023 20:18:36 +0000   Mon, 17 Jul 2023 20:16:53 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 17 Jul 2023 20:18:36 +0000   Mon, 17 Jul 2023 20:16:53 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 17 Jul 2023 20:18:36 +0000   Mon, 17 Jul 2023 20:17:16 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-845621
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	System Info:
	  Machine ID:                 1a9b1ba697a840d3a592a51d4866e01e
	  System UUID:                4c9cd181-0f6f-4d34-bd50-f902bfee7607
	  Boot ID:                    b82ddf7c-3e5c-4bee-beb9-2ca767fc047e
	  Kernel Version:             5.15.0-1039-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.4
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-hj9g8                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         33s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         42s
	  kube-system                 coredns-66bff467f8-qvlnr                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     97s
	  kube-system                 etcd-ingress-addon-legacy-845621                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         108s
	  kube-system                 kube-apiserver-ingress-addon-legacy-845621             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         108s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-845621    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         108s
	  kube-system                 kube-proxy-4jhz5                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         97s
	  kube-system                 kube-scheduler-ingress-addon-legacy-845621             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         108s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         95s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)
	  memory             70Mi (0%!)(MISSING)   170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From        Message
	  ----    ------                   ----                 ----        -------
	  Normal  NodeHasSufficientMemory  2m3s (x5 over 2m3s)  kubelet     Node ingress-addon-legacy-845621 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m3s (x4 over 2m3s)  kubelet     Node ingress-addon-legacy-845621 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m3s (x4 over 2m3s)  kubelet     Node ingress-addon-legacy-845621 status is now: NodeHasSufficientPID
	  Normal  Starting                 108s                 kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  108s                 kubelet     Node ingress-addon-legacy-845621 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    108s                 kubelet     Node ingress-addon-legacy-845621 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     108s                 kubelet     Node ingress-addon-legacy-845621 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  108s                 kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                98s                  kubelet     Node ingress-addon-legacy-845621 status is now: NodeReady
	  Normal  Starting                 95s                  kube-proxy  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +0.000992] FS-Cache: O-key=[8] '063f5c0100000000'
	[  +0.000676] FS-Cache: N-cookie c=0000004f [p=00000045 fl=2 nc=0 na=1]
	[  +0.000880] FS-Cache: N-cookie d=000000000ec8a001{9p.inode} n=00000000b7d02f89
	[  +0.001002] FS-Cache: N-key=[8] '063f5c0100000000'
	[  +3.237809] FS-Cache: Duplicate cookie detected
	[  +0.000802] FS-Cache: O-cookie c=00000046 [p=00000045 fl=226 nc=0 na=1]
	[  +0.000972] FS-Cache: O-cookie d=000000000ec8a001{9p.inode} n=00000000c5282cab
	[  +0.001170] FS-Cache: O-key=[8] '053f5c0100000000'
	[  +0.000727] FS-Cache: N-cookie c=00000051 [p=00000045 fl=2 nc=0 na=1]
	[  +0.000968] FS-Cache: N-cookie d=000000000ec8a001{9p.inode} n=000000001b45f8b3
	[  +0.001058] FS-Cache: N-key=[8] '053f5c0100000000'
	[  +0.288283] FS-Cache: Duplicate cookie detected
	[  +0.000765] FS-Cache: O-cookie c=0000004b [p=00000045 fl=226 nc=0 na=1]
	[  +0.001010] FS-Cache: O-cookie d=000000000ec8a001{9p.inode} n=00000000eb1e0aa2
	[  +0.001066] FS-Cache: O-key=[8] '0b3f5c0100000000'
	[  +0.000729] FS-Cache: N-cookie c=00000052 [p=00000045 fl=2 nc=0 na=1]
	[  +0.000978] FS-Cache: N-cookie d=000000000ec8a001{9p.inode} n=000000003de8c4a0
	[  +0.001034] FS-Cache: N-key=[8] '0b3f5c0100000000'
	[  +3.916795] FS-Cache: Duplicate cookie detected
	[  +0.000817] FS-Cache: O-cookie c=00000055 [p=00000002 fl=222 nc=0 na=1]
	[  +0.001140] FS-Cache: O-cookie d=0000000040a7720e{9P.session} n=00000000483324eb
	[  +0.001142] FS-Cache: O-key=[10] '34323939333531323834'
	[  +0.000766] FS-Cache: N-cookie c=00000056 [p=00000002 fl=2 nc=0 na=1]
	[  +0.000899] FS-Cache: N-cookie d=0000000040a7720e{9P.session} n=0000000083fabb1c
	[  +0.001060] FS-Cache: N-key=[10] '34323939333531323834'
	
	* 
	* ==> etcd [d398df7fb965] <==
	* raft2023/07/17 20:16:54 INFO: aec36adc501070cc became follower at term 0
	raft2023/07/17 20:16:54 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	raft2023/07/17 20:16:54 INFO: aec36adc501070cc became follower at term 1
	raft2023/07/17 20:16:54 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-07-17 20:16:54.606494 W | auth: simple token is not cryptographically signed
	2023-07-17 20:16:54.716461 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	raft2023/07/17 20:16:55 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-07-17 20:16:55.169764 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	2023-07-17 20:16:55.303743 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	2023-07-17 20:16:55.303966 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2023-07-17 20:16:55.331723 I | embed: listening for peers on 192.168.49.2:2380
	2023-07-17 20:16:55.332109 I | embed: listening for metrics on http://127.0.0.1:2381
	raft2023/07/17 20:16:55 INFO: aec36adc501070cc is starting a new election at term 1
	raft2023/07/17 20:16:55 INFO: aec36adc501070cc became candidate at term 2
	raft2023/07/17 20:16:55 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2023/07/17 20:16:55 INFO: aec36adc501070cc became leader at term 2
	raft2023/07/17 20:16:55 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2023-07-17 20:16:55.410050 I | etcdserver: setting up the initial cluster version to 3.4
	2023-07-17 20:16:55.418912 N | etcdserver/membership: set the initial cluster version to 3.4
	2023-07-17 20:16:55.418972 I | etcdserver: published {Name:ingress-addon-legacy-845621 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2023-07-17 20:16:55.419085 I | embed: ready to serve client requests
	2023-07-17 20:16:55.419323 I | etcdserver/api: enabled capabilities for version 3.4
	2023-07-17 20:16:55.419464 I | embed: ready to serve client requests
	2023-07-17 20:16:55.422321 I | embed: serving client requests on 127.0.0.1:2379
	2023-07-17 20:16:55.423164 I | embed: serving client requests on 192.168.49.2:2379
	
	* 
	* ==> kernel <==
	*  20:18:55 up  5:01,  0 users,  load average: 1.46, 2.39, 2.73
	Linux ingress-addon-legacy-845621 5.15.0-1039-aws #44~20.04.1-Ubuntu SMP Thu Jun 22 12:21:08 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kube-apiserver [1de5005bfe2d] <==
	* I0717 20:16:59.456617       1 crdregistration_controller.go:111] Starting crd-autoregister controller
	I0717 20:16:59.459728       1 shared_informer.go:223] Waiting for caches to sync for crd-autoregister
	I0717 20:16:59.560442       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I0717 20:16:59.579630       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0717 20:16:59.583760       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I0717 20:16:59.586394       1 cache.go:39] Caches are synced for autoregister controller
	I0717 20:16:59.587247       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0717 20:17:00.378476       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0717 20:17:00.378687       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0717 20:17:00.394635       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I0717 20:17:00.404505       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I0717 20:17:00.405587       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I0717 20:17:00.871333       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0717 20:17:00.928456       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0717 20:17:01.138541       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0717 20:17:01.139938       1 controller.go:609] quota admission added evaluator for: endpoints
	I0717 20:17:01.144819       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0717 20:17:01.825774       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I0717 20:17:02.643177       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I0717 20:17:02.743569       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I0717 20:17:06.282851       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I0717 20:17:17.266672       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I0717 20:17:17.313050       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I0717 20:17:52.661789       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I0717 20:18:12.641343       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	
	* 
	* ==> kube-controller-manager [542bfa3d1f40] <==
	* I0717 20:17:17.405071       1 range_allocator.go:373] Set node ingress-addon-legacy-845621 PodCIDR to [10.244.0.0/24]
	E0717 20:17:17.410818       1 daemon_controller.go:321] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"/apis/apps/v1/namespaces/kube-system/daemonsets/kube-proxy", UID:"8fc737f5-6a64-4196-9f46-a6d81f590a10", ResourceVersion:"214", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63825221822, loc:(*time.Location)(0x6307ca0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4000e90a20), FieldsType:"FieldsV1", FieldsV1:(*v1.Fields
V1)(0x4000e90a40)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4000e90a60), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(n
il), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0x4000e84380), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSou
rce)(0x4000e90a80), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.Pr
ojectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4000e90aa0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolum
eSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.18.20", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4000e90ae0)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList
(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x4001420f50), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4000cf1a98), Acti
veDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x40001ff8f0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPoli
cy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000f108)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4000cf1ae8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
	I0717 20:17:17.421577       1 shared_informer.go:230] Caches are synced for certificate-csrapproving 
	I0717 20:17:17.433083       1 shared_informer.go:230] Caches are synced for certificate-csrsigning 
	I0717 20:17:17.705278       1 shared_informer.go:230] Caches are synced for attach detach 
	I0717 20:17:17.802310       1 shared_informer.go:230] Caches are synced for persistent volume 
	I0717 20:17:17.822121       1 shared_informer.go:230] Caches are synced for resource quota 
	I0717 20:17:17.826964       1 shared_informer.go:230] Caches are synced for namespace 
	I0717 20:17:17.843147       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0717 20:17:17.862215       1 shared_informer.go:230] Caches are synced for service account 
	I0717 20:17:17.875071       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0717 20:17:17.875091       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0717 20:17:17.885879       1 shared_informer.go:230] Caches are synced for job 
	I0717 20:17:17.927062       1 shared_informer.go:230] Caches are synced for resource quota 
	I0717 20:17:18.204669       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"2dd6df04-d00c-41d8-9593-8f8f0576e04e", APIVersion:"apps/v1", ResourceVersion:"358", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled down replica set coredns-66bff467f8 to 1
	I0717 20:17:18.251285       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"9688eb08-a6f7-4646-86ea-c7282117e945", APIVersion:"apps/v1", ResourceVersion:"359", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: coredns-66bff467f8-c5xqq
	I0717 20:17:52.672285       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"b218e525-93cd-4354-b713-4c70693c37e3", APIVersion:"apps/v1", ResourceVersion:"469", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I0717 20:17:52.700667       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"2fd7fe41-6fc1-46e1-be50-ccddffedf97e", APIVersion:"batch/v1", ResourceVersion:"470", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-8mc9d
	I0717 20:17:52.714951       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"0a44e36c-8809-46ac-accc-90f76c18cf80", APIVersion:"apps/v1", ResourceVersion:"471", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-khw8l
	I0717 20:17:52.752965       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"522e5b4e-e4f1-4831-a125-16b8f2e2c06f", APIVersion:"batch/v1", ResourceVersion:"476", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-2rn69
	I0717 20:17:55.047005       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"2fd7fe41-6fc1-46e1-be50-ccddffedf97e", APIVersion:"batch/v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0717 20:17:56.082944       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"522e5b4e-e4f1-4831-a125-16b8f2e2c06f", APIVersion:"batch/v1", ResourceVersion:"493", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0717 20:18:21.338750       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"ad139a13-1514-4af8-a015-bac9e14ab2d6", APIVersion:"apps/v1", ResourceVersion:"604", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	I0717 20:18:21.348487       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"45c37ea5-fa0c-4776-9001-8f7b5fac0696", APIVersion:"apps/v1", ResourceVersion:"605", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-hj9g8
	E0717 20:18:51.870619       1 tokens_controller.go:261] error synchronizing serviceaccount ingress-nginx/default: secrets "default-token-dq8r5" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated
	
	* 
	* ==> kube-proxy [8d32530c6d15] <==
	* W0717 20:17:19.279113       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I0717 20:17:19.297191       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I0717 20:17:19.297248       1 server_others.go:186] Using iptables Proxier.
	I0717 20:17:19.297640       1 server.go:583] Version: v1.18.20
	I0717 20:17:19.298788       1 config.go:315] Starting service config controller
	I0717 20:17:19.298968       1 shared_informer.go:223] Waiting for caches to sync for service config
	I0717 20:17:19.299167       1 config.go:133] Starting endpoints config controller
	I0717 20:17:19.299265       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I0717 20:17:19.399445       1 shared_informer.go:230] Caches are synced for service config 
	I0717 20:17:19.399487       1 shared_informer.go:230] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [85c009bf2af5] <==
	* W0717 20:16:59.548844       1 authentication.go:298] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0717 20:16:59.548893       1 authentication.go:299] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0717 20:16:59.577003       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0717 20:16:59.577199       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0717 20:16:59.579185       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
	I0717 20:16:59.579530       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0717 20:16:59.579631       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0717 20:16:59.579797       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0717 20:16:59.583547       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0717 20:16:59.586698       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0717 20:16:59.586933       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0717 20:16:59.587135       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0717 20:16:59.587601       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0717 20:16:59.587827       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0717 20:16:59.588041       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0717 20:16:59.588323       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0717 20:16:59.588551       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0717 20:16:59.588729       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0717 20:16:59.589027       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0717 20:16:59.589231       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0717 20:17:00.552556       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0717 20:17:00.582304       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0717 20:17:00.645307       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	I0717 20:17:01.079888       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	E0717 20:17:17.324956       1 factory.go:503] pod: kube-system/coredns-66bff467f8-qvlnr is already present in the active queue
	
	* 
	* ==> kubelet <==
	* Jul 17 20:18:26 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:26.567098    2865 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 034a615cd94ea851c739be7fef60e28f7c7a5f17bb9266bcaf7909dc4dc3287e
	Jul 17 20:18:26 ingress-addon-legacy-845621 kubelet[2865]: E0717 20:18:26.567407    2865 pod_workers.go:191] Error syncing pod 6f60fc81-d5cd-4dc0-b2f3-d693d91017d3 ("hello-world-app-5f5d8b66bb-hj9g8_default(6f60fc81-d5cd-4dc0-b2f3-d693d91017d3)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-hj9g8_default(6f60fc81-d5cd-4dc0-b2f3-d693d91017d3)"
	Jul 17 20:18:37 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:37.148305    2865 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-26xrg" (UniqueName: "kubernetes.io/secret/0180b6a0-5b54-48ed-a52f-000442a3a5dc-minikube-ingress-dns-token-26xrg") pod "0180b6a0-5b54-48ed-a52f-000442a3a5dc" (UID: "0180b6a0-5b54-48ed-a52f-000442a3a5dc")
	Jul 17 20:18:37 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:37.153367    2865 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0180b6a0-5b54-48ed-a52f-000442a3a5dc-minikube-ingress-dns-token-26xrg" (OuterVolumeSpecName: "minikube-ingress-dns-token-26xrg") pod "0180b6a0-5b54-48ed-a52f-000442a3a5dc" (UID: "0180b6a0-5b54-48ed-a52f-000442a3a5dc"). InnerVolumeSpecName "minikube-ingress-dns-token-26xrg". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 17 20:18:37 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:37.248732    2865 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-26xrg" (UniqueName: "kubernetes.io/secret/0180b6a0-5b54-48ed-a52f-000442a3a5dc-minikube-ingress-dns-token-26xrg") on node "ingress-addon-legacy-845621" DevicePath ""
	Jul 17 20:18:38 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:38.661174    2865 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 6d58529fbe180b8865d774d689dd48cfb8add116521a0dbfbee0c0fb3b26705f
	Jul 17 20:18:39 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:39.330887    2865 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 034a615cd94ea851c739be7fef60e28f7c7a5f17bb9266bcaf7909dc4dc3287e
	Jul 17 20:18:39 ingress-addon-legacy-845621 kubelet[2865]: W0717 20:18:39.469015    2865 container.go:412] Failed to create summary reader for "/kubepods/besteffort/pod6f60fc81-d5cd-4dc0-b2f3-d693d91017d3/f4798236c42d286eec7c48f092525431280954d79d295439cb2dc7468c458160": none of the resources are being tracked.
	Jul 17 20:18:39 ingress-addon-legacy-845621 kubelet[2865]: W0717 20:18:39.672673    2865 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-hj9g8 through plugin: invalid network status for
	Jul 17 20:18:39 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:39.677801    2865 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 034a615cd94ea851c739be7fef60e28f7c7a5f17bb9266bcaf7909dc4dc3287e
	Jul 17 20:18:39 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:39.678116    2865 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: f4798236c42d286eec7c48f092525431280954d79d295439cb2dc7468c458160
	Jul 17 20:18:39 ingress-addon-legacy-845621 kubelet[2865]: E0717 20:18:39.678360    2865 pod_workers.go:191] Error syncing pod 6f60fc81-d5cd-4dc0-b2f3-d693d91017d3 ("hello-world-app-5f5d8b66bb-hj9g8_default(6f60fc81-d5cd-4dc0-b2f3-d693d91017d3)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-hj9g8_default(6f60fc81-d5cd-4dc0-b2f3-d693d91017d3)"
	Jul 17 20:18:40 ingress-addon-legacy-845621 kubelet[2865]: W0717 20:18:40.686669    2865 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-hj9g8 through plugin: invalid network status for
	Jul 17 20:18:47 ingress-addon-legacy-845621 kubelet[2865]: E0717 20:18:47.208963    2865 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-khw8l.1772c119e6a5414f", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-khw8l", UID:"edac0296-c3ed-449f-96cb-21922667f237", APIVersion:"v1", ResourceVersion:"480", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-845621"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc1258669cc3c7b4f, ext:104631787408, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc1258669cc3c7b4f, ext:104631787408, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-khw8l.1772c119e6a5414f" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 17 20:18:47 ingress-addon-legacy-845621 kubelet[2865]: E0717 20:18:47.233595    2865 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-khw8l.1772c119e6a5414f", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-khw8l", UID:"edac0296-c3ed-449f-96cb-21922667f237", APIVersion:"v1", ResourceVersion:"480", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-845621"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc1258669cc3c7b4f, ext:104631787408, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc1258669ccf0815e, ext:104643585448, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-khw8l.1772c119e6a5414f" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 17 20:18:49 ingress-addon-legacy-845621 kubelet[2865]: W0717 20:18:49.770585    2865 pod_container_deletor.go:77] Container "939e6c5589a7cd944e97b112615e2d74abe858e6ca5175a204a2a357150e1c91" not found in pod's containers
	Jul 17 20:18:51 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:51.378874    2865 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-wd4bw" (UniqueName: "kubernetes.io/secret/edac0296-c3ed-449f-96cb-21922667f237-ingress-nginx-token-wd4bw") pod "edac0296-c3ed-449f-96cb-21922667f237" (UID: "edac0296-c3ed-449f-96cb-21922667f237")
	Jul 17 20:18:51 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:51.378929    2865 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/edac0296-c3ed-449f-96cb-21922667f237-webhook-cert") pod "edac0296-c3ed-449f-96cb-21922667f237" (UID: "edac0296-c3ed-449f-96cb-21922667f237")
	Jul 17 20:18:51 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:51.385047    2865 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edac0296-c3ed-449f-96cb-21922667f237-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "edac0296-c3ed-449f-96cb-21922667f237" (UID: "edac0296-c3ed-449f-96cb-21922667f237"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 17 20:18:51 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:51.385823    2865 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edac0296-c3ed-449f-96cb-21922667f237-ingress-nginx-token-wd4bw" (OuterVolumeSpecName: "ingress-nginx-token-wd4bw") pod "edac0296-c3ed-449f-96cb-21922667f237" (UID: "edac0296-c3ed-449f-96cb-21922667f237"). InnerVolumeSpecName "ingress-nginx-token-wd4bw". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 17 20:18:51 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:51.479264    2865 reconciler.go:319] Volume detached for volume "ingress-nginx-token-wd4bw" (UniqueName: "kubernetes.io/secret/edac0296-c3ed-449f-96cb-21922667f237-ingress-nginx-token-wd4bw") on node "ingress-addon-legacy-845621" DevicePath ""
	Jul 17 20:18:51 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:51.479314    2865 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/edac0296-c3ed-449f-96cb-21922667f237-webhook-cert") on node "ingress-addon-legacy-845621" DevicePath ""
	Jul 17 20:18:52 ingress-addon-legacy-845621 kubelet[2865]: W0717 20:18:52.341026    2865 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/edac0296-c3ed-449f-96cb-21922667f237/volumes" does not exist
	Jul 17 20:18:53 ingress-addon-legacy-845621 kubelet[2865]: I0717 20:18:53.330753    2865 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: f4798236c42d286eec7c48f092525431280954d79d295439cb2dc7468c458160
	Jul 17 20:18:53 ingress-addon-legacy-845621 kubelet[2865]: E0717 20:18:53.331057    2865 pod_workers.go:191] Error syncing pod 6f60fc81-d5cd-4dc0-b2f3-d693d91017d3 ("hello-world-app-5f5d8b66bb-hj9g8_default(6f60fc81-d5cd-4dc0-b2f3-d693d91017d3)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-hj9g8_default(6f60fc81-d5cd-4dc0-b2f3-d693d91017d3)"
	
	* 
	* ==> storage-provisioner [fe20361e1052] <==
	* I0717 20:17:21.532732       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0717 20:17:21.549951       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0717 20:17:21.551649       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0717 20:17:21.558100       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0717 20:17:21.559110       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-845621_545e55c5-4bc9-4f59-b3df-50cecca5e3fa!
	I0717 20:17:21.560202       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"7862338a-3dbe-4893-94ff-ead529838e00", APIVersion:"v1", ResourceVersion:"405", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-845621_545e55c5-4bc9-4f59-b3df-50cecca5e3fa became leader
	I0717 20:17:21.659760       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-845621_545e55c5-4bc9-4f59-b3df-50cecca5e3fa!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-845621 -n ingress-addon-legacy-845621
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-845621 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (51.88s)

                                                
                                    

Test pass (292/319)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 10.62
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.38
10 TestDownloadOnly/v1.27.3/json-events 9.34
11 TestDownloadOnly/v1.27.3/preload-exists 0
15 TestDownloadOnly/v1.27.3/LogsDuration 0.07
16 TestDownloadOnly/DeleteAll 0.23
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.14
19 TestBinaryMirror 0.6
20 TestOffline 72.46
22 TestAddons/Setup 146.83
24 TestAddons/parallel/Registry 14.97
26 TestAddons/parallel/InspektorGadget 10.82
27 TestAddons/parallel/MetricsServer 5.85
30 TestAddons/parallel/CSI 63.9
31 TestAddons/parallel/Headlamp 12.69
32 TestAddons/parallel/CloudSpanner 5.72
35 TestAddons/serial/GCPAuth/Namespaces 0.26
36 TestAddons/StoppedEnableDisable 11.34
37 TestCertOptions 39.63
38 TestCertExpiration 255.49
39 TestDockerFlags 46.34
40 TestForceSystemdFlag 43.93
41 TestForceSystemdEnv 47.75
48 TestErrorSpam/start 0.84
49 TestErrorSpam/status 1.06
50 TestErrorSpam/pause 1.41
51 TestErrorSpam/unpause 1.58
52 TestErrorSpam/stop 2.09
55 TestFunctional/serial/CopySyncFile 0
56 TestFunctional/serial/StartWithProxy 63.18
57 TestFunctional/serial/AuditLog 0
58 TestFunctional/serial/SoftStart 34.63
59 TestFunctional/serial/KubeContext 0.07
60 TestFunctional/serial/KubectlGetPods 0.11
63 TestFunctional/serial/CacheCmd/cache/add_remote 3.18
64 TestFunctional/serial/CacheCmd/cache/add_local 0.96
65 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.05
66 TestFunctional/serial/CacheCmd/cache/list 0.06
67 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.33
68 TestFunctional/serial/CacheCmd/cache/cache_reload 1.64
69 TestFunctional/serial/CacheCmd/cache/delete 0.11
70 TestFunctional/serial/MinikubeKubectlCmd 0.14
71 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.15
72 TestFunctional/serial/ExtraConfig 37.23
73 TestFunctional/serial/ComponentHealth 0.12
74 TestFunctional/serial/LogsCmd 1.4
75 TestFunctional/serial/LogsFileCmd 1.34
76 TestFunctional/serial/InvalidService 4.42
78 TestFunctional/parallel/ConfigCmd 0.45
79 TestFunctional/parallel/DashboardCmd 12.79
80 TestFunctional/parallel/DryRun 0.5
81 TestFunctional/parallel/InternationalLanguage 0.2
82 TestFunctional/parallel/StatusCmd 1.08
86 TestFunctional/parallel/ServiceCmdConnect 11.68
87 TestFunctional/parallel/AddonsCmd 0.18
88 TestFunctional/parallel/PersistentVolumeClaim 26.45
90 TestFunctional/parallel/SSHCmd 0.79
91 TestFunctional/parallel/CpCmd 1.57
93 TestFunctional/parallel/FileSync 0.53
94 TestFunctional/parallel/CertSync 2.33
98 TestFunctional/parallel/NodeLabels 0.11
100 TestFunctional/parallel/NonActiveRuntimeDisabled 0.53
102 TestFunctional/parallel/License 0.32
104 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.7
105 TestFunctional/parallel/Version/short 0.07
106 TestFunctional/parallel/Version/components 0.73
107 TestFunctional/parallel/ImageCommands/ImageListShort 0.24
108 TestFunctional/parallel/ImageCommands/ImageListTable 0.26
109 TestFunctional/parallel/ImageCommands/ImageListJson 0.25
110 TestFunctional/parallel/ImageCommands/ImageListYaml 0.29
111 TestFunctional/parallel/ImageCommands/ImageBuild 3.45
112 TestFunctional/parallel/ImageCommands/Setup 1.88
113 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
115 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 10.48
116 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 3.63
117 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 2.73
118 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 5.96
119 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.13
120 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
124 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
125 TestFunctional/parallel/DockerEnv/bash 1.72
126 TestFunctional/parallel/UpdateContextCmd/no_changes 0.26
127 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.19
128 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.24
129 TestFunctional/parallel/ImageCommands/ImageSaveToFile 1.07
130 TestFunctional/parallel/ImageCommands/ImageRemove 0.59
131 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 1.57
132 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 3.34
133 TestFunctional/parallel/MountCmd/any-port 8.67
134 TestFunctional/parallel/MountCmd/specific-port 2.08
135 TestFunctional/parallel/MountCmd/VerifyCleanup 2.6
136 TestFunctional/parallel/ServiceCmd/DeployApp 7.24
137 TestFunctional/parallel/ProfileCmd/profile_not_create 0.4
138 TestFunctional/parallel/ProfileCmd/profile_list 0.42
139 TestFunctional/parallel/ProfileCmd/profile_json_output 0.4
140 TestFunctional/parallel/ServiceCmd/List 0.64
141 TestFunctional/parallel/ServiceCmd/JSONOutput 0.73
142 TestFunctional/parallel/ServiceCmd/HTTPS 0.72
143 TestFunctional/parallel/ServiceCmd/Format 0.6
144 TestFunctional/parallel/ServiceCmd/URL 0.49
145 TestFunctional/delete_addon-resizer_images 0.08
146 TestFunctional/delete_my-image_image 0.02
147 TestFunctional/delete_minikube_cached_images 0.02
151 TestImageBuild/serial/Setup 32.55
152 TestImageBuild/serial/NormalBuild 1.89
153 TestImageBuild/serial/BuildWithBuildArg 0.88
154 TestImageBuild/serial/BuildWithDockerIgnore 0.73
155 TestImageBuild/serial/BuildWithSpecifiedDockerfile 0.72
158 TestIngressAddonLegacy/StartLegacyK8sCluster 103.87
160 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 11.45
161 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.58
165 TestJSONOutput/start/Command 62.25
166 TestJSONOutput/start/Audit 0
168 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
169 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
171 TestJSONOutput/pause/Command 0.66
172 TestJSONOutput/pause/Audit 0
174 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
175 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
177 TestJSONOutput/unpause/Command 0.59
178 TestJSONOutput/unpause/Audit 0
180 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
181 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
183 TestJSONOutput/stop/Command 5.76
184 TestJSONOutput/stop/Audit 0
186 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
187 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
188 TestErrorJSONOutput 0.22
190 TestKicCustomNetwork/create_custom_network 34.2
191 TestKicCustomNetwork/use_default_bridge_network 35.2
192 TestKicExistingNetwork 37.77
193 TestKicCustomSubnet 36.49
194 TestKicStaticIP 37.84
195 TestMainNoArgs 0.05
196 TestMinikubeProfile 75.91
199 TestMountStart/serial/StartWithMountFirst 10.89
200 TestMountStart/serial/VerifyMountFirst 0.28
201 TestMountStart/serial/StartWithMountSecond 10.67
202 TestMountStart/serial/VerifyMountSecond 0.27
203 TestMountStart/serial/DeleteFirst 1.5
204 TestMountStart/serial/VerifyMountPostDelete 0.27
205 TestMountStart/serial/Stop 1.23
206 TestMountStart/serial/RestartStopped 8.08
207 TestMountStart/serial/VerifyMountPostStop 0.28
210 TestMultiNode/serial/FreshStart2Nodes 84.39
211 TestMultiNode/serial/DeployApp2Nodes 43.61
212 TestMultiNode/serial/PingHostFrom2Pods 1.09
213 TestMultiNode/serial/AddNode 20.79
214 TestMultiNode/serial/ProfileList 0.35
215 TestMultiNode/serial/CopyFile 10.91
216 TestMultiNode/serial/StopNode 2.37
217 TestMultiNode/serial/StartAfterStop 13.79
218 TestMultiNode/serial/RestartKeepsNodes 126.71
219 TestMultiNode/serial/DeleteNode 5.1
220 TestMultiNode/serial/StopMultiNode 21.87
221 TestMultiNode/serial/RestartMultiNode 82.6
222 TestMultiNode/serial/ValidateNameConflict 35.45
227 TestPreload 153.47
229 TestScheduledStopUnix 106.53
230 TestSkaffold 110.68
232 TestInsufficientStorage 10.97
233 TestRunningBinaryUpgrade 160.45
235 TestKubernetesUpgrade 207.88
236 TestMissingContainerUpgrade 177.78
238 TestPause/serial/Start 71.99
239 TestPause/serial/SecondStartNoReconfiguration 40.1
241 TestNoKubernetes/serial/StartNoK8sWithVersion 0.11
242 TestNoKubernetes/serial/StartWithK8s 42.69
243 TestPause/serial/Pause 1.06
244 TestPause/serial/VerifyStatus 0.55
245 TestPause/serial/Unpause 1.13
246 TestPause/serial/PauseAgain 1.12
247 TestNoKubernetes/serial/StartWithStopK8s 17.15
248 TestPause/serial/DeletePaused 2.39
249 TestPause/serial/VerifyDeletedResources 19.24
250 TestNoKubernetes/serial/Start 7.46
262 TestNoKubernetes/serial/VerifyK8sNotRunning 0.36
263 TestNoKubernetes/serial/ProfileList 0.74
264 TestNoKubernetes/serial/Stop 1.28
265 TestNoKubernetes/serial/StartNoArgs 9.3
266 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.39
267 TestStoppedBinaryUpgrade/Setup 1.1
268 TestStoppedBinaryUpgrade/Upgrade 132.84
276 TestNetworkPlugins/group/auto/Start 79
277 TestNetworkPlugins/group/auto/KubeletFlags 0.32
278 TestNetworkPlugins/group/auto/NetCatPod 10.4
279 TestNetworkPlugins/group/auto/DNS 0.35
280 TestNetworkPlugins/group/auto/Localhost 0.29
281 TestNetworkPlugins/group/auto/HairPin 0.31
282 TestNetworkPlugins/group/kindnet/Start 76.09
283 TestStoppedBinaryUpgrade/MinikubeLogs 2.37
284 TestNetworkPlugins/group/calico/Start 84.78
285 TestNetworkPlugins/group/kindnet/ControllerPod 5.04
286 TestNetworkPlugins/group/kindnet/KubeletFlags 0.49
287 TestNetworkPlugins/group/kindnet/NetCatPod 10.55
288 TestNetworkPlugins/group/kindnet/DNS 0.29
289 TestNetworkPlugins/group/kindnet/Localhost 0.21
290 TestNetworkPlugins/group/kindnet/HairPin 0.23
291 TestNetworkPlugins/group/calico/ControllerPod 5.04
292 TestNetworkPlugins/group/calico/KubeletFlags 0.31
293 TestNetworkPlugins/group/calico/NetCatPod 12.54
294 TestNetworkPlugins/group/calico/DNS 0.26
295 TestNetworkPlugins/group/calico/Localhost 0.27
296 TestNetworkPlugins/group/calico/HairPin 0.28
297 TestNetworkPlugins/group/custom-flannel/Start 73.68
298 TestNetworkPlugins/group/false/Start 57.86
299 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.31
300 TestNetworkPlugins/group/custom-flannel/NetCatPod 12.62
301 TestNetworkPlugins/group/false/KubeletFlags 0.32
302 TestNetworkPlugins/group/false/NetCatPod 10.44
303 TestNetworkPlugins/group/custom-flannel/DNS 0.22
304 TestNetworkPlugins/group/custom-flannel/Localhost 0.18
305 TestNetworkPlugins/group/custom-flannel/HairPin 0.21
306 TestNetworkPlugins/group/false/DNS 0.23
307 TestNetworkPlugins/group/false/Localhost 0.22
308 TestNetworkPlugins/group/false/HairPin 0.2
309 TestNetworkPlugins/group/enable-default-cni/Start 97.65
310 TestNetworkPlugins/group/flannel/Start 73.62
311 TestNetworkPlugins/group/flannel/ControllerPod 5.03
312 TestNetworkPlugins/group/flannel/KubeletFlags 0.31
313 TestNetworkPlugins/group/flannel/NetCatPod 10.36
314 TestNetworkPlugins/group/flannel/DNS 0.24
315 TestNetworkPlugins/group/flannel/Localhost 0.21
316 TestNetworkPlugins/group/flannel/HairPin 0.21
317 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.32
318 TestNetworkPlugins/group/enable-default-cni/NetCatPod 10.37
319 TestNetworkPlugins/group/enable-default-cni/DNS 0.34
320 TestNetworkPlugins/group/enable-default-cni/Localhost 0.25
321 TestNetworkPlugins/group/enable-default-cni/HairPin 0.28
322 TestNetworkPlugins/group/bridge/Start 93.54
323 TestNetworkPlugins/group/kubenet/Start 70.71
324 TestNetworkPlugins/group/kubenet/KubeletFlags 0.3
325 TestNetworkPlugins/group/kubenet/NetCatPod 10.39
326 TestNetworkPlugins/group/bridge/KubeletFlags 0.31
327 TestNetworkPlugins/group/bridge/NetCatPod 11.37
328 TestNetworkPlugins/group/kubenet/DNS 0.26
329 TestNetworkPlugins/group/kubenet/Localhost 0.23
330 TestNetworkPlugins/group/kubenet/HairPin 0.21
331 TestNetworkPlugins/group/bridge/DNS 0.31
332 TestNetworkPlugins/group/bridge/Localhost 0.3
333 TestNetworkPlugins/group/bridge/HairPin 0.29
335 TestStartStop/group/old-k8s-version/serial/FirstStart 142.91
337 TestStartStop/group/no-preload/serial/FirstStart 80.29
338 TestStartStop/group/no-preload/serial/DeployApp 10.52
339 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.22
340 TestStartStop/group/no-preload/serial/Stop 11.04
341 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.19
342 TestStartStop/group/no-preload/serial/SecondStart 345.09
343 TestStartStop/group/old-k8s-version/serial/DeployApp 9.51
344 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.11
345 TestStartStop/group/old-k8s-version/serial/Stop 10.83
346 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.21
347 TestStartStop/group/old-k8s-version/serial/SecondStart 431.08
348 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 11.03
349 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.11
350 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.43
351 TestStartStop/group/no-preload/serial/Pause 3.21
353 TestStartStop/group/embed-certs/serial/FirstStart 69.08
354 TestStartStop/group/embed-certs/serial/DeployApp 8.47
355 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.23
356 TestStartStop/group/embed-certs/serial/Stop 10.96
357 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.22
358 TestStartStop/group/embed-certs/serial/SecondStart 360.15
359 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.03
360 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.12
361 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.45
362 TestStartStop/group/old-k8s-version/serial/Pause 3.23
364 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 63.24
365 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 10.58
366 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.25
367 TestStartStop/group/default-k8s-diff-port/serial/Stop 11.11
368 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.2
369 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 358.68
370 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 7.03
371 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.11
372 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.37
373 TestStartStop/group/embed-certs/serial/Pause 3.19
375 TestStartStop/group/newest-cni/serial/FirstStart 46.66
376 TestStartStop/group/newest-cni/serial/DeployApp 0
377 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.84
378 TestStartStop/group/newest-cni/serial/Stop 11.4
379 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.27
380 TestStartStop/group/newest-cni/serial/SecondStart 45.64
381 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 16.03
382 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
383 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
384 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.94
385 TestStartStop/group/newest-cni/serial/Pause 5.38
386 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.11
387 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.36
388 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.14
x
+
TestDownloadOnly/v1.16.0/json-events (10.62s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-513233 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-513233 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker: (10.6158752s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (10.62s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-513233
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-513233: exit status 85 (381.760747ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-513233 | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC |          |
	|         | -p download-only-513233        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/17 20:06:09
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 20:06:09.810798 1054566 out.go:296] Setting OutFile to fd 1 ...
	I0717 20:06:09.811066 1054566 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:06:09.811094 1054566 out.go:309] Setting ErrFile to fd 2...
	I0717 20:06:09.811112 1054566 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:06:09.811404 1054566 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
	W0717 20:06:09.811569 1054566 root.go:314] Error reading config file at /home/jenkins/minikube-integration/16890-1049210/.minikube/config/config.json: open /home/jenkins/minikube-integration/16890-1049210/.minikube/config/config.json: no such file or directory
	I0717 20:06:09.812063 1054566 out.go:303] Setting JSON to true
	I0717 20:06:09.813080 1054566 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":17313,"bootTime":1689607057,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0717 20:06:09.813175 1054566 start.go:138] virtualization:  
	I0717 20:06:09.816527 1054566 out.go:97] [download-only-513233] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0717 20:06:09.822732 1054566 out.go:169] MINIKUBE_LOCATION=16890
	W0717 20:06:09.816750 1054566 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball: no such file or directory
	I0717 20:06:09.817042 1054566 notify.go:220] Checking for updates...
	I0717 20:06:09.827809 1054566 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:06:09.830107 1054566 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	I0717 20:06:09.832193 1054566 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	I0717 20:06:09.834650 1054566 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0717 20:06:09.839108 1054566 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0717 20:06:09.839425 1054566 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 20:06:09.863212 1054566 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 20:06:09.863292 1054566 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:06:09.944270 1054566 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-07-17 20:06:09.933964815 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:06:09.944376 1054566 docker.go:294] overlay module found
	I0717 20:06:09.946363 1054566 out.go:97] Using the docker driver based on user configuration
	I0717 20:06:09.946386 1054566 start.go:298] selected driver: docker
	I0717 20:06:09.946393 1054566 start.go:880] validating driver "docker" against <nil>
	I0717 20:06:09.946488 1054566 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:06:10.015052 1054566 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-07-17 20:06:10.002552196 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:06:10.015250 1054566 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0717 20:06:10.015547 1054566 start_flags.go:382] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0717 20:06:10.015749 1054566 start_flags.go:901] Wait components to verify : map[apiserver:true system_pods:true]
	I0717 20:06:10.019580 1054566 out.go:169] Using Docker driver with root privileges
	I0717 20:06:10.022126 1054566 cni.go:84] Creating CNI manager for ""
	I0717 20:06:10.022167 1054566 cni.go:168] CNI unnecessary in this configuration, recommending no CNI
	I0717 20:06:10.022187 1054566 start_flags.go:319] config:
	{Name:download-only-513233 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-513233 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:06:10.025085 1054566 out.go:97] Starting control plane node download-only-513233 in cluster download-only-513233
	I0717 20:06:10.025131 1054566 cache.go:122] Beginning downloading kic base image for docker with docker
	I0717 20:06:10.027290 1054566 out.go:97] Pulling base image ...
	I0717 20:06:10.027351 1054566 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0717 20:06:10.027465 1054566 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0717 20:06:10.047010 1054566 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0717 20:06:10.047242 1054566 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0717 20:06:10.047364 1054566 image.go:118] Writing gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0717 20:06:10.101895 1054566 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I0717 20:06:10.101925 1054566 cache.go:57] Caching tarball of preloaded images
	I0717 20:06:10.102099 1054566 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0717 20:06:10.104757 1054566 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0717 20:06:10.104794 1054566 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0717 20:06:10.238162 1054566 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I0717 20:06:15.428752 1054566 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0717 20:06:17.974952 1054566 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0717 20:06:17.975061 1054566 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0717 20:06:18.878798 1054566 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I0717 20:06:18.879156 1054566 profile.go:148] Saving config to /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/download-only-513233/config.json ...
	I0717 20:06:18.879189 1054566 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/download-only-513233/config.json: {Name:mkb3bdf038b26b66d174b5625f0baf8ccd35a2a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:06:18.879383 1054566 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0717 20:06:18.879572 1054566 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl.sha1 -> /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/linux/arm64/v1.16.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-513233"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.38s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/json-events (9.34s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-513233 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-513233 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=docker --driver=docker  --container-runtime=docker: (9.335011787s)
--- PASS: TestDownloadOnly/v1.27.3/json-events (9.34s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/preload-exists
--- PASS: TestDownloadOnly/v1.27.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-513233
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-513233: exit status 85 (73.6265ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-513233 | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC |          |
	|         | -p download-only-513233        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-513233 | jenkins | v1.30.1 | 17 Jul 23 20:06 UTC |          |
	|         | -p download-only-513233        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.27.3   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/17 20:06:20
	Running on machine: ip-172-31-31-251
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 20:06:20.811692 1054643 out.go:296] Setting OutFile to fd 1 ...
	I0717 20:06:20.811939 1054643 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:06:20.811961 1054643 out.go:309] Setting ErrFile to fd 2...
	I0717 20:06:20.811980 1054643 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:06:20.812247 1054643 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
	W0717 20:06:20.812430 1054643 root.go:314] Error reading config file at /home/jenkins/minikube-integration/16890-1049210/.minikube/config/config.json: open /home/jenkins/minikube-integration/16890-1049210/.minikube/config/config.json: no such file or directory
	I0717 20:06:20.812693 1054643 out.go:303] Setting JSON to true
	I0717 20:06:20.813609 1054643 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":17324,"bootTime":1689607057,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0717 20:06:20.813703 1054643 start.go:138] virtualization:  
	I0717 20:06:20.857932 1054643 out.go:97] [download-only-513233] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0717 20:06:20.858264 1054643 notify.go:220] Checking for updates...
	I0717 20:06:20.888959 1054643 out.go:169] MINIKUBE_LOCATION=16890
	I0717 20:06:20.921718 1054643 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:06:20.953322 1054643 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	I0717 20:06:20.985128 1054643 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	I0717 20:06:21.017372 1054643 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0717 20:06:21.097820 1054643 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0717 20:06:21.098371 1054643 config.go:182] Loaded profile config "download-only-513233": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W0717 20:06:21.098465 1054643 start.go:788] api.Load failed for download-only-513233: filestore "download-only-513233": Docker machine "download-only-513233" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0717 20:06:21.098642 1054643 driver.go:373] Setting default libvirt URI to qemu:///system
	W0717 20:06:21.098677 1054643 start.go:788] api.Load failed for download-only-513233: filestore "download-only-513233": Docker machine "download-only-513233" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0717 20:06:21.122727 1054643 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 20:06:21.122821 1054643 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:06:21.189807 1054643 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-17 20:06:21.178679963 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:06:21.189907 1054643 docker.go:294] overlay module found
	I0717 20:06:21.209755 1054643 out.go:97] Using the docker driver based on existing profile
	I0717 20:06:21.209816 1054643 start.go:298] selected driver: docker
	I0717 20:06:21.209823 1054643 start.go:880] validating driver "docker" against &{Name:download-only-513233 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-513233 Namespace:default APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:06:21.210004 1054643 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:06:21.277772 1054643 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-17 20:06:21.268352934 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:06:21.278212 1054643 cni.go:84] Creating CNI manager for ""
	I0717 20:06:21.278231 1054643 cni.go:149] "docker" driver + "docker" runtime found, recommending kindnet
	I0717 20:06:21.278242 1054643 start_flags.go:319] config:
	{Name:download-only-513233 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:download-only-513233 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:06:21.306601 1054643 out.go:97] Starting control plane node download-only-513233 in cluster download-only-513233
	I0717 20:06:21.306657 1054643 cache.go:122] Beginning downloading kic base image for docker with docker
	I0717 20:06:21.338479 1054643 out.go:97] Pulling base image ...
	I0717 20:06:21.338507 1054643 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0717 20:06:21.338658 1054643 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0717 20:06:21.356365 1054643 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0717 20:06:21.356478 1054643 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0717 20:06:21.356503 1054643 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory, skipping pull
	I0717 20:06:21.356510 1054643 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in cache, skipping pull
	I0717 20:06:21.356518 1054643 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0717 20:06:21.413510 1054643 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	I0717 20:06:21.413532 1054643 cache.go:57] Caching tarball of preloaded images
	I0717 20:06:21.413686 1054643 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0717 20:06:21.436475 1054643 out.go:97] Downloading Kubernetes v1.27.3 preload ...
	I0717 20:06:21.436507 1054643 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4 ...
	I0717 20:06:21.559900 1054643 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4?checksum=md5:e061b1178966dc348ac19219444153f4 -> /home/jenkins/minikube-integration/16890-1049210/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-513233"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.27.3/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.23s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:187: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.23s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.14s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:199: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-513233
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.14s)

                                                
                                    
x
+
TestBinaryMirror (0.6s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:304: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-282045 --alsologtostderr --binary-mirror http://127.0.0.1:46565 --driver=docker  --container-runtime=docker
helpers_test.go:175: Cleaning up "binary-mirror-282045" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-282045
--- PASS: TestBinaryMirror (0.60s)

                                                
                                    
x
+
TestOffline (72.46s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-arm64 start -p offline-docker-980239 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker
E0717 20:38:58.668846 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:39:23.286138 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:39:26.993580 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-arm64 start -p offline-docker-980239 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker: (1m10.132022864s)
helpers_test.go:175: Cleaning up "offline-docker-980239" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p offline-docker-980239
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p offline-docker-980239: (2.323926808s)
--- PASS: TestOffline (72.46s)

                                                
                                    
x
+
TestAddons/Setup (146.83s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:88: (dbg) Run:  out/minikube-linux-arm64 start -p addons-282155 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns
addons_test.go:88: (dbg) Done: out/minikube-linux-arm64 start -p addons-282155 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns: (2m26.831441989s)
--- PASS: TestAddons/Setup (146.83s)

                                                
                                    
x
+
TestAddons/parallel/Registry (14.97s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:306: registry stabilized in 29.192037ms
addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-2p97m" [daf16004-5af6-400c-80ae-9740f80d8a2c] Running
addons_test.go:308: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.016646034s
addons_test.go:311: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-nz9l9" [5ac5fbf2-3eaf-495a-b138-dd47c872b0e5] Running
addons_test.go:311: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.009942139s
addons_test.go:316: (dbg) Run:  kubectl --context addons-282155 delete po -l run=registry-test --now
addons_test.go:321: (dbg) Run:  kubectl --context addons-282155 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:321: (dbg) Done: kubectl --context addons-282155 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.955433834s)
addons_test.go:335: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 ip
2023/07/17 20:09:12 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (14.97s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.82s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-njbch" [5b65bddd-f998-45d5-8e7e-852175c49340] Running
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.009649071s
addons_test.go:817: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-282155
addons_test.go:817: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-282155: (5.810156111s)
--- PASS: TestAddons/parallel/InspektorGadget (10.82s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.85s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:383: metrics-server stabilized in 4.076534ms
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-844d8db974-gt9sk" [e0688d50-3734-4add-b6f4-20213ee09034] Running
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.010123087s
addons_test.go:391: (dbg) Run:  kubectl --context addons-282155 top pods -n kube-system
addons_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.85s)

                                                
                                    
x
+
TestAddons/parallel/CSI (63.9s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:537: csi-hostpath-driver pods stabilized in 5.159726ms
addons_test.go:540: (dbg) Run:  kubectl --context addons-282155 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:550: (dbg) Run:  kubectl --context addons-282155 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [03bbc113-ece9-4d64-bed7-17f046e9af7a] Pending
helpers_test.go:344: "task-pv-pod" [03bbc113-ece9-4d64-bed7-17f046e9af7a] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [03bbc113-ece9-4d64-bed7-17f046e9af7a] Running
addons_test.go:555: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.019319343s
addons_test.go:560: (dbg) Run:  kubectl --context addons-282155 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-282155 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-282155 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:570: (dbg) Run:  kubectl --context addons-282155 delete pod task-pv-pod
addons_test.go:570: (dbg) Done: kubectl --context addons-282155 delete pod task-pv-pod: (1.275238119s)
addons_test.go:576: (dbg) Run:  kubectl --context addons-282155 delete pvc hpvc
addons_test.go:582: (dbg) Run:  kubectl --context addons-282155 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:587: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-282155 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:592: (dbg) Run:  kubectl --context addons-282155 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:597: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [6348fdc0-4c6b-406c-bb87-ea0c530b5856] Pending
helpers_test.go:344: "task-pv-pod-restore" [6348fdc0-4c6b-406c-bb87-ea0c530b5856] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [6348fdc0-4c6b-406c-bb87-ea0c530b5856] Running
addons_test.go:597: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.009656626s
addons_test.go:602: (dbg) Run:  kubectl --context addons-282155 delete pod task-pv-pod-restore
addons_test.go:606: (dbg) Run:  kubectl --context addons-282155 delete pvc hpvc-restore
addons_test.go:610: (dbg) Run:  kubectl --context addons-282155 delete volumesnapshot new-snapshot-demo
addons_test.go:614: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:614: (dbg) Done: out/minikube-linux-arm64 -p addons-282155 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.757241853s)
addons_test.go:618: (dbg) Run:  out/minikube-linux-arm64 -p addons-282155 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (63.90s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (12.69s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:800: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-282155 --alsologtostderr -v=1
addons_test.go:800: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-282155 --alsologtostderr -v=1: (1.669112164s)
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-66f6498c69-ssp2s" [17e2941a-f69d-40da-82d5-1c5746e0a7ef] Pending
helpers_test.go:344: "headlamp-66f6498c69-ssp2s" [17e2941a-f69d-40da-82d5-1c5746e0a7ef] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-66f6498c69-ssp2s" [17e2941a-f69d-40da-82d5-1c5746e0a7ef] Running
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 11.022217613s
--- PASS: TestAddons/parallel/Headlamp (12.69s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.72s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-88647b4cb-zf2xl" [58465eea-25de-4d47-a318-74c6fb141ad0] Running
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.016788237s
addons_test.go:836: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-282155
--- PASS: TestAddons/parallel/CloudSpanner (5.72s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.26s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:626: (dbg) Run:  kubectl --context addons-282155 create ns new-namespace
addons_test.go:640: (dbg) Run:  kubectl --context addons-282155 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.26s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (11.34s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:148: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-282155
addons_test.go:148: (dbg) Done: out/minikube-linux-arm64 stop -p addons-282155: (11.068090962s)
addons_test.go:152: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-282155
addons_test.go:156: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-282155
addons_test.go:161: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-282155
--- PASS: TestAddons/StoppedEnableDisable (11.34s)

                                                
                                    
x
+
TestCertOptions (39.63s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-391838 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-391838 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker: (36.781833254s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-391838 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-391838 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-391838 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-391838" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-391838
E0717 20:43:32.952368 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:32.959047 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:32.971798 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:32.992039 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:33.032354 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:33.112663 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:33.272912 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-391838: (2.182829307s)
--- PASS: TestCertOptions (39.63s)

                                                
                                    
x
+
TestCertExpiration (255.49s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-301818 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-301818 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker: (40.265690654s)
E0717 20:43:03.949914 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-301818 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker
E0717 20:46:16.799062 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-301818 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker: (32.942735651s)
helpers_test.go:175: Cleaning up "cert-expiration-301818" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-301818
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-301818: (2.285702094s)
--- PASS: TestCertExpiration (255.49s)

                                                
                                    
x
+
TestDockerFlags (46.34s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-linux-arm64 start -p docker-flags-736300 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:51: (dbg) Done: out/minikube-linux-arm64 start -p docker-flags-736300 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (42.948123853s)
docker_test.go:56: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-736300 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:67: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-736300 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
helpers_test.go:175: Cleaning up "docker-flags-736300" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-flags-736300
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-flags-736300: (2.624009558s)
--- PASS: TestDockerFlags (46.34s)

                                                
                                    
x
+
TestForceSystemdFlag (43.93s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-483911 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-483911 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (39.614839006s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-483911 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-flag-483911" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-483911
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-483911: (3.833758401s)
--- PASS: TestForceSystemdFlag (43.93s)

                                                
                                    
x
+
TestForceSystemdEnv (47.75s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-357589 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-357589 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (44.977149969s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-357589 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-env-357589" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-357589
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-357589: (2.374421718s)
--- PASS: TestForceSystemdEnv (47.75s)

                                                
                                    
x
+
TestErrorSpam/start (0.84s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 start --dry-run
--- PASS: TestErrorSpam/start (0.84s)

                                                
                                    
x
+
TestErrorSpam/status (1.06s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 status
--- PASS: TestErrorSpam/status (1.06s)

                                                
                                    
x
+
TestErrorSpam/pause (1.41s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 pause
--- PASS: TestErrorSpam/pause (1.41s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.58s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 unpause
--- PASS: TestErrorSpam/unpause (1.58s)

                                                
                                    
x
+
TestErrorSpam/stop (2.09s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 stop: (1.889730259s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-729477 --log_dir /tmp/nospam-729477 stop
--- PASS: TestErrorSpam/stop (2.09s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/16890-1049210/.minikube/files/etc/test/nested/copy/1054561/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (63.18s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-964765 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-964765 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker: (1m3.181352743s)
--- PASS: TestFunctional/serial/StartWithProxy (63.18s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (34.63s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-964765 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-964765 --alsologtostderr -v=8: (34.631464778s)
functional_test.go:659: soft start took 34.631958365s for "functional-964765" cluster.
--- PASS: TestFunctional/serial/SoftStart (34.63s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-964765 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.18s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 cache add registry.k8s.io/pause:3.1: (1.111178247s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 cache add registry.k8s.io/pause:3.3: (1.122820488s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.18s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (0.96s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-964765 /tmp/TestFunctionalserialCacheCmdcacheadd_local4016243830/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 cache add minikube-local-cache-test:functional-964765
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 cache delete minikube-local-cache-test:functional-964765
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-964765
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (0.96s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.33s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.33s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.64s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (324.82071ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.64s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 kubectl -- --context functional-964765 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.15s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-964765 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.15s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (37.23s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-964765 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0717 20:13:58.668917 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:13:58.674593 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:13:58.684784 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:13:58.704972 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:13:58.745183 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:13:58.825430 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:13:58.985756 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:13:59.306262 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:13:59.947376 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:14:01.227792 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:14:03.787971 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:14:08.908892 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-964765 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (37.224881327s)
functional_test.go:757: restart took 37.224979452s for "functional-964765" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (37.23s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-964765 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.12s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.4s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 logs: (1.404087803s)
--- PASS: TestFunctional/serial/LogsCmd (1.40s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.34s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 logs --file /tmp/TestFunctionalserialLogsFileCmd4049677465/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 logs --file /tmp/TestFunctionalserialLogsFileCmd4049677465/001/logs.txt: (1.343266273s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.34s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.42s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-964765 apply -f testdata/invalidsvc.yaml
E0717 20:14:19.149095 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-964765
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-964765: exit status 115 (411.770371ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30808 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-964765 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.42s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 config get cpus: exit status 14 (50.598529ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 config get cpus: exit status 14 (126.355541ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (12.79s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-964765 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-964765 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 1095599: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (12.79s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-964765 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-964765 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (209.616761ms)

                                                
                                                
-- stdout --
	* [functional-964765] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16890
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 20:15:11.743460 1094819 out.go:296] Setting OutFile to fd 1 ...
	I0717 20:15:11.743663 1094819 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:15:11.743673 1094819 out.go:309] Setting ErrFile to fd 2...
	I0717 20:15:11.743679 1094819 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:15:11.744015 1094819 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
	I0717 20:15:11.744407 1094819 out.go:303] Setting JSON to false
	I0717 20:15:11.745553 1094819 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":17855,"bootTime":1689607057,"procs":318,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0717 20:15:11.745622 1094819 start.go:138] virtualization:  
	I0717 20:15:11.749251 1094819 out.go:177] * [functional-964765] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	I0717 20:15:11.751247 1094819 out.go:177]   - MINIKUBE_LOCATION=16890
	I0717 20:15:11.753147 1094819 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:15:11.751465 1094819 notify.go:220] Checking for updates...
	I0717 20:15:11.757256 1094819 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	I0717 20:15:11.759443 1094819 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	I0717 20:15:11.761600 1094819 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 20:15:11.763785 1094819 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 20:15:11.766187 1094819 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0717 20:15:11.767422 1094819 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 20:15:11.791908 1094819 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 20:15:11.792026 1094819 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:15:11.889761 1094819 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-07-17 20:15:11.879480965 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:15:11.889884 1094819 docker.go:294] overlay module found
	I0717 20:15:11.892145 1094819 out.go:177] * Using the docker driver based on existing profile
	I0717 20:15:11.894149 1094819 start.go:298] selected driver: docker
	I0717 20:15:11.894169 1094819 start.go:880] validating driver "docker" against &{Name:functional-964765 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-964765 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:15:11.894289 1094819 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 20:15:11.896894 1094819 out.go:177] 
	W0717 20:15:11.899181 1094819 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0717 20:15:11.901271 1094819 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-964765 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
--- PASS: TestFunctional/parallel/DryRun (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-964765 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-964765 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (197.506443ms)

                                                
                                                
-- stdout --
	* [functional-964765] minikube v1.30.1 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16890
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 20:15:13.330465 1095123 out.go:296] Setting OutFile to fd 1 ...
	I0717 20:15:13.330625 1095123 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:15:13.330633 1095123 out.go:309] Setting ErrFile to fd 2...
	I0717 20:15:13.330639 1095123 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:15:13.331013 1095123 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
	I0717 20:15:13.331382 1095123 out.go:303] Setting JSON to false
	I0717 20:15:13.332486 1095123 start.go:128] hostinfo: {"hostname":"ip-172-31-31-251","uptime":17857,"bootTime":1689607057,"procs":318,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
	I0717 20:15:13.332555 1095123 start.go:138] virtualization:  
	I0717 20:15:13.334954 1095123 out.go:177] * [functional-964765] minikube v1.30.1 sur Ubuntu 20.04 (arm64)
	I0717 20:15:13.337191 1095123 out.go:177]   - MINIKUBE_LOCATION=16890
	I0717 20:15:13.337222 1095123 notify.go:220] Checking for updates...
	I0717 20:15:13.339582 1095123 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:15:13.341298 1095123 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	I0717 20:15:13.343078 1095123 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	I0717 20:15:13.344732 1095123 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 20:15:13.346834 1095123 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 20:15:13.349832 1095123 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0717 20:15:13.350657 1095123 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 20:15:13.375758 1095123 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 20:15:13.375858 1095123 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:15:13.458715 1095123 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-07-17 20:15:13.448395859 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:15:13.458817 1095123 docker.go:294] overlay module found
	I0717 20:15:13.461220 1095123 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0717 20:15:13.463070 1095123 start.go:298] selected driver: docker
	I0717 20:15:13.463087 1095123 start.go:880] validating driver "docker" against &{Name:functional-964765 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-964765 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 20:15:13.463228 1095123 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 20:15:13.465569 1095123 out.go:177] 
	W0717 20:15:13.467433 1095123 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0717 20:15:13.469283 1095123 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.08s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (11.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-964765 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-964765 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-58d66798bb-xf8np" [4f1edba7-a392-4f2c-9942-be5bd7016413] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-58d66798bb-xf8np" [4f1edba7-a392-4f2c-9942-be5bd7016413] Running
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 11.01019772s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:31525
functional_test.go:1674: http://192.168.49.2:31525: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-58d66798bb-xf8np

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31525
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (11.68s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (26.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [ad1ca429-1eff-4cde-b759-8de36ee5c6b6] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.013337045s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-964765 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-964765 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-964765 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-964765 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [29d60925-ad03-4ea7-9172-aa4b475d330c] Pending
helpers_test.go:344: "sp-pod" [29d60925-ad03-4ea7-9172-aa4b475d330c] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [29d60925-ad03-4ea7-9172-aa4b475d330c] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 12.015298305s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-964765 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-964765 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-964765 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [cedf1836-9d0c-4d8f-8823-ed8a887e4c2c] Pending
helpers_test.go:344: "sp-pod" [cedf1836-9d0c-4d8f-8823-ed8a887e4c2c] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [cedf1836-9d0c-4d8f-8823-ed8a887e4c2c] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.009786618s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-964765 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (26.45s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.79s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.79s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh -n functional-964765 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 cp functional-964765:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd2914378427/001/cp-test.txt
E0717 20:14:39.629783 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh -n functional-964765 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.57s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/1054561/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo cat /etc/test/nested/copy/1054561/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/1054561.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo cat /etc/ssl/certs/1054561.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/1054561.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo cat /usr/share/ca-certificates/1054561.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/10545612.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo cat /etc/ssl/certs/10545612.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/10545612.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo cat /usr/share/ca-certificates/10545612.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.33s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-964765 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 ssh "sudo systemctl is-active crio": exit status 1 (531.565375ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.32s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-964765 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-964765 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-964765 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-964765 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 1090154: os: process already finished
helpers_test.go:502: unable to terminate pid 1089988: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 version --short
--- PASS: TestFunctional/parallel/Version/short (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.73s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-964765 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.27.3
registry.k8s.io/kube-proxy:v1.27.3
registry.k8s.io/kube-controller-manager:v1.27.3
registry.k8s.io/kube-apiserver:v1.27.3
registry.k8s.io/etcd:3.5.7-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-964765
docker.io/localhost/my-image:functional-964765
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-964765
docker.io/kubernetesui/metrics-scraper:<none>
docker.io/kindest/kindnetd:v20230511-dc714da8
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-964765 image ls --format short --alsologtostderr:
I0717 20:15:22.489462 1096433 out.go:296] Setting OutFile to fd 1 ...
I0717 20:15:22.489697 1096433 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:22.489717 1096433 out.go:309] Setting ErrFile to fd 2...
I0717 20:15:22.489736 1096433 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:22.489991 1096433 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
I0717 20:15:22.490577 1096433 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:22.490717 1096433 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:22.491213 1096433 cli_runner.go:164] Run: docker container inspect functional-964765 --format={{.State.Status}}
I0717 20:15:22.510079 1096433 ssh_runner.go:195] Run: systemctl --version
I0717 20:15:22.510128 1096433 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-964765
I0717 20:15:22.528036 1096433 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34005 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/functional-964765/id_rsa Username:docker}
I0717 20:15:22.625870 1096433 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
2023/07/17 20:15:26 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-964765 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/kube-scheduler              | v1.27.3            | bcb9e554eaab6 | 56.2MB |
| registry.k8s.io/pause                       | 3.9                | 829e9de338bd5 | 514kB  |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | ba04bb24b9575 | 29MB   |
| registry.k8s.io/echoserver-arm              | 1.8                | 72565bf5bbedf | 85MB   |
| registry.k8s.io/pause                       | latest             | 8cb2091f603e7 | 240kB  |
| docker.io/library/minikube-local-cache-test | functional-964765  | 23de4fe56e19b | 30B    |
| registry.k8s.io/kube-apiserver              | v1.27.3            | 39dfb036b0986 | 115MB  |
| registry.k8s.io/etcd                        | 3.5.7-0            | 24bc64e911039 | 181MB  |
| gcr.io/google-containers/addon-resizer      | functional-964765  | ffd4cfbbe753e | 32.9MB |
| registry.k8s.io/pause                       | 3.1                | 8057e0500773a | 525kB  |
| docker.io/library/nginx                     | latest             | 2002d33a54f72 | 192MB  |
| registry.k8s.io/kube-proxy                  | v1.27.3            | fb73e92641fd5 | 66.5MB |
| docker.io/kubernetesui/metrics-scraper      | <none>             | a422e0e982356 | 42.3MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | 1611cd07b61d5 | 3.55MB |
| docker.io/kindest/kindnetd                  | v20230511-dc714da8 | b18bf71b941ba | 59.2MB |
| registry.k8s.io/coredns/coredns             | v1.10.1            | 97e04611ad434 | 51.4MB |
| registry.k8s.io/kube-controller-manager     | v1.27.3            | ab3683b584ae5 | 107MB  |
| registry.k8s.io/pause                       | 3.3                | 3d18732f8686c | 484kB  |
| docker.io/localhost/my-image                | functional-964765  | 6589184203530 | 1.41MB |
| docker.io/library/nginx                     | alpine             | 66bf2c914bf4d | 41MB   |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-964765 image ls --format table --alsologtostderr:
I0717 20:15:22.230382 1096403 out.go:296] Setting OutFile to fd 1 ...
I0717 20:15:22.230581 1096403 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:22.230592 1096403 out.go:309] Setting ErrFile to fd 2...
I0717 20:15:22.230598 1096403 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:22.230864 1096403 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
I0717 20:15:22.231435 1096403 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:22.231553 1096403 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:22.232016 1096403 cli_runner.go:164] Run: docker container inspect functional-964765 --format={{.State.Status}}
I0717 20:15:22.262260 1096403 ssh_runner.go:195] Run: systemctl --version
I0717 20:15:22.262317 1096403 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-964765
I0717 20:15:22.281702 1096403 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34005 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/functional-964765/id_rsa Username:docker}
I0717 20:15:22.378539 1096403 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-964765 image ls --format json --alsologtostderr:
[{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"525000"},{"id":"2002d33a54f72d1333751d4d1b4793a60a635eac6e94a98daf0acea501580c4f","repoDigests":[],"repoTags":["docker.io/library/nginx:latest"],"size":"192000000"},{"id":"ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8","repoDigests":[],"repoTags":["registry.k8s.io/kube-controller-manager:v1.27.3"],"size":"107000000"},{"id":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":[],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"51400000"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29000000"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3550000"},{"id":"829e9de338bd5fdd3f16f68f83a9fb288fbc
8453e881e5d5cfd0f6f2ff72b43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.9"],"size":"514000"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-964765"],"size":"32900000"},{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":[],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"85000000"},{"id":"23de4fe56e19b216c94987490b297f31609fab615086b3702eb2d1477ce342b3","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-964765"],"size":"30"},{"id":"66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea","repoDigests":[],"repoTags":["docker.io/library/nginx:alpine"],"size":"41000000"},{"id":"39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473","repoDigests":[],"repoTags":["registry.k8s.io/kube-apiserver:v1.27.3"],"size":"115000000"},{"id":"b18bf71b941bae2e12db1c07e567ad14e4febbc778310a0fc64487f1ac877d79","repoDi
gests":[],"repoTags":["docker.io/kindest/kindnetd:v20230511-dc714da8"],"size":"59200000"},{"id":"24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737","repoDigests":[],"repoTags":["registry.k8s.io/etcd:3.5.7-0"],"size":"181000000"},{"id":"bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540","repoDigests":[],"repoTags":["registry.k8s.io/kube-scheduler:v1.27.3"],"size":"56200000"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"484000"},{"id":"658918420353089ec8f94161e09585f14c65a8968571e0b4e9d1497fc068c4c7","repoDigests":[],"repoTags":["docker.io/localhost/my-image:functional-964765"],"size":"1410000"},{"id":"fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a","repoDigests":[],"repoTags":["registry.k8s.io/kube-proxy:v1.27.3"],"size":"66500000"},{"id":"a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":[],"repoTags":["docker.io/kubernetesui/metrics-scrape
r:\u003cnone\u003e"],"size":"42300000"},{"id":"8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"240000"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-964765 image ls --format json --alsologtostderr:
I0717 20:15:21.969594 1096376 out.go:296] Setting OutFile to fd 1 ...
I0717 20:15:21.969777 1096376 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:21.969782 1096376 out.go:309] Setting ErrFile to fd 2...
I0717 20:15:21.969787 1096376 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:21.970050 1096376 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
I0717 20:15:21.970699 1096376 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:21.970815 1096376 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:21.971262 1096376 cli_runner.go:164] Run: docker container inspect functional-964765 --format={{.State.Status}}
I0717 20:15:21.990395 1096376 ssh_runner.go:195] Run: systemctl --version
I0717 20:15:21.990447 1096376 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-964765
I0717 20:15:22.019107 1096376 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34005 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/functional-964765/id_rsa Username:docker}
I0717 20:15:22.121671 1096376 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-964765 image ls --format yaml --alsologtostderr:
- id: b18bf71b941bae2e12db1c07e567ad14e4febbc778310a0fc64487f1ac877d79
repoDigests: []
repoTags:
- docker.io/kindest/kindnetd:v20230511-dc714da8
size: "59200000"
- id: 829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.9
size: "514000"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "484000"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29000000"
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3550000"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "240000"
- id: 2002d33a54f72d1333751d4d1b4793a60a635eac6e94a98daf0acea501580c4f
repoDigests: []
repoTags:
- docker.io/library/nginx:latest
size: "192000000"
- id: bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540
repoDigests: []
repoTags:
- registry.k8s.io/kube-scheduler:v1.27.3
size: "56200000"
- id: fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a
repoDigests: []
repoTags:
- registry.k8s.io/kube-proxy:v1.27.3
size: "66500000"
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-964765
size: "32900000"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests: []
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "85000000"
- id: 39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473
repoDigests: []
repoTags:
- registry.k8s.io/kube-apiserver:v1.27.3
size: "115000000"
- id: 24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737
repoDigests: []
repoTags:
- registry.k8s.io/etcd:3.5.7-0
size: "181000000"
- id: a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests: []
repoTags:
- docker.io/kubernetesui/metrics-scraper:<none>
size: "42300000"
- id: 97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests: []
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "51400000"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "525000"
- id: 23de4fe56e19b216c94987490b297f31609fab615086b3702eb2d1477ce342b3
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-964765
size: "30"
- id: 66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea
repoDigests: []
repoTags:
- docker.io/library/nginx:alpine
size: "41000000"
- id: ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8
repoDigests: []
repoTags:
- registry.k8s.io/kube-controller-manager:v1.27.3
size: "107000000"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-964765 image ls --format yaml --alsologtostderr:
I0717 20:15:18.229481 1096133 out.go:296] Setting OutFile to fd 1 ...
I0717 20:15:18.229636 1096133 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:18.229641 1096133 out.go:309] Setting ErrFile to fd 2...
I0717 20:15:18.229646 1096133 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:18.229893 1096133 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
I0717 20:15:18.230534 1096133 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:18.230644 1096133 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:18.231122 1096133 cli_runner.go:164] Run: docker container inspect functional-964765 --format={{.State.Status}}
I0717 20:15:18.259593 1096133 ssh_runner.go:195] Run: systemctl --version
I0717 20:15:18.259647 1096133 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-964765
I0717 20:15:18.291526 1096133 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34005 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/functional-964765/id_rsa Username:docker}
I0717 20:15:18.406105 1096133 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 ssh pgrep buildkitd: exit status 1 (386.14186ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image build -t localhost/my-image:functional-964765 testdata/build --alsologtostderr
E0717 20:15:20.590480 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 image build -t localhost/my-image:functional-964765 testdata/build --alsologtostderr: (2.774399659s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-964765 image build -t localhost/my-image:functional-964765 testdata/build --alsologtostderr:
I0717 20:15:18.905586 1096210 out.go:296] Setting OutFile to fd 1 ...
I0717 20:15:18.906559 1096210 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:18.906572 1096210 out.go:309] Setting ErrFile to fd 2...
I0717 20:15:18.906578 1096210 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 20:15:18.906841 1096210 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
I0717 20:15:18.907460 1096210 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:18.908066 1096210 config.go:182] Loaded profile config "functional-964765": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0717 20:15:18.908602 1096210 cli_runner.go:164] Run: docker container inspect functional-964765 --format={{.State.Status}}
I0717 20:15:18.941164 1096210 ssh_runner.go:195] Run: systemctl --version
I0717 20:15:18.941220 1096210 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-964765
I0717 20:15:18.967458 1096210 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34005 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/functional-964765/id_rsa Username:docker}
I0717 20:15:19.061120 1096210 build_images.go:151] Building image from path: /tmp/build.3740660958.tar
I0717 20:15:19.061220 1096210 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0717 20:15:19.077122 1096210 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.3740660958.tar
I0717 20:15:19.084141 1096210 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.3740660958.tar: stat -c "%s %y" /var/lib/minikube/build/build.3740660958.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.3740660958.tar': No such file or directory
I0717 20:15:19.084190 1096210 ssh_runner.go:362] scp /tmp/build.3740660958.tar --> /var/lib/minikube/build/build.3740660958.tar (3072 bytes)
I0717 20:15:19.119840 1096210 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.3740660958
I0717 20:15:19.131647 1096210 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.3740660958 -xf /var/lib/minikube/build/build.3740660958.tar
I0717 20:15:19.144184 1096210 docker.go:339] Building image: /var/lib/minikube/build/build.3740660958
I0717 20:15:19.144276 1096210 ssh_runner.go:195] Run: docker build -t localhost/my-image:functional-964765 /var/lib/minikube/build/build.3740660958
#0 building with "default" instance using docker driver

                                                
                                                
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.7s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B 0.0s done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.2s
#5 sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 770B / 770B done
#5 sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9 527B / 527B done
#5 sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02 1.47kB / 1.47kB done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.0s done
#5 DONE 0.4s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.6s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.1s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.0s done
#8 writing image sha256:658918420353089ec8f94161e09585f14c65a8968571e0b4e9d1497fc068c4c7 done
#8 naming to localhost/my-image:functional-964765 done
#8 DONE 0.0s
I0717 20:15:21.584079 1096210 ssh_runner.go:235] Completed: docker build -t localhost/my-image:functional-964765 /var/lib/minikube/build/build.3740660958: (2.43977815s)
I0717 20:15:21.584148 1096210 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.3740660958
I0717 20:15:21.595558 1096210 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.3740660958.tar
I0717 20:15:21.610622 1096210 build_images.go:207] Built localhost/my-image:functional-964765 from /tmp/build.3740660958.tar
I0717 20:15:21.610647 1096210 build_images.go:123] succeeded building to: functional-964765
I0717 20:15:21.610652 1096210 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.45s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.88s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (1.849751862s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-964765
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.88s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-964765 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-964765 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [b06a34c9-11f0-4dbf-a1e8-c1c7c044179a] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [b06a34c9-11f0-4dbf-a1e8-c1c7c044179a] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 10.026147174s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.48s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (3.63s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image load --daemon gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 image load --daemon gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr: (3.417049048s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (3.63s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image load --daemon gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 image load --daemon gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr: (2.519419314s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.73s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.96s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.741342139s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-964765
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image load --daemon gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 image load --daemon gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr: (3.899883905s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.96s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-964765 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.110.200.74 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-964765 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (1.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-964765 docker-env) && out/minikube-linux-arm64 status -p functional-964765"
functional_test.go:495: (dbg) Done: /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-964765 docker-env) && out/minikube-linux-arm64 status -p functional-964765": (1.070858286s)
functional_test.go:518: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-964765 docker-env) && docker images"
--- PASS: TestFunctional/parallel/DockerEnv/bash (1.72s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image save gcr.io/google-containers/addon-resizer:functional-964765 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:379: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 image save gcr.io/google-containers/addon-resizer:functional-964765 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.073977217s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.59s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image rm gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.59s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:408: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.247385477s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.57s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (3.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-964765
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 image save --daemon gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr
functional_test.go:423: (dbg) Done: out/minikube-linux-arm64 -p functional-964765 image save --daemon gcr.io/google-containers/addon-resizer:functional-964765 --alsologtostderr: (3.257714831s)
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-964765
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (3.34s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (8.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdany-port4213931224/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1689624881058715806" to /tmp/TestFunctionalparallelMountCmdany-port4213931224/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1689624881058715806" to /tmp/TestFunctionalparallelMountCmdany-port4213931224/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1689624881058715806" to /tmp/TestFunctionalparallelMountCmdany-port4213931224/001/test-1689624881058715806
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (483.48366ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jul 17 20:14 created-by-test
-rw-r--r-- 1 docker docker 24 Jul 17 20:14 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jul 17 20:14 test-1689624881058715806
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh cat /mount-9p/test-1689624881058715806
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-964765 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [44928bf7-14ea-4811-9072-63b3da58c384] Pending
helpers_test.go:344: "busybox-mount" [44928bf7-14ea-4811-9072-63b3da58c384] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [44928bf7-14ea-4811-9072-63b3da58c384] Running
helpers_test.go:344: "busybox-mount" [44928bf7-14ea-4811-9072-63b3da58c384] Running: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [44928bf7-14ea-4811-9072-63b3da58c384] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 5.016628103s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-964765 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdany-port4213931224/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (8.67s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdspecific-port1592088502/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (502.359422ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdspecific-port1592088502/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 ssh "sudo umount -f /mount-9p": exit status 1 (423.798327ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-964765 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdspecific-port1592088502/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.08s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (2.6s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3798364367/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3798364367/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3798364367/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T" /mount1: exit status 1 (1.087207838s)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-964765 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3798364367/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3798364367/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-964765 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3798364367/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (2.60s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (7.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-964765 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-964765 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-7b684b55f9-n2hfc" [3619cbb5-a0be-4c8b-82ac-d6f1bc6927fc] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-7b684b55f9-n2hfc" [3619cbb5-a0be-4c8b-82ac-d6f1bc6927fc] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 7.012759548s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (7.24s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1314: Took "357.986358ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1328: Took "60.33317ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1365: Took "331.852404ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1378: Took "68.778349ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.64s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 service list -o json
functional_test.go:1493: Took "728.429062ms" to run "out/minikube-linux-arm64 -p functional-964765 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.73s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.49.2:30002
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.72s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.6s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.60s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-arm64 -p functional-964765 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:30002
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.49s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.08s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-964765
--- PASS: TestFunctional/delete_addon-resizer_images (0.08s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-964765
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-964765
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (32.55s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -p image-687264 --driver=docker  --container-runtime=docker
image_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -p image-687264 --driver=docker  --container-runtime=docker: (32.554096411s)
--- PASS: TestImageBuild/serial/Setup (32.55s)

                                                
                                    
x
+
TestImageBuild/serial/NormalBuild (1.89s)

                                                
                                                
=== RUN   TestImageBuild/serial/NormalBuild
image_test.go:78: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-687264
image_test.go:78: (dbg) Done: out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-687264: (1.888687686s)
--- PASS: TestImageBuild/serial/NormalBuild (1.89s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithBuildArg (0.88s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithBuildArg
image_test.go:99: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-687264
--- PASS: TestImageBuild/serial/BuildWithBuildArg (0.88s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithDockerIgnore (0.73s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithDockerIgnore
image_test.go:133: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal --build-opt=no-cache -p image-687264
--- PASS: TestImageBuild/serial/BuildWithDockerIgnore (0.73s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.72s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithSpecifiedDockerfile
image_test.go:88: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest -f inner/Dockerfile ./testdata/image-build/test-f -p image-687264
--- PASS: TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.72s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (103.87s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-arm64 start -p ingress-addon-legacy-845621 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E0717 20:16:42.511537 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-arm64 start -p ingress-addon-legacy-845621 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (1m43.868512549s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (103.87s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (11.45s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-845621 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-845621 addons enable ingress --alsologtostderr -v=5: (11.446269146s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (11.45s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.58s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-845621 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.58s)

                                                
                                    
x
+
TestJSONOutput/start/Command (62.25s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-547062 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker
E0717 20:18:58.669286 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:19:23.286663 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:23.291905 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:23.302134 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:23.322341 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:23.362520 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:23.442765 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:23.603122 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:23.923571 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:24.564705 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:25.845469 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:26.351843 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:19:28.406967 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:33.528103 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 20:19:43.768357 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-547062 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker: (1m2.253901148s)
--- PASS: TestJSONOutput/start/Command (62.25s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.66s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-547062 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.66s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.59s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-547062 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.59s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.76s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-547062 --output=json --user=testUser
E0717 20:20:04.249350 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-547062 --output=json --user=testUser: (5.755414924s)
--- PASS: TestJSONOutput/stop/Command (5.76s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.22s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-945258 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-945258 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (70.520707ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"26d7f620-33b9-437f-98f6-dc1a2b376ad2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-945258] minikube v1.30.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"4b68a20a-7aa8-495f-9b88-ece43c52f49a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16890"}}
	{"specversion":"1.0","id":"bd085f19-2eca-4e70-bdc3-2b875cd23c92","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"b7e30778-3efe-45a0-b675-a8a1bbb46b31","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig"}}
	{"specversion":"1.0","id":"9b07eee3-9d2b-49c4-bbb4-11de1ddb5004","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube"}}
	{"specversion":"1.0","id":"0590ff40-bb98-43aa-a555-3920a7d5577e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"c3216c63-ebfe-419d-b528-8ed870cb4c75","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"66bbefc2-1343-456d-a7a6-2db5daf5f724","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-945258" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-945258
--- PASS: TestErrorJSONOutput (0.22s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (34.2s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-093321 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-093321 --network=: (32.088671852s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-093321" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-093321
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-093321: (2.092094946s)
--- PASS: TestKicCustomNetwork/create_custom_network (34.20s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (35.2s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-531497 --network=bridge
E0717 20:20:45.209604 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-531497 --network=bridge: (33.185220472s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-531497" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-531497
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-531497: (1.995843796s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (35.20s)

                                                
                                    
x
+
TestKicExistingNetwork (37.77s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-155638 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-155638 --network=existing-network: (35.608623881s)
helpers_test.go:175: Cleaning up "existing-network-155638" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-155638
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-155638: (2.002163185s)
--- PASS: TestKicExistingNetwork (37.77s)

                                                
                                    
x
+
TestKicCustomSubnet (36.49s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-205670 --subnet=192.168.60.0/24
E0717 20:22:07.130364 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-205670 --subnet=192.168.60.0/24: (34.402838398s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-205670 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-205670" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-205670
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-205670: (2.054689913s)
--- PASS: TestKicCustomSubnet (36.49s)

                                                
                                    
x
+
TestKicStaticIP (37.84s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-259927 --static-ip=192.168.200.200
E0717 20:23:03.949759 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:03.955012 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:03.965230 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:03.985472 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:04.025642 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:04.105918 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:04.266227 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:04.586807 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:05.227811 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:06.508320 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-259927 --static-ip=192.168.200.200: (35.457403129s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-259927 ip
helpers_test.go:175: Cleaning up "static-ip-259927" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-259927
E0717 20:23:09.068434 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-259927: (2.20319727s)
--- PASS: TestKicStaticIP (37.84s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (75.91s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-261420 --driver=docker  --container-runtime=docker
E0717 20:23:14.189279 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:24.430453 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:23:44.910669 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-261420 --driver=docker  --container-runtime=docker: (34.934491798s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-264702 --driver=docker  --container-runtime=docker
E0717 20:23:58.669016 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-264702 --driver=docker  --container-runtime=docker: (35.355351406s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-261420
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-264702
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-264702" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-264702
E0717 20:24:23.286568 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-264702: (2.184524545s)
helpers_test.go:175: Cleaning up "first-261420" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-261420
E0717 20:24:25.870914 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-261420: (2.177641365s)
--- PASS: TestMinikubeProfile (75.91s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (10.89s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-114707 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-114707 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (9.884896995s)
--- PASS: TestMountStart/serial/StartWithMountFirst (10.89s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-114707 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.28s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (10.67s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-116823 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-116823 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (9.667838752s)
--- PASS: TestMountStart/serial/StartWithMountSecond (10.67s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-116823 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.27s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.5s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-114707 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-114707 --alsologtostderr -v=5: (1.503624192s)
--- PASS: TestMountStart/serial/DeleteFirst (1.50s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-116823 ssh -- ls /minikube-host
E0717 20:24:50.970850 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.27s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.23s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-116823
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-116823: (1.229131516s)
--- PASS: TestMountStart/serial/Stop (1.23s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (8.08s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-116823
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-116823: (7.076985801s)
--- PASS: TestMountStart/serial/RestartStopped (8.08s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-116823 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (84.39s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-698783 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E0717 20:25:47.791079 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p multinode-698783 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m23.835228617s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (84.39s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (43.61s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-698783 -- rollout status deployment/busybox: (3.120890238s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-g5xsx -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-q5m8w -- nslookup kubernetes.io
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-g5xsx -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-q5m8w -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-g5xsx -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-q5m8w -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (43.61s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-g5xsx -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-g5xsx -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-q5m8w -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-698783 -- exec busybox-67b7f59bb-q5m8w -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.09s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (20.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-698783 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-698783 -v 3 --alsologtostderr: (20.077867242s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (20.79s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.35s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (10.91s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp testdata/cp-test.txt multinode-698783:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1062404421/001/cp-test_multinode-698783.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783:/home/docker/cp-test.txt multinode-698783-m02:/home/docker/cp-test_multinode-698783_multinode-698783-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m02 "sudo cat /home/docker/cp-test_multinode-698783_multinode-698783-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783:/home/docker/cp-test.txt multinode-698783-m03:/home/docker/cp-test_multinode-698783_multinode-698783-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m03 "sudo cat /home/docker/cp-test_multinode-698783_multinode-698783-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp testdata/cp-test.txt multinode-698783-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1062404421/001/cp-test_multinode-698783-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783-m02:/home/docker/cp-test.txt multinode-698783:/home/docker/cp-test_multinode-698783-m02_multinode-698783.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783 "sudo cat /home/docker/cp-test_multinode-698783-m02_multinode-698783.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783-m02:/home/docker/cp-test.txt multinode-698783-m03:/home/docker/cp-test_multinode-698783-m02_multinode-698783-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m03 "sudo cat /home/docker/cp-test_multinode-698783-m02_multinode-698783-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp testdata/cp-test.txt multinode-698783-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1062404421/001/cp-test_multinode-698783-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783-m03:/home/docker/cp-test.txt multinode-698783:/home/docker/cp-test_multinode-698783-m03_multinode-698783.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783 "sudo cat /home/docker/cp-test_multinode-698783-m03_multinode-698783.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 cp multinode-698783-m03:/home/docker/cp-test.txt multinode-698783-m02:/home/docker/cp-test_multinode-698783-m03_multinode-698783-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 ssh -n multinode-698783-m02 "sudo cat /home/docker/cp-test_multinode-698783-m03_multinode-698783-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (10.91s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.37s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-arm64 -p multinode-698783 node stop m03: (1.243921666s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-698783 status: exit status 7 (584.573876ms)

                                                
                                                
-- stdout --
	multinode-698783
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-698783-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-698783-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-698783 status --alsologtostderr: exit status 7 (544.892015ms)

                                                
                                                
-- stdout --
	multinode-698783
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-698783-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-698783-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 20:27:45.316753 1162193 out.go:296] Setting OutFile to fd 1 ...
	I0717 20:27:45.316988 1162193 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:27:45.317007 1162193 out.go:309] Setting ErrFile to fd 2...
	I0717 20:27:45.317013 1162193 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:27:45.317761 1162193 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
	I0717 20:27:45.318106 1162193 out.go:303] Setting JSON to false
	I0717 20:27:45.318170 1162193 mustload.go:65] Loading cluster: multinode-698783
	I0717 20:27:45.319016 1162193 config.go:182] Loaded profile config "multinode-698783": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0717 20:27:45.319048 1162193 status.go:255] checking status of multinode-698783 ...
	I0717 20:27:45.320056 1162193 cli_runner.go:164] Run: docker container inspect multinode-698783 --format={{.State.Status}}
	I0717 20:27:45.322255 1162193 notify.go:220] Checking for updates...
	I0717 20:27:45.339540 1162193 status.go:330] multinode-698783 host status = "Running" (err=<nil>)
	I0717 20:27:45.339563 1162193 host.go:66] Checking if "multinode-698783" exists ...
	I0717 20:27:45.339985 1162193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-698783
	I0717 20:27:45.358502 1162193 host.go:66] Checking if "multinode-698783" exists ...
	I0717 20:27:45.358833 1162193 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 20:27:45.358889 1162193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-698783
	I0717 20:27:45.377175 1162193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34075 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/multinode-698783/id_rsa Username:docker}
	I0717 20:27:45.470019 1162193 ssh_runner.go:195] Run: systemctl --version
	I0717 20:27:45.475620 1162193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 20:27:45.489446 1162193 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:27:45.567782 1162193 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:55 SystemTime:2023-07-17 20:27:45.557527274 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 20:27:45.568391 1162193 kubeconfig.go:92] found "multinode-698783" server: "https://192.168.58.2:8443"
	I0717 20:27:45.568415 1162193 api_server.go:166] Checking apiserver status ...
	I0717 20:27:45.568459 1162193 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 20:27:45.582013 1162193 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/2159/cgroup
	I0717 20:27:45.593202 1162193 api_server.go:182] apiserver freezer: "7:freezer:/docker/145252c1d2202af63add5d8e61e43a0fc8bc5a8592399426226348f68d8d5a1b/kubepods/burstable/podf2cc3fac62051f66c1896baac5c8f4cc/6613283283de72df11f51edb6804c21a63b6b59e595b572c9618f8d8561f0a1f"
	I0717 20:27:45.593275 1162193 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/145252c1d2202af63add5d8e61e43a0fc8bc5a8592399426226348f68d8d5a1b/kubepods/burstable/podf2cc3fac62051f66c1896baac5c8f4cc/6613283283de72df11f51edb6804c21a63b6b59e595b572c9618f8d8561f0a1f/freezer.state
	I0717 20:27:45.603851 1162193 api_server.go:204] freezer state: "THAWED"
	I0717 20:27:45.603879 1162193 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0717 20:27:45.612839 1162193 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0717 20:27:45.612866 1162193 status.go:421] multinode-698783 apiserver status = Running (err=<nil>)
	I0717 20:27:45.612877 1162193 status.go:257] multinode-698783 status: &{Name:multinode-698783 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 20:27:45.612893 1162193 status.go:255] checking status of multinode-698783-m02 ...
	I0717 20:27:45.613197 1162193 cli_runner.go:164] Run: docker container inspect multinode-698783-m02 --format={{.State.Status}}
	I0717 20:27:45.630412 1162193 status.go:330] multinode-698783-m02 host status = "Running" (err=<nil>)
	I0717 20:27:45.630441 1162193 host.go:66] Checking if "multinode-698783-m02" exists ...
	I0717 20:27:45.630734 1162193 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-698783-m02
	I0717 20:27:45.648030 1162193 host.go:66] Checking if "multinode-698783-m02" exists ...
	I0717 20:27:45.648335 1162193 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 20:27:45.648385 1162193 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-698783-m02
	I0717 20:27:45.667064 1162193 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34080 SSHKeyPath:/home/jenkins/minikube-integration/16890-1049210/.minikube/machines/multinode-698783-m02/id_rsa Username:docker}
	I0717 20:27:45.757833 1162193 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 20:27:45.771965 1162193 status.go:257] multinode-698783-m02 status: &{Name:multinode-698783-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0717 20:27:45.771999 1162193 status.go:255] checking status of multinode-698783-m03 ...
	I0717 20:27:45.772303 1162193 cli_runner.go:164] Run: docker container inspect multinode-698783-m03 --format={{.State.Status}}
	I0717 20:27:45.792374 1162193 status.go:330] multinode-698783-m03 host status = "Stopped" (err=<nil>)
	I0717 20:27:45.792396 1162193 status.go:343] host is not running, skipping remaining checks
	I0717 20:27:45.792403 1162193 status.go:257] multinode-698783-m03 status: &{Name:multinode-698783-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.37s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (13.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Done: out/minikube-linux-arm64 -p multinode-698783 node start m03 --alsologtostderr: (12.932682179s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (13.79s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (126.71s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-698783
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-698783
E0717 20:28:03.949973 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
multinode_test.go:290: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-698783: (22.614776931s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-698783 --wait=true -v=8 --alsologtostderr
E0717 20:28:31.631966 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:28:58.668427 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:29:23.286744 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-arm64 start -p multinode-698783 --wait=true -v=8 --alsologtostderr: (1m43.970195762s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-698783
--- PASS: TestMultiNode/serial/RestartKeepsNodes (126.71s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 node delete m03
multinode_test.go:394: (dbg) Done: out/minikube-linux-arm64 -p multinode-698783 node delete m03: (4.337068128s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.10s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (21.87s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 stop
E0717 20:30:21.712059 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
multinode_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p multinode-698783 stop: (21.680113902s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-698783 status: exit status 7 (97.951703ms)

                                                
                                                
-- stdout --
	multinode-698783
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-698783-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-698783 status --alsologtostderr: exit status 7 (90.371792ms)

                                                
                                                
-- stdout --
	multinode-698783
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-698783-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 20:30:33.224148 1178029 out.go:296] Setting OutFile to fd 1 ...
	I0717 20:30:33.224365 1178029 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:30:33.224394 1178029 out.go:309] Setting ErrFile to fd 2...
	I0717 20:30:33.224415 1178029 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 20:30:33.224706 1178029 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16890-1049210/.minikube/bin
	I0717 20:30:33.224982 1178029 out.go:303] Setting JSON to false
	I0717 20:30:33.225089 1178029 mustload.go:65] Loading cluster: multinode-698783
	I0717 20:30:33.225168 1178029 notify.go:220] Checking for updates...
	I0717 20:30:33.225524 1178029 config.go:182] Loaded profile config "multinode-698783": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0717 20:30:33.225559 1178029 status.go:255] checking status of multinode-698783 ...
	I0717 20:30:33.226063 1178029 cli_runner.go:164] Run: docker container inspect multinode-698783 --format={{.State.Status}}
	I0717 20:30:33.244960 1178029 status.go:330] multinode-698783 host status = "Stopped" (err=<nil>)
	I0717 20:30:33.244981 1178029 status.go:343] host is not running, skipping remaining checks
	I0717 20:30:33.244987 1178029 status.go:257] multinode-698783 status: &{Name:multinode-698783 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 20:30:33.245009 1178029 status.go:255] checking status of multinode-698783-m02 ...
	I0717 20:30:33.245302 1178029 cli_runner.go:164] Run: docker container inspect multinode-698783-m02 --format={{.State.Status}}
	I0717 20:30:33.265183 1178029 status.go:330] multinode-698783-m02 host status = "Stopped" (err=<nil>)
	I0717 20:30:33.265202 1178029 status.go:343] host is not running, skipping remaining checks
	I0717 20:30:33.265208 1178029 status.go:257] multinode-698783-m02 status: &{Name:multinode-698783-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (21.87s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (82.6s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-698783 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
multinode_test.go:354: (dbg) Done: out/minikube-linux-arm64 start -p multinode-698783 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m21.750234051s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-arm64 -p multinode-698783 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (82.60s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (35.45s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-698783
multinode_test.go:452: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-698783-m02 --driver=docker  --container-runtime=docker
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-698783-m02 --driver=docker  --container-runtime=docker: exit status 14 (79.538652ms)

                                                
                                                
-- stdout --
	* [multinode-698783-m02] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16890
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-698783-m02' is duplicated with machine name 'multinode-698783-m02' in profile 'multinode-698783'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-698783-m03 --driver=docker  --container-runtime=docker
multinode_test.go:460: (dbg) Done: out/minikube-linux-arm64 start -p multinode-698783-m03 --driver=docker  --container-runtime=docker: (33.234825071s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-698783
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-698783: exit status 80 (329.877987ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-698783
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-698783-m03 already exists in multinode-698783-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-698783-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-698783-m03: (1.755049567s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (35.45s)

                                                
                                    
x
+
TestPreload (153.47s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-958573 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4
E0717 20:33:03.949795 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-958573 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4: (1m21.488263156s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-958573 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-958573 image pull gcr.io/k8s-minikube/busybox: (1.474165469s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-958573
E0717 20:33:58.669355 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-958573: (10.894471953s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-958573 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker
E0717 20:34:23.286711 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-958573 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker: (57.21048392s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-958573 image list
helpers_test.go:175: Cleaning up "test-preload-958573" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-958573
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-958573: (2.181232947s)
--- PASS: TestPreload (153.47s)

                                                
                                    
x
+
TestScheduledStopUnix (106.53s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-305753 --memory=2048 --driver=docker  --container-runtime=docker
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-305753 --memory=2048 --driver=docker  --container-runtime=docker: (33.16643352s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-305753 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-305753 -n scheduled-stop-305753
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-305753 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-305753 --cancel-scheduled
E0717 20:35:46.331094 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-305753 -n scheduled-stop-305753
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-305753
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-305753 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-305753
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-305753: exit status 7 (69.313649ms)

                                                
                                                
-- stdout --
	scheduled-stop-305753
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-305753 -n scheduled-stop-305753
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-305753 -n scheduled-stop-305753: exit status 7 (68.879458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-305753" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-305753
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-305753: (1.682905114s)
--- PASS: TestScheduledStopUnix (106.53s)

                                                
                                    
x
+
TestSkaffold (110.68s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /tmp/skaffold.exe2661140344 version
skaffold_test.go:63: skaffold version: v2.6.0
skaffold_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p skaffold-478983 --memory=2600 --driver=docker  --container-runtime=docker
skaffold_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p skaffold-478983 --memory=2600 --driver=docker  --container-runtime=docker: (32.948569344s)
skaffold_test.go:86: copying out/minikube-linux-arm64 to /home/jenkins/workspace/Docker_Linux_docker_arm64/out/minikube
skaffold_test.go:105: (dbg) Run:  /tmp/skaffold.exe2661140344 run --minikube-profile skaffold-478983 --kube-context skaffold-478983 --status-check=true --port-forward=false --interactive=false
E0717 20:38:03.949869 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
skaffold_test.go:105: (dbg) Done: /tmp/skaffold.exe2661140344 run --minikube-profile skaffold-478983 --kube-context skaffold-478983 --status-check=true --port-forward=false --interactive=false: (1m2.915921591s)
skaffold_test.go:111: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-app" in namespace "default" ...
helpers_test.go:344: "leeroy-app-5989797dfd-bgbg9" [78ed9254-a1cb-4e0b-a0ea-8e95d0fe4772] Running
skaffold_test.go:111: (dbg) TestSkaffold: app=leeroy-app healthy within 5.025237105s
skaffold_test.go:114: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-web" in namespace "default" ...
helpers_test.go:344: "leeroy-web-c6bc67798-4684m" [f70eec43-94de-4cc5-9b3d-500c2d6a9ee1] Running
skaffold_test.go:114: (dbg) TestSkaffold: app=leeroy-web healthy within 5.007164108s
helpers_test.go:175: Cleaning up "skaffold-478983" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p skaffold-478983
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p skaffold-478983: (2.949177462s)
--- PASS: TestSkaffold (110.68s)

                                                
                                    
x
+
TestInsufficientStorage (10.97s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-174646 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-174646 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker: exit status 26 (8.586741164s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"4dc94c50-3f03-4f12-bac9-52002a193377","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-174646] minikube v1.30.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"297f00ee-f718-4250-abd4-aae6ee05eedf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16890"}}
	{"specversion":"1.0","id":"9382f95b-10eb-4286-aaa7-cb9c2d9eab3c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"34ac276d-1bbb-4d34-9095-6e1c66c9a94b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig"}}
	{"specversion":"1.0","id":"e182b752-7b13-4da2-b224-0d4d59f859f9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube"}}
	{"specversion":"1.0","id":"20c85a65-8596-4e8c-bbf1-b86d47b1562f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"12364d19-41fc-4841-86f9-262d2d3d1188","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"9bc6a250-cdfa-4846-b04b-cf8b897ed0bc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"4b29e26f-c58c-4d07-b6ab-c6c761083e6f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"9667409d-21e8-4def-b67e-ca7ab9382457","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"5d457634-7db7-42ae-bd91-81a9796a044f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"a86078a9-d1d7-4d80-8795-b44d75a5500d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-174646 in cluster insufficient-storage-174646","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"71fdfeef-aec2-4008-b9ad-bf08b9254f75","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"7b3213fc-c6ae-437d-bb52-d202be13d8b5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"eb2fdc2e-195c-4e79-b41f-03c74a0dfed1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-174646 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-174646 --output=json --layout=cluster: exit status 7 (321.83374ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-174646","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.30.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-174646","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0717 20:38:54.839169 1214884 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-174646" does not appear in /home/jenkins/minikube-integration/16890-1049210/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-174646 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-174646 --output=json --layout=cluster: exit status 7 (344.119611ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-174646","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.30.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-174646","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0717 20:38:55.188322 1214940 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-174646" does not appear in /home/jenkins/minikube-integration/16890-1049210/kubeconfig
	E0717 20:38:55.200875 1214940 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/insufficient-storage-174646/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-174646" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-174646
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-174646: (1.715804552s)
--- PASS: TestInsufficientStorage (10.97s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (160.45s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
E0717 20:47:01.712597 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.17.0.3608955006.exe start -p running-upgrade-986441 --memory=2200 --vm-driver=docker  --container-runtime=docker
E0717 20:48:03.950120 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
version_upgrade_test.go:132: (dbg) Done: /tmp/minikube-v1.17.0.3608955006.exe start -p running-upgrade-986441 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m11.468150642s)
version_upgrade_test.go:142: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-986441 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:142: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-986441 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m25.522604184s)
helpers_test.go:175: Cleaning up "running-upgrade-986441" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-986441
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-986441: (2.373407807s)
--- PASS: TestRunningBinaryUpgrade (160.45s)

                                                
                                    
x
+
TestKubernetesUpgrade (207.88s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-347509 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0717 20:43:33.593166 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:34.234235 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:35.514977 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:38.075848 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:43.196478 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:53.436631 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:43:58.668573 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:44:13.917777 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:44:23.286631 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-347509 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m0.74630643s)
version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-347509
version_upgrade_test.go:239: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-347509: (10.905128684s)
version_upgrade_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-347509 status --format={{.Host}}
version_upgrade_test.go:244: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-347509 status --format={{.Host}}: exit status 7 (84.584174ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:246: status error: exit status 7 (may be ok)
version_upgrade_test.go:255: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-347509 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0717 20:44:54.878693 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
version_upgrade_test.go:255: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-347509 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m38.125397269s)
version_upgrade_test.go:260: (dbg) Run:  kubectl --context kubernetes-upgrade-347509 version --output=json
version_upgrade_test.go:279: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:281: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-347509 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker
version_upgrade_test.go:281: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-347509 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker: exit status 106 (116.514388ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-347509] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16890
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.27.3 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-347509
	    minikube start -p kubernetes-upgrade-347509 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-3475092 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.27.3, by running:
	    
	    minikube start -p kubernetes-upgrade-347509 --kubernetes-version=v1.27.3
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:285: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:287: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-347509 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:287: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-347509 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (34.594826436s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-347509" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-347509
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-347509: (3.166171937s)
--- PASS: TestKubernetesUpgrade (207.88s)

                                                
                                    
x
+
TestMissingContainerUpgrade (177.78s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:321: (dbg) Run:  /tmp/minikube-v1.17.0.2733649961.exe start -p missing-upgrade-249691 --memory=2200 --driver=docker  --container-runtime=docker
version_upgrade_test.go:321: (dbg) Done: /tmp/minikube-v1.17.0.2733649961.exe start -p missing-upgrade-249691 --memory=2200 --driver=docker  --container-runtime=docker: (1m43.227661772s)
version_upgrade_test.go:330: (dbg) Run:  docker stop missing-upgrade-249691
version_upgrade_test.go:330: (dbg) Done: docker stop missing-upgrade-249691: (1.535884133s)
version_upgrade_test.go:335: (dbg) Run:  docker rm missing-upgrade-249691
version_upgrade_test.go:341: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-249691 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0717 20:48:32.950946 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:48:58.669308 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:49:00.639540 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:49:23.286166 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
version_upgrade_test.go:341: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-249691 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m9.123734638s)
helpers_test.go:175: Cleaning up "missing-upgrade-249691" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-249691
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-249691: (2.716780543s)
--- PASS: TestMissingContainerUpgrade (177.78s)

                                                
                                    
x
+
TestPause/serial/Start (71.99s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-032932 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-032932 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker: (1m11.985495943s)
--- PASS: TestPause/serial/Start (71.99s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (40.1s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-032932 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-032932 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (40.069369715s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (40.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.11s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-691420 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-691420 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker: exit status 14 (114.106361ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-691420] minikube v1.30.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16890
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16890-1049210/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16890-1049210/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.11s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (42.69s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-691420 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-691420 --driver=docker  --container-runtime=docker: (42.027439097s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-691420 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (42.69s)

                                                
                                    
x
+
TestPause/serial/Pause (1.06s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-032932 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-032932 --alsologtostderr -v=5: (1.056888732s)
--- PASS: TestPause/serial/Pause (1.06s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.55s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-032932 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-032932 --output=json --layout=cluster: exit status 2 (552.549067ms)

                                                
                                                
-- stdout --
	{"Name":"pause-032932","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 14 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.30.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-032932","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.55s)

                                                
                                    
x
+
TestPause/serial/Unpause (1.13s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-032932 --alsologtostderr -v=5
pause_test.go:121: (dbg) Done: out/minikube-linux-arm64 unpause -p pause-032932 --alsologtostderr -v=5: (1.129972665s)
--- PASS: TestPause/serial/Unpause (1.13s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.12s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-032932 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-032932 --alsologtostderr -v=5: (1.121930257s)
--- PASS: TestPause/serial/PauseAgain (1.12s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (17.15s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-691420 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-691420 --no-kubernetes --driver=docker  --container-runtime=docker: (15.10833129s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-691420 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-691420 status -o json: exit status 2 (306.429606ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-691420","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-691420
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-691420: (1.738373013s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (17.15s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.39s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-032932 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-032932 --alsologtostderr -v=5: (2.385607917s)
--- PASS: TestPause/serial/DeletePaused (2.39s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (19.24s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:142: (dbg) Done: out/minikube-linux-arm64 profile list --output json: (19.167377882s)
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-032932
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-032932: exit status 1 (21.304563ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-032932: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (19.24s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (7.46s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-691420 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-691420 --no-kubernetes --driver=docker  --container-runtime=docker: (7.463285519s)
--- PASS: TestNoKubernetes/serial/Start (7.46s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.36s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-691420 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-691420 "sudo systemctl is-active --quiet service kubelet": exit status 1 (363.932271ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.36s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.74s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.74s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.28s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-691420
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-691420: (1.277350888s)
--- PASS: TestNoKubernetes/serial/Stop (1.28s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (9.3s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-691420 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-691420 --driver=docker  --container-runtime=docker: (9.304160806s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (9.30s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.39s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-691420 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-691420 "sudo systemctl is-active --quiet service kubelet": exit status 1 (386.012685ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.39s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.1s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.10s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (132.84s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:195: (dbg) Run:  /tmp/minikube-v1.17.0.2224308174.exe start -p stopped-upgrade-865925 --memory=2200 --vm-driver=docker  --container-runtime=docker
version_upgrade_test.go:195: (dbg) Done: /tmp/minikube-v1.17.0.2224308174.exe start -p stopped-upgrade-865925 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m22.380863926s)
version_upgrade_test.go:204: (dbg) Run:  /tmp/minikube-v1.17.0.2224308174.exe -p stopped-upgrade-865925 stop
version_upgrade_test.go:204: (dbg) Done: /tmp/minikube-v1.17.0.2224308174.exe -p stopped-upgrade-865925 stop: (11.140740743s)
version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-865925 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:210: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-865925 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (39.319819808s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (132.84s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (79s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker: (1m19.001110738s)
--- PASS: TestNetworkPlugins/group/auto/Start (79.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (10.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-w5ld8" [35a215b6-d364-4f02-a858-9dfe699f6f0e] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-w5ld8" [35a215b6-d364-4f02-a858-9dfe699f6f0e] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 10.007822466s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (10.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (76.09s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker: (1m16.094033794s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (76.09s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (2.37s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:218: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-865925
version_upgrade_test.go:218: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-865925: (2.37012622s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (2.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (84.78s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker
E0717 20:52:26.331353 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker: (1m24.783114363s)
--- PASS: TestNetworkPlugins/group/calico/Start (84.78s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-gg6k6" [a6dd0b07-bdf2-4189-b206-6b6592ee2d7c] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.031621883s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.49s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.49s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (10.55s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-mvwz9" [e51f5713-3959-4735-ba40-c9d7469a5bb4] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0717 20:53:03.950220 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-mvwz9" [e51f5713-3959-4735-ba40-c9d7469a5bb4] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 10.011550739s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (10.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-2fsjv" [97985ceb-687a-4e01-81e9-4fffd3b0710e] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.041298814s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (12.54s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-94ptv" [bbe9971a-b8ff-4832-873e-5779c12c2ac4] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-94ptv" [bbe9971a-b8ff-4832-873e-5779c12c2ac4] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 12.016481686s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (12.54s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (73.68s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker: (1m13.675880977s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (73.68s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (57.86s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p false-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker
E0717 20:53:58.668549 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 20:54:23.286325 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p false-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker: (57.858994664s)
--- PASS: TestNetworkPlugins/group/false/Start (57.86s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (12.62s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-g9sdw" [ad07548e-1174-47fd-804d-529d06d0f24f] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-g9sdw" [ad07548e-1174-47fd-804d-529d06d0f24f] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 12.016323853s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (12.62s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p false-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/false/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/NetCatPod (10.44s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context false-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-k4b7d" [7c237336-70de-4659-880c-cee395d62b67] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-k4b7d" [7c237336-70de-4659-880c-cee395d62b67] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: app=netcat healthy within 10.008517631s
--- PASS: TestNetworkPlugins/group/false/NetCatPod (10.44s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/DNS (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/DNS
net_test.go:175: (dbg) Run:  kubectl --context false-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/false/DNS (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Localhost
net_test.go:194: (dbg) Run:  kubectl --context false-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/false/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/HairPin
net_test.go:264: (dbg) Run:  kubectl --context false-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/false/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (97.65s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker: (1m37.645768372s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (97.65s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (73.62s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker
E0717 20:56:01.444345 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:01.449588 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:01.459832 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:01.480066 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:01.520305 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:01.600540 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:01.760805 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:02.081595 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:02.721794 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:04.002281 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:06.562484 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:06.994069 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:56:11.683191 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:21.924235 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:56:42.405326 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker: (1m13.616858929s)
--- PASS: TestNetworkPlugins/group/flannel/Start (73.62s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-pts22" [23c8e452-8150-45b6-8fdb-785c638cf040] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.026257275s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (10.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-4f8wv" [2641af87-8aa9-41c3-a57e-b7a3666cf1a2] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-4f8wv" [2641af87-8aa9-41c3-a57e-b7a3666cf1a2] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 10.007795429s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (10.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-h9dkj" [c31d8283-1094-4779-aba6-b1ae47d4ddd1] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-h9dkj" [c31d8283-1094-4779-aba6-b1ae47d4ddd1] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 10.008407537s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (93.54s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker: (1m33.536717206s)
--- PASS: TestNetworkPlugins/group/bridge/Start (93.54s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (70.71s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kubenet-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker
E0717 20:57:54.709057 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:54.714307 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:54.724575 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:54.744822 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:54.785073 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:54.865266 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:55.025610 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:55.346085 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:55.986297 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:57.267255 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:57:59.827672 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:58:03.949870 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 20:58:04.948589 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:58:11.325701 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:11.330969 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:11.341206 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:11.362068 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:11.402323 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:11.483209 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:11.643625 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:11.964112 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:12.605188 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:13.886196 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:15.189658 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:58:16.446404 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:21.566573 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:31.807079 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 20:58:32.950696 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:58:35.670772 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 20:58:45.286380 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 20:58:52.287530 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kubenet-895541 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker: (1m10.706888922s)
--- PASS: TestNetworkPlugins/group/kubenet/Start (70.71s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/KubeletFlags (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kubenet-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kubenet/KubeletFlags (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/NetCatPod (10.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kubenet-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-8xnq8" [76810342-0446-465e-98d7-872fc14578b5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0717 20:58:58.668518 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-8xnq8" [76810342-0446-465e-98d7-872fc14578b5] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: app=netcat healthy within 10.007143239s
--- PASS: TestNetworkPlugins/group/kubenet/NetCatPod (10.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-895541 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (11.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-895541 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-c95pl" [e6a481ef-6971-4db1-b749-2c96e68ff664] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-c95pl" [e6a481ef-6971-4db1-b749-2c96e68ff664] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 11.008614366s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (11.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/DNS (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kubenet-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kubenet/DNS (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Localhost (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kubenet-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kubenet/Localhost (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kubenet-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kubenet/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-895541 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-895541 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.29s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (142.91s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-332639 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E0717 20:59:33.247765 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-332639 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (2m22.90600364s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (142.91s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (80.29s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-934831 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0717 20:59:50.062546 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:50.068065 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:50.078326 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:50.098578 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:50.138827 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:50.219073 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:50.379416 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:50.700351 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:51.341323 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:52.621690 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:55.182682 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 20:59:56.000315 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 20:59:56.898436 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:56.903660 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:56.914308 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:56.934811 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:56.975691 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:57.056727 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:57.217118 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:57.539799 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:58.180116 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 20:59:59.460822 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 21:00:00.302894 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:00:02.021754 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 21:00:07.141919 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 21:00:10.543070 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:00:17.382239 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 21:00:31.024105 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:00:37.863194 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 21:00:38.551929 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 21:00:55.167983 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 21:01:01.444122 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-934831 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m20.291226466s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (80.29s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (10.52s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-934831 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [95e642e4-1505-4c3e-b94b-33f5abfa6b95] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [95e642e4-1505-4c3e-b94b-33f5abfa6b95] Running
E0717 21:01:11.984716 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 10.034232885s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-934831 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (10.52s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.22s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-934831 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-934831 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.068424859s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-934831 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.22s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (11.04s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-934831 --alsologtostderr -v=3
E0717 21:01:18.823986 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-934831 --alsologtostderr -v=3: (11.04146458s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (11.04s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-934831 -n no-preload-934831
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-934831 -n no-preload-934831: exit status 7 (70.233297ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-934831 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (345.09s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-934831 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0717 21:01:29.127326 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 21:01:49.661010 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:49.666245 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:49.676465 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:49.696768 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:49.737191 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:49.817429 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:49.977738 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:50.298127 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:50.939128 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:01:52.219323 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-934831 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m44.609815637s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-934831 -n no-preload-934831
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (345.09s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.51s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-332639 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [cb57ba3b-fba3-4934-a6b4-9a9309711140] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
E0717 21:01:54.779751 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
helpers_test.go:344: "busybox" [cb57ba3b-fba3-4934-a6b4-9a9309711140] Running
E0717 21:01:59.900764 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.052667229s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-332639 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.51s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-332639 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-332639 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (10.83s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-332639 --alsologtostderr -v=3
E0717 21:02:07.548910 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:07.554364 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:07.564608 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:07.584851 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:07.625126 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:07.705516 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:07.865930 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:08.186831 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:08.827758 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:10.108122 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:10.141320 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:02:12.669272 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-332639 --alsologtostderr -v=3: (10.832759162s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (10.83s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-332639 -n old-k8s-version-332639
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-332639 -n old-k8s-version-332639: exit status 7 (81.835969ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-332639 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (431.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-332639 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E0717 21:02:17.790107 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:28.030344 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:30.622121 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:02:33.905565 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:02:40.744325 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 21:02:48.510578 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:02:54.708626 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 21:03:03.950445 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 21:03:11.326311 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 21:03:11.582790 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:03:22.392080 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 21:03:29.471083 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:03:32.950227 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 21:03:39.008250 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 21:03:41.712855 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 21:03:56.275403 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:56.280677 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:56.290925 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:56.311298 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:56.351644 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:56.431907 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:56.592254 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:56.912804 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:57.553181 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:03:58.668761 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 21:03:58.833922 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:04:01.394789 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:04:04.497113 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:04.502382 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:04.512620 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:04.532931 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:04.573192 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:04.653505 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:04.813996 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:05.134825 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:05.775215 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:06.514987 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:04:07.056069 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:09.616484 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:14.737456 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:16.755216 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:04:23.286723 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 21:04:24.978251 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:33.503854 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:04:37.235427 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:04:45.459318 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:04:50.062260 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:04:51.391457 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:04:56.898188 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 21:05:17.745883 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:05:18.196442 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:05:24.584783 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
E0717 21:05:26.420230 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:06:01.444128 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 21:06:40.117454 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:06:48.340431 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:06:49.661143 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:07:07.548604 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-332639 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (7m10.623476978s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-332639 -n old-k8s-version-332639
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (431.08s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (11.03s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-25d55" [68c82e74-9e51-4582-ac4a-1800eed291c4] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-25d55" [68c82e74-9e51-4582-ac4a-1800eed291c4] Running
E0717 21:07:17.344923 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 11.024147861s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (11.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-25d55" [68c82e74-9e51-4582-ac4a-1800eed291c4] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.006896989s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-934831 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.43s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p no-preload-934831 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.43s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.21s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-934831 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-934831 -n no-preload-934831
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-934831 -n no-preload-934831: exit status 2 (353.889557ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-934831 -n no-preload-934831
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-934831 -n no-preload-934831: exit status 2 (360.821636ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-934831 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-934831 -n no-preload-934831
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-934831 -n no-preload-934831
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (69.08s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-619492 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0717 21:07:35.232447 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:07:54.708567 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 21:08:03.949861 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 21:08:11.325872 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 21:08:32.950352 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-619492 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m9.084104147s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (69.08s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (8.47s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-619492 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [07296107-ddb5-46fa-ba2a-b99781d84c57] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [07296107-ddb5-46fa-ba2a-b99781d84c57] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.035279332s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-619492 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (8.47s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.23s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-619492 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-619492 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.120254258s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-619492 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.23s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (10.96s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-619492 --alsologtostderr -v=3
E0717 21:08:56.275775 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:08:58.669038 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-619492 --alsologtostderr -v=3: (10.955806615s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (10.96s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-619492 -n embed-certs-619492
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-619492 -n embed-certs-619492: exit status 7 (94.0371ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-619492 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.22s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (360.15s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-619492 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0717 21:09:04.498573 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:09:06.331883 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 21:09:23.286985 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 21:09:23.957921 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-619492 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m59.624927167s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-619492 -n embed-certs-619492
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (360.15s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-ppdgt" [32b113dd-86fe-45d7-a9cc-c31dbef1667f] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.027828874s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.12s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-ppdgt" [32b113dd-86fe-45d7-a9cc-c31dbef1667f] Running
E0717 21:09:32.181131 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007029563s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-332639 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.12s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.45s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p old-k8s-version-332639 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.45s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.23s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-332639 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-332639 -n old-k8s-version-332639
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-332639 -n old-k8s-version-332639: exit status 2 (385.80239ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-332639 -n old-k8s-version-332639
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-332639 -n old-k8s-version-332639: exit status 2 (364.654111ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-332639 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-332639 -n old-k8s-version-332639
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-332639 -n old-k8s-version-332639
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (63.24s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-351852 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0717 21:09:50.062804 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:09:56.898453 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-351852 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m3.237350177s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (63.24s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.58s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-351852 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [333136bd-40c0-448c-a70c-e3585105b701] Pending
helpers_test.go:344: "busybox" [333136bd-40c0-448c-a70c-e3585105b701] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [333136bd-40c0-448c-a70c-e3585105b701] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 10.034410518s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-351852 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.58s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.25s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-351852 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-351852 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.123492231s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-351852 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.25s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (11.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-351852 --alsologtostderr -v=3
E0717 21:11:01.444447 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 21:11:03.552668 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:03.558208 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:03.568453 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:03.588703 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:03.628974 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:03.709324 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:03.869760 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:04.190395 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:04.830600 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:06.111105 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:08.672054 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-351852 --alsologtostderr -v=3: (11.107628955s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (11.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852: exit status 7 (75.752685ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-351852 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (358.68s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-351852 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0717 21:11:13.793162 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:24.034071 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:44.514791 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:11:49.661213 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:11:53.748944 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:53.754283 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:53.764582 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:53.784843 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:53.825103 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:53.905426 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:54.065883 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:54.386239 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:55.027195 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:56.307911 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:11:58.868058 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:12:03.988599 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:12:07.548914 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
E0717 21:12:14.228798 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:12:24.487972 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 21:12:25.475588 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:12:34.709954 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:12:46.994305 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 21:12:54.708686 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 21:13:03.950227 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/ingress-addon-legacy-845621/client.crt: no such file or directory
E0717 21:13:11.326372 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 21:13:15.670619 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:13:32.950580 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 21:13:47.396553 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:13:56.275032 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kubenet-895541/client.crt: no such file or directory
E0717 21:13:58.669097 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/addons-282155/client.crt: no such file or directory
E0717 21:14:04.497870 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/bridge-895541/client.crt: no such file or directory
E0717 21:14:17.752569 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/kindnet-895541/client.crt: no such file or directory
E0717 21:14:23.286298 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/functional-964765/client.crt: no such file or directory
E0717 21:14:34.369177 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/calico-895541/client.crt: no such file or directory
E0717 21:14:37.591686 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
E0717 21:14:50.062091 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:14:56.898542 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-351852 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m57.867273423s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (358.68s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (7.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-mz5m4" [ade64c2f-c403-4f13-bdb4-95d3f61982c1] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-mz5m4" [ade64c2f-c403-4f13-bdb4-95d3f61982c1] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 7.026601434s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (7.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-mz5m4" [ade64c2f-c403-4f13-bdb4-95d3f61982c1] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.011756963s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-619492 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.37s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p embed-certs-619492 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.37s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-619492 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-619492 -n embed-certs-619492
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-619492 -n embed-certs-619492: exit status 2 (359.780453ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-619492 -n embed-certs-619492
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-619492 -n embed-certs-619492: exit status 2 (366.206434ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-619492 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-619492 -n embed-certs-619492
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-619492 -n embed-certs-619492
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.19s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (46.66s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-283440 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0717 21:16:01.443826 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/auto-895541/client.crt: no such file or directory
E0717 21:16:03.552974 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-283440 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (46.66409577s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (46.66s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.84s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-283440 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-283440 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.840155418s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.84s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (11.4s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-283440 --alsologtostderr -v=3
E0717 21:16:13.106487 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/custom-flannel-895541/client.crt: no such file or directory
E0717 21:16:19.945446 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/false-895541/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-283440 --alsologtostderr -v=3: (11.404604023s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (11.40s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.27s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-283440 -n newest-cni-283440
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-283440 -n newest-cni-283440: exit status 7 (100.875846ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-283440 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.27s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (45.64s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-283440 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0717 21:16:31.237646 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/no-preload-934831/client.crt: no such file or directory
E0717 21:16:36.001549 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/skaffold-478983/client.crt: no such file or directory
E0717 21:16:49.660872 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/flannel-895541/client.crt: no such file or directory
E0717 21:16:53.749329 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-283440 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (44.482780833s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-283440 -n newest-cni-283440
E0717 21:17:07.547987 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/enable-default-cni-895541/client.crt: no such file or directory
start_stop_delete_test.go:262: (dbg) Done: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-283440 -n newest-cni-283440: (1.152991355s)
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (45.64s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (16.03s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-pk5rg" [c3b95c42-fecd-43b8-932b-73ea1169f503] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-pk5rg" [c3b95c42-fecd-43b8-932b-73ea1169f503] Running
E0717 21:17:21.432704 1054561 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16890-1049210/.minikube/profiles/old-k8s-version-332639/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 16.02736044s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (16.03s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.94s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p newest-cni-283440 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.94s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (5.38s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-283440 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p newest-cni-283440 --alsologtostderr -v=1: (1.308059814s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-283440 -n newest-cni-283440
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-283440 -n newest-cni-283440: exit status 2 (610.679744ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-283440 -n newest-cni-283440
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-283440 -n newest-cni-283440: exit status 2 (627.1516ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-283440 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p newest-cni-283440 --alsologtostderr -v=1: (1.339658025s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-283440 -n newest-cni-283440
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-283440 -n newest-cni-283440
--- PASS: TestStartStop/group/newest-cni/serial/Pause (5.38s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-pk5rg" [c3b95c42-fecd-43b8-932b-73ea1169f503] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007013088s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-351852 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.36s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p default-k8s-diff-port-351852 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.36s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.14s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-351852 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852: exit status 2 (346.947425ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852: exit status 2 (347.821106ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-351852 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-351852 -n default-k8s-diff-port-351852
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.14s)

                                                
                                    

Test skip (24/319)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.27.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.27.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.27.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.55s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-123883 --alsologtostderr --driver=docker  --container-runtime=docker
aaa_download_only_test.go:234: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-123883" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-123883
--- SKIP: TestDownloadOnlyKic (0.55s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:420: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:474: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker true linux arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild/serial/validateImageBuildWithBuildEnv (0s)

                                                
                                                
=== RUN   TestImageBuild/serial/validateImageBuildWithBuildEnv
image_test.go:114: skipping due to https://github.com/kubernetes/minikube/issues/12431
--- SKIP: TestImageBuild/serial/validateImageBuildWithBuildEnv (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (4.97s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:522: 
----------------------- debugLogs start: cilium-895541 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-895541" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-895541

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-895541" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-895541"

                                                
                                                
----------------------- debugLogs end: cilium-895541 [took: 4.744648243s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-895541" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-895541
--- SKIP: TestNetworkPlugins/group/cilium (4.97s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-116064" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-116064
--- SKIP: TestStartStop/group/disable-driver-mounts (0.18s)

                                                
                                    
Copied to clipboard