Test Report: Docker_Linux_docker_arm64 17585

                    
                      ea770f64c27c5646b2ec1dfcd286218478f671de:2023-11-08:31788
                    
                

Test fail (3/323)

Order failed test Duration
28 TestAddons/parallel/Ingress 39.25
107 TestFunctional/parallel/License 0.3
167 TestIngressAddonLegacy/serial/ValidateIngressAddons 52.64
x
+
TestAddons/parallel/Ingress (39.25s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:206: (dbg) Run:  kubectl --context addons-705389 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:231: (dbg) Run:  kubectl --context addons-705389 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:244: (dbg) Run:  kubectl --context addons-705389 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:249: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [26d9e66c-776e-4a72-ad1e-d94afba64761] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [26d9e66c-776e-4a72-ad1e-d94afba64761] Running
addons_test.go:249: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 10.014229822s
addons_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:285: (dbg) Run:  kubectl --context addons-705389 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 ip
addons_test.go:296: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:296: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.0517147s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:298: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:302: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:305: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:305: (dbg) Done: out/minikube-linux-arm64 -p addons-705389 addons disable ingress-dns --alsologtostderr -v=1: (1.119781103s)
addons_test.go:310: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 addons disable ingress --alsologtostderr -v=1
addons_test.go:310: (dbg) Done: out/minikube-linux-arm64 -p addons-705389 addons disable ingress --alsologtostderr -v=1: (7.771449771s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-705389
helpers_test.go:235: (dbg) docker inspect addons-705389:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "ca7ea7a107cd2c9aa0330bb3a3da99412ee2d4fd90ce9d98b325311d9844f588",
	        "Created": "2023-11-07T23:02:01.298753646Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 8518,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-11-07T23:02:01.70148988Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:62753ecb37c4e3c5bf7b6c8d02fe88b543f553e92492fca245cded98b0d364dd",
	        "ResolvConfPath": "/var/lib/docker/containers/ca7ea7a107cd2c9aa0330bb3a3da99412ee2d4fd90ce9d98b325311d9844f588/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/ca7ea7a107cd2c9aa0330bb3a3da99412ee2d4fd90ce9d98b325311d9844f588/hostname",
	        "HostsPath": "/var/lib/docker/containers/ca7ea7a107cd2c9aa0330bb3a3da99412ee2d4fd90ce9d98b325311d9844f588/hosts",
	        "LogPath": "/var/lib/docker/containers/ca7ea7a107cd2c9aa0330bb3a3da99412ee2d4fd90ce9d98b325311d9844f588/ca7ea7a107cd2c9aa0330bb3a3da99412ee2d4fd90ce9d98b325311d9844f588-json.log",
	        "Name": "/addons-705389",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-705389:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-705389",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/066ce93ffbb3b0d1a1905884dbf52bfe03ef9677f0c0c7c718784898a946afe4-init/diff:/var/lib/docker/overlay2/def196dc8a3d27299244ed5014f1d879dfc5c896a504644a641cada3a411b821/diff",
	                "MergedDir": "/var/lib/docker/overlay2/066ce93ffbb3b0d1a1905884dbf52bfe03ef9677f0c0c7c718784898a946afe4/merged",
	                "UpperDir": "/var/lib/docker/overlay2/066ce93ffbb3b0d1a1905884dbf52bfe03ef9677f0c0c7c718784898a946afe4/diff",
	                "WorkDir": "/var/lib/docker/overlay2/066ce93ffbb3b0d1a1905884dbf52bfe03ef9677f0c0c7c718784898a946afe4/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-705389",
	                "Source": "/var/lib/docker/volumes/addons-705389/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-705389",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-705389",
	                "name.minikube.sigs.k8s.io": "addons-705389",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "134b0484d5f5de458b72ea512d7fb2ce8a78a839fc31d32e5dea37f8d822b930",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32772"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32771"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32768"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32770"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32769"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/134b0484d5f5",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-705389": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "ca7ea7a107cd",
	                        "addons-705389"
	                    ],
	                    "NetworkID": "59313438b91a268b76dacf37617a90ba72dc8bb6171809d76dbb2d4850ca39d4",
	                    "EndpointID": "d9bca686477389e3b7b4b7f8bbcad767e658ecb39cf7341abbdd0f1840b334b4",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-705389 -n addons-705389
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-705389 logs -n 25: (1.489892435s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| delete  | --all                                                                                       | minikube               | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC | 07 Nov 23 23:01 UTC |
	| delete  | -p download-only-729698                                                                     | download-only-729698   | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC | 07 Nov 23 23:01 UTC |
	| delete  | -p download-only-729698                                                                     | download-only-729698   | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC | 07 Nov 23 23:01 UTC |
	| start   | --download-only -p                                                                          | download-docker-949347 | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC |                     |
	|         | download-docker-949347                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=docker                                                                  |                        |         |         |                     |                     |
	| delete  | -p download-docker-949347                                                                   | download-docker-949347 | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC | 07 Nov 23 23:01 UTC |
	| start   | --download-only -p                                                                          | binary-mirror-431297   | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC |                     |
	|         | binary-mirror-431297                                                                        |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                        |         |         |                     |                     |
	|         | http://127.0.0.1:39335                                                                      |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=docker                                                                  |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-431297                                                                     | binary-mirror-431297   | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC | 07 Nov 23 23:01 UTC |
	| addons  | enable dashboard -p                                                                         | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC |                     |
	|         | addons-705389                                                                               |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC |                     |
	|         | addons-705389                                                                               |                        |         |         |                     |                     |
	| start   | -p addons-705389 --wait=true                                                                | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC | 07 Nov 23 23:04 UTC |
	|         | --memory=4000 --alsologtostderr                                                             |                        |         |         |                     |                     |
	|         | --addons=registry                                                                           |                        |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=docker                                                                  |                        |         |         |                     |                     |
	|         | --addons=ingress                                                                            |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                        |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:04 UTC | 07 Nov 23 23:04 UTC |
	|         | -p addons-705389                                                                            |                        |         |         |                     |                     |
	| ip      | addons-705389 ip                                                                            | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:04 UTC | 07 Nov 23 23:04 UTC |
	| addons  | addons-705389 addons disable                                                                | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:04 UTC | 07 Nov 23 23:04 UTC |
	|         | registry --alsologtostderr                                                                  |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| ssh     | addons-705389 ssh cat                                                                       | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:04 UTC | 07 Nov 23 23:04 UTC |
	|         | /opt/local-path-provisioner/pvc-855d3783-d5df-4f86-983d-e2cf8016b546_default_test-pvc/file1 |                        |         |         |                     |                     |
	| addons  | addons-705389 addons disable                                                                | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:04 UTC | 07 Nov 23 23:05 UTC |
	|         | storage-provisioner-rancher                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:04 UTC | 07 Nov 23 23:04 UTC |
	|         | addons-705389                                                                               |                        |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:04 UTC | 07 Nov 23 23:04 UTC |
	|         | -p addons-705389                                                                            |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:05 UTC | 07 Nov 23 23:05 UTC |
	|         | addons-705389                                                                               |                        |         |         |                     |                     |
	| addons  | addons-705389 addons                                                                        | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:05 UTC | 07 Nov 23 23:05 UTC |
	|         | disable csi-hostpath-driver                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | addons-705389 addons                                                                        | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:05 UTC | 07 Nov 23 23:05 UTC |
	|         | disable metrics-server                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | addons-705389 addons                                                                        | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:05 UTC | 07 Nov 23 23:05 UTC |
	|         | disable volumesnapshots                                                                     |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| ssh     | addons-705389 ssh curl -s                                                                   | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:05 UTC | 07 Nov 23 23:05 UTC |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                        |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                        |         |         |                     |                     |
	| ip      | addons-705389 ip                                                                            | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:05 UTC | 07 Nov 23 23:05 UTC |
	| addons  | addons-705389 addons disable                                                                | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:05 UTC | 07 Nov 23 23:05 UTC |
	|         | ingress-dns --alsologtostderr                                                               |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | addons-705389 addons disable                                                                | addons-705389          | jenkins | v1.32.0 | 07 Nov 23 23:05 UTC | 07 Nov 23 23:05 UTC |
	|         | ingress --alsologtostderr -v=1                                                              |                        |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/07 23:01:36
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.21.3 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1107 23:01:36.802368    8034 out.go:296] Setting OutFile to fd 1 ...
	I1107 23:01:36.802572    8034 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:01:36.802584    8034 out.go:309] Setting ErrFile to fd 2...
	I1107 23:01:36.802590    8034 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:01:36.802889    8034 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
	I1107 23:01:36.803339    8034 out.go:303] Setting JSON to false
	I1107 23:01:36.804112    8034 start.go:128] hostinfo: {"hostname":"ip-172-31-30-239","uptime":2433,"bootTime":1699395664,"procs":145,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1049-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I1107 23:01:36.804188    8034 start.go:138] virtualization:  
	I1107 23:01:36.809176    8034 out.go:177] * [addons-705389] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	I1107 23:01:36.811602    8034 out.go:177]   - MINIKUBE_LOCATION=17585
	I1107 23:01:36.811662    8034 notify.go:220] Checking for updates...
	I1107 23:01:36.815524    8034 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1107 23:01:36.817983    8034 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	I1107 23:01:36.820343    8034 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	I1107 23:01:36.822650    8034 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1107 23:01:36.824830    8034 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1107 23:01:36.826946    8034 driver.go:378] Setting default libvirt URI to qemu:///system
	I1107 23:01:36.851116    8034 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1107 23:01:36.851264    8034 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:01:36.937843    8034 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-11-07 23:01:36.927609641 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:01:36.937940    8034 docker.go:295] overlay module found
	I1107 23:01:36.940340    8034 out.go:177] * Using the docker driver based on user configuration
	I1107 23:01:36.942952    8034 start.go:298] selected driver: docker
	I1107 23:01:36.942979    8034 start.go:902] validating driver "docker" against <nil>
	I1107 23:01:36.942996    8034 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1107 23:01:36.943927    8034 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:01:37.031424    8034 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-11-07 23:01:37.008899261 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:01:37.031600    8034 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1107 23:01:37.031851    8034 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1107 23:01:37.034221    8034 out.go:177] * Using Docker driver with root privileges
	I1107 23:01:37.037440    8034 cni.go:84] Creating CNI manager for ""
	I1107 23:01:37.037527    8034 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1107 23:01:37.037545    8034 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1107 23:01:37.037557    8034 start_flags.go:323] config:
	{Name:addons-705389 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:addons-705389 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:
cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:01:37.040426    8034 out.go:177] * Starting control plane node addons-705389 in cluster addons-705389
	I1107 23:01:37.043124    8034 cache.go:121] Beginning downloading kic base image for docker with docker
	I1107 23:01:37.046315    8034 out.go:177] * Pulling base image ...
	I1107 23:01:37.048852    8034 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1107 23:01:37.048979    8034 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4
	I1107 23:01:37.049027    8034 cache.go:56] Caching tarball of preloaded images
	I1107 23:01:37.049004    8034 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local docker daemon
	I1107 23:01:37.049192    8034 preload.go:174] Found /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1107 23:01:37.049211    8034 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1107 23:01:37.049642    8034 profile.go:148] Saving config to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/config.json ...
	I1107 23:01:37.049714    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/config.json: {Name:mk68fb32a9320415a146fcb18b999beb72141d1b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:01:37.067382    8034 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 to local cache
	I1107 23:01:37.067483    8034 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local cache directory
	I1107 23:01:37.067507    8034 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local cache directory, skipping pull
	I1107 23:01:37.067516    8034 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 exists in cache, skipping pull
	I1107 23:01:37.067528    8034 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 as a tarball
	I1107 23:01:37.067534    8034 cache.go:162] Loading gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 from local cache
	I1107 23:01:53.491729    8034 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 from cached tarball
	I1107 23:01:53.491766    8034 cache.go:194] Successfully downloaded all kic artifacts
	I1107 23:01:53.491843    8034 start.go:365] acquiring machines lock for addons-705389: {Name:mk3c925c31f7a29b22ed8fd648b4f785e3d4d5ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1107 23:01:53.491969    8034 start.go:369] acquired machines lock for "addons-705389" in 90.364µs
	I1107 23:01:53.491998    8034 start.go:93] Provisioning new machine with config: &{Name:addons-705389 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:addons-705389 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServ
erIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custo
mQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1107 23:01:53.492101    8034 start.go:125] createHost starting for "" (driver="docker")
	I1107 23:01:53.494879    8034 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I1107 23:01:53.495139    8034 start.go:159] libmachine.API.Create for "addons-705389" (driver="docker")
	I1107 23:01:53.495174    8034 client.go:168] LocalClient.Create starting
	I1107 23:01:53.495292    8034 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem
	I1107 23:01:54.041601    8034 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem
	I1107 23:01:54.680939    8034 cli_runner.go:164] Run: docker network inspect addons-705389 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W1107 23:01:54.698767    8034 cli_runner.go:211] docker network inspect addons-705389 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I1107 23:01:54.698847    8034 network_create.go:281] running [docker network inspect addons-705389] to gather additional debugging logs...
	I1107 23:01:54.698867    8034 cli_runner.go:164] Run: docker network inspect addons-705389
	W1107 23:01:54.718611    8034 cli_runner.go:211] docker network inspect addons-705389 returned with exit code 1
	I1107 23:01:54.718653    8034 network_create.go:284] error running [docker network inspect addons-705389]: docker network inspect addons-705389: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-705389 not found
	I1107 23:01:54.718669    8034 network_create.go:286] output of [docker network inspect addons-705389]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-705389 not found
	
	** /stderr **
	I1107 23:01:54.718788    8034 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1107 23:01:54.737276    8034 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4002573320}
	I1107 23:01:54.737314    8034 network_create.go:124] attempt to create docker network addons-705389 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I1107 23:01:54.737373    8034 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-705389 addons-705389
	I1107 23:01:54.805659    8034 network_create.go:108] docker network addons-705389 192.168.49.0/24 created
	I1107 23:01:54.805693    8034 kic.go:121] calculated static IP "192.168.49.2" for the "addons-705389" container
	I1107 23:01:54.805767    8034 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I1107 23:01:54.823450    8034 cli_runner.go:164] Run: docker volume create addons-705389 --label name.minikube.sigs.k8s.io=addons-705389 --label created_by.minikube.sigs.k8s.io=true
	I1107 23:01:54.842878    8034 oci.go:103] Successfully created a docker volume addons-705389
	I1107 23:01:54.842975    8034 cli_runner.go:164] Run: docker run --rm --name addons-705389-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-705389 --entrypoint /usr/bin/test -v addons-705389:/var gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -d /var/lib
	I1107 23:01:57.120598    8034 cli_runner.go:217] Completed: docker run --rm --name addons-705389-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-705389 --entrypoint /usr/bin/test -v addons-705389:/var gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -d /var/lib: (2.277579896s)
	I1107 23:01:57.120630    8034 oci.go:107] Successfully prepared a docker volume addons-705389
	I1107 23:01:57.120661    8034 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1107 23:01:57.120680    8034 kic.go:194] Starting extracting preloaded images to volume ...
	I1107 23:01:57.120770    8034 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-705389:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir
	I1107 23:02:01.202836    8034 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-705389:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir: (4.08200174s)
	I1107 23:02:01.202869    8034 kic.go:203] duration metric: took 4.082187 seconds to extract preloaded images to volume
	W1107 23:02:01.203024    8034 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I1107 23:02:01.203146    8034 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I1107 23:02:01.281196    8034 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-705389 --name addons-705389 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-705389 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-705389 --network addons-705389 --ip 192.168.49.2 --volume addons-705389:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0
	I1107 23:02:01.722500    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Running}}
	I1107 23:02:01.742490    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:01.761896    8034 cli_runner.go:164] Run: docker exec addons-705389 stat /var/lib/dpkg/alternatives/iptables
	I1107 23:02:01.873230    8034 oci.go:144] the created container "addons-705389" has a running status.
	I1107 23:02:01.873256    8034 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa...
	I1107 23:02:02.593318    8034 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I1107 23:02:02.621965    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:02.648911    8034 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I1107 23:02:02.648931    8034 kic_runner.go:114] Args: [docker exec --privileged addons-705389 chown docker:docker /home/docker/.ssh/authorized_keys]
	I1107 23:02:02.736576    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:02.759440    8034 machine.go:88] provisioning docker machine ...
	I1107 23:02:02.759469    8034 ubuntu.go:169] provisioning hostname "addons-705389"
	I1107 23:02:02.759542    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:02.779744    8034 main.go:141] libmachine: Using SSH client type: native
	I1107 23:02:02.780200    8034 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I1107 23:02:02.780213    8034 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-705389 && echo "addons-705389" | sudo tee /etc/hostname
	I1107 23:02:02.950042    8034 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-705389
	
	I1107 23:02:02.950120    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:02.984496    8034 main.go:141] libmachine: Using SSH client type: native
	I1107 23:02:02.984932    8034 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I1107 23:02:02.984962    8034 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-705389' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-705389/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-705389' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1107 23:02:03.125823    8034 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1107 23:02:03.125847    8034 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17585-2228/.minikube CaCertPath:/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17585-2228/.minikube}
	I1107 23:02:03.125876    8034 ubuntu.go:177] setting up certificates
	I1107 23:02:03.125889    8034 provision.go:83] configureAuth start
	I1107 23:02:03.125951    8034 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-705389
	I1107 23:02:03.145323    8034 provision.go:138] copyHostCerts
	I1107 23:02:03.145435    8034 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17585-2228/.minikube/ca.pem (1082 bytes)
	I1107 23:02:03.145565    8034 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17585-2228/.minikube/cert.pem (1123 bytes)
	I1107 23:02:03.145631    8034 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17585-2228/.minikube/key.pem (1679 bytes)
	I1107 23:02:03.145683    8034 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17585-2228/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca-key.pem org=jenkins.addons-705389 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-705389]
	I1107 23:02:03.546382    8034 provision.go:172] copyRemoteCerts
	I1107 23:02:03.546452    8034 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1107 23:02:03.546502    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:03.564928    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:03.658629    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I1107 23:02:03.686343    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I1107 23:02:03.714148    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I1107 23:02:03.743197    8034 provision.go:86] duration metric: configureAuth took 617.295836ms
	I1107 23:02:03.743223    8034 ubuntu.go:193] setting minikube options for container-runtime
	I1107 23:02:03.743401    8034 config.go:182] Loaded profile config "addons-705389": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1107 23:02:03.743458    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:03.761968    8034 main.go:141] libmachine: Using SSH client type: native
	I1107 23:02:03.762362    8034 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I1107 23:02:03.762374    8034 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I1107 23:02:03.889444    8034 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I1107 23:02:03.889462    8034 ubuntu.go:71] root file system type: overlay
	I1107 23:02:03.889582    8034 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I1107 23:02:03.889648    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:03.908513    8034 main.go:141] libmachine: Using SSH client type: native
	I1107 23:02:03.908957    8034 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I1107 23:02:03.909045    8034 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I1107 23:02:04.048022    8034 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I1107 23:02:04.048119    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:04.067494    8034 main.go:141] libmachine: Using SSH client type: native
	I1107 23:02:04.067943    8034 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I1107 23:02:04.067969    8034 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I1107 23:02:04.847717    8034 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-10-26 09:06:20.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-11-07 23:02:04.039890544 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I1107 23:02:04.847806    8034 machine.go:91] provisioned docker machine in 2.088345996s
	I1107 23:02:04.847839    8034 client.go:171] LocalClient.Create took 11.352657606s
	I1107 23:02:04.847972    8034 start.go:167] duration metric: libmachine.API.Create for "addons-705389" took 11.352831072s
	I1107 23:02:04.848004    8034 start.go:300] post-start starting for "addons-705389" (driver="docker")
	I1107 23:02:04.848043    8034 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1107 23:02:04.848128    8034 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1107 23:02:04.848194    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:04.867641    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:04.963105    8034 ssh_runner.go:195] Run: cat /etc/os-release
	I1107 23:02:04.967286    8034 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I1107 23:02:04.967326    8034 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I1107 23:02:04.967341    8034 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I1107 23:02:04.967348    8034 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I1107 23:02:04.967359    8034 filesync.go:126] Scanning /home/jenkins/minikube-integration/17585-2228/.minikube/addons for local assets ...
	I1107 23:02:04.967430    8034 filesync.go:126] Scanning /home/jenkins/minikube-integration/17585-2228/.minikube/files for local assets ...
	I1107 23:02:04.967460    8034 start.go:303] post-start completed in 119.42172ms
	I1107 23:02:04.967765    8034 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-705389
	I1107 23:02:04.986501    8034 profile.go:148] Saving config to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/config.json ...
	I1107 23:02:04.986796    8034 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1107 23:02:04.986846    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:05.013897    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:05.107123    8034 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I1107 23:02:05.114059    8034 start.go:128] duration metric: createHost completed in 11.621939822s
	I1107 23:02:05.114083    8034 start.go:83] releasing machines lock for "addons-705389", held for 11.622101571s
	I1107 23:02:05.114161    8034 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-705389
	I1107 23:02:05.133110    8034 ssh_runner.go:195] Run: cat /version.json
	I1107 23:02:05.133173    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:05.133455    8034 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1107 23:02:05.133511    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:05.166047    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:05.166667    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:05.458418    8034 ssh_runner.go:195] Run: systemctl --version
	I1107 23:02:05.464006    8034 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I1107 23:02:05.469292    8034 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I1107 23:02:05.498467    8034 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I1107 23:02:05.498592    8034 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I1107 23:02:05.534131    8034 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I1107 23:02:05.534159    8034 start.go:472] detecting cgroup driver to use...
	I1107 23:02:05.534193    8034 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I1107 23:02:05.534309    8034 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1107 23:02:05.553731    8034 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I1107 23:02:05.565435    8034 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1107 23:02:05.577427    8034 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I1107 23:02:05.577501    8034 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1107 23:02:05.589690    8034 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1107 23:02:05.601811    8034 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1107 23:02:05.613595    8034 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1107 23:02:05.625238    8034 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1107 23:02:05.636206    8034 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1107 23:02:05.647809    8034 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1107 23:02:05.658480    8034 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1107 23:02:05.669008    8034 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1107 23:02:05.763257    8034 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1107 23:02:05.887674    8034 start.go:472] detecting cgroup driver to use...
	I1107 23:02:05.887730    8034 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I1107 23:02:05.887784    8034 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I1107 23:02:05.903227    8034 cruntime.go:279] skipping containerd shutdown because we are bound to it
	I1107 23:02:05.903320    8034 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1107 23:02:05.918338    8034 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1107 23:02:05.938947    8034 ssh_runner.go:195] Run: which cri-dockerd
	I1107 23:02:05.945202    8034 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I1107 23:02:05.955959    8034 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I1107 23:02:05.986873    8034 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I1107 23:02:06.110353    8034 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I1107 23:02:06.225398    8034 docker.go:560] configuring docker to use "cgroupfs" as cgroup driver...
	I1107 23:02:06.225519    8034 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I1107 23:02:06.248792    8034 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1107 23:02:06.368561    8034 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1107 23:02:06.655007    8034 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1107 23:02:06.753464    8034 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I1107 23:02:06.851707    8034 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1107 23:02:06.956700    8034 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1107 23:02:07.061770    8034 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I1107 23:02:07.078881    8034 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1107 23:02:07.178111    8034 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
	I1107 23:02:07.260777    8034 start.go:519] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I1107 23:02:07.260876    8034 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I1107 23:02:07.266067    8034 start.go:540] Will wait 60s for crictl version
	I1107 23:02:07.266132    8034 ssh_runner.go:195] Run: which crictl
	I1107 23:02:07.271553    8034 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I1107 23:02:07.327352    8034 start.go:556] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  24.0.7
	RuntimeApiVersion:  v1
	I1107 23:02:07.327441    8034 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1107 23:02:07.357343    8034 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1107 23:02:07.391555    8034 out.go:204] * Preparing Kubernetes v1.28.3 on Docker 24.0.7 ...
	I1107 23:02:07.391654    8034 cli_runner.go:164] Run: docker network inspect addons-705389 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1107 23:02:07.409107    8034 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I1107 23:02:07.413850    8034 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1107 23:02:07.427220    8034 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1107 23:02:07.427289    8034 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1107 23:02:07.449347    8034 docker.go:671] Got preloaded images: -- stdout --
	registry.k8s.io/kube-scheduler:v1.28.3
	registry.k8s.io/kube-apiserver:v1.28.3
	registry.k8s.io/kube-controller-manager:v1.28.3
	registry.k8s.io/kube-proxy:v1.28.3
	registry.k8s.io/etcd:3.5.9-0
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1107 23:02:07.449372    8034 docker.go:601] Images already preloaded, skipping extraction
	I1107 23:02:07.449443    8034 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1107 23:02:07.471515    8034 docker.go:671] Got preloaded images: -- stdout --
	registry.k8s.io/kube-controller-manager:v1.28.3
	registry.k8s.io/kube-scheduler:v1.28.3
	registry.k8s.io/kube-apiserver:v1.28.3
	registry.k8s.io/kube-proxy:v1.28.3
	registry.k8s.io/etcd:3.5.9-0
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1107 23:02:07.471551    8034 cache_images.go:84] Images are preloaded, skipping loading
	I1107 23:02:07.471615    8034 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I1107 23:02:07.532908    8034 cni.go:84] Creating CNI manager for ""
	I1107 23:02:07.532937    8034 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1107 23:02:07.532971    8034 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I1107 23:02:07.532992    8034 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.28.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-705389 NodeName:addons-705389 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I1107 23:02:07.533136    8034 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "addons-705389"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1107 23:02:07.533201    8034 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-705389 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.3 ClusterName:addons-705389 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I1107 23:02:07.533269    8034 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.3
	I1107 23:02:07.544257    8034 binaries.go:44] Found k8s binaries, skipping transfer
	I1107 23:02:07.544333    8034 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1107 23:02:07.555225    8034 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
	I1107 23:02:07.577008    8034 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I1107 23:02:07.597411    8034 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I1107 23:02:07.617669    8034 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I1107 23:02:07.622298    8034 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1107 23:02:07.635339    8034 certs.go:56] Setting up /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389 for IP: 192.168.49.2
	I1107 23:02:07.635371    8034 certs.go:190] acquiring lock for shared ca certs: {Name:mk9a3e4d35b7079db49eb191a7c695fba58dc729 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:07.635486    8034 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/17585-2228/.minikube/ca.key
	I1107 23:02:08.528265    8034 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt ...
	I1107 23:02:08.528300    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt: {Name:mk65ba241c2e344ad098f9cf11f262cfc43c6c9a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:08.528493    8034 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17585-2228/.minikube/ca.key ...
	I1107 23:02:08.528505    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/ca.key: {Name:mk69b82de164e99d39032a2239caa09afbdd8626 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:08.528587    8034 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.key
	I1107 23:02:08.751634    8034 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.crt ...
	I1107 23:02:08.751664    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.crt: {Name:mkdf9065dc329a526644bec2425c97094c4311b2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:08.751832    8034 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.key ...
	I1107 23:02:08.751844    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.key: {Name:mk45d71c8d41940f298dcaad6677bc2073869fe6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:08.751980    8034 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.key
	I1107 23:02:08.751997    8034 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt with IP's: []
	I1107 23:02:08.929798    8034 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt ...
	I1107 23:02:08.929829    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: {Name:mkbc77353f4541b1b5e5f21c0d1844f4d64003c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:08.930006    8034 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.key ...
	I1107 23:02:08.930018    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.key: {Name:mke4781b56a5951975985f48e8b06dc4965efe8b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:08.930094    8034 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.key.dd3b5fb2
	I1107 23:02:08.930114    8034 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I1107 23:02:09.426164    8034 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.crt.dd3b5fb2 ...
	I1107 23:02:09.426192    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.crt.dd3b5fb2: {Name:mkf6171fd4dd2308a3444775c6b121cd525c3113 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:09.426370    8034 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.key.dd3b5fb2 ...
	I1107 23:02:09.426382    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.key.dd3b5fb2: {Name:mk57199eea4ad7f8493db20d851601c760a0c9fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:09.426457    8034 certs.go:337] copying /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.crt
	I1107 23:02:09.426529    8034 certs.go:341] copying /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.key
	I1107 23:02:09.426579    8034 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/proxy-client.key
	I1107 23:02:09.426598    8034 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/proxy-client.crt with IP's: []
	I1107 23:02:10.093995    8034 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/proxy-client.crt ...
	I1107 23:02:10.094028    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/proxy-client.crt: {Name:mk6a353446178d82a435703094890b351d5bcf10 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:10.094231    8034 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/proxy-client.key ...
	I1107 23:02:10.094251    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/proxy-client.key: {Name:mk7fbcb97a878663e5634dedf37481fc97f60d35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:10.094457    8034 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca-key.pem (1679 bytes)
	I1107 23:02:10.094507    8034 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem (1082 bytes)
	I1107 23:02:10.094544    8034 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem (1123 bytes)
	I1107 23:02:10.094572    8034 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/key.pem (1679 bytes)
	I1107 23:02:10.095196    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I1107 23:02:10.128430    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I1107 23:02:10.158414    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1107 23:02:10.190080    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I1107 23:02:10.219749    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1107 23:02:10.248739    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I1107 23:02:10.277721    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1107 23:02:10.305583    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I1107 23:02:10.337903    8034 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1107 23:02:10.366969    8034 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I1107 23:02:10.387785    8034 ssh_runner.go:195] Run: openssl version
	I1107 23:02:10.394975    8034 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1107 23:02:10.406431    8034 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1107 23:02:10.411179    8034 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Nov  7 23:02 /usr/share/ca-certificates/minikubeCA.pem
	I1107 23:02:10.411249    8034 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1107 23:02:10.419993    8034 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1107 23:02:10.431463    8034 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I1107 23:02:10.435832    8034 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I1107 23:02:10.435894    8034 kubeadm.go:404] StartCluster: {Name:addons-705389 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:addons-705389 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clu
ster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:02:10.436017    8034 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1107 23:02:10.457056    8034 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1107 23:02:10.468033    8034 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1107 23:02:10.478858    8034 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I1107 23:02:10.478922    8034 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1107 23:02:10.489923    8034 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1107 23:02:10.489996    8034 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I1107 23:02:10.546005    8034 kubeadm.go:322] [init] Using Kubernetes version: v1.28.3
	I1107 23:02:10.546329    8034 kubeadm.go:322] [preflight] Running pre-flight checks
	I1107 23:02:10.607814    8034 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I1107 23:02:10.607900    8034 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1049-aws
	I1107 23:02:10.607934    8034 kubeadm.go:322] OS: Linux
	I1107 23:02:10.607980    8034 kubeadm.go:322] CGROUPS_CPU: enabled
	I1107 23:02:10.608030    8034 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I1107 23:02:10.608079    8034 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I1107 23:02:10.608128    8034 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I1107 23:02:10.608175    8034 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I1107 23:02:10.608250    8034 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I1107 23:02:10.608296    8034 kubeadm.go:322] CGROUPS_PIDS: enabled
	I1107 23:02:10.608345    8034 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I1107 23:02:10.608392    8034 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I1107 23:02:10.691071    8034 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1107 23:02:10.691245    8034 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1107 23:02:10.691374    8034 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1107 23:02:11.075275    8034 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1107 23:02:11.079773    8034 out.go:204]   - Generating certificates and keys ...
	I1107 23:02:11.080076    8034 kubeadm.go:322] [certs] Using existing ca certificate authority
	I1107 23:02:11.080223    8034 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I1107 23:02:11.621491    8034 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I1107 23:02:11.974783    8034 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I1107 23:02:12.171793    8034 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I1107 23:02:12.366491    8034 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I1107 23:02:12.753692    8034 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I1107 23:02:12.754055    8034 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-705389 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I1107 23:02:13.114591    8034 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I1107 23:02:13.114954    8034 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-705389 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I1107 23:02:13.571714    8034 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I1107 23:02:14.390398    8034 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I1107 23:02:14.727001    8034 kubeadm.go:322] [certs] Generating "sa" key and public key
	I1107 23:02:14.727332    8034 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1107 23:02:15.160713    8034 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1107 23:02:15.780779    8034 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1107 23:02:16.091405    8034 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1107 23:02:16.581785    8034 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1107 23:02:16.582481    8034 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1107 23:02:16.586816    8034 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1107 23:02:16.590041    8034 out.go:204]   - Booting up control plane ...
	I1107 23:02:16.590207    8034 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1107 23:02:16.590307    8034 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1107 23:02:16.590376    8034 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1107 23:02:16.605524    8034 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1107 23:02:16.606370    8034 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1107 23:02:16.606609    8034 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I1107 23:02:16.709824    8034 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1107 23:02:24.217766    8034 kubeadm.go:322] [apiclient] All control plane components are healthy after 7.508349 seconds
	I1107 23:02:24.217905    8034 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1107 23:02:24.237014    8034 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I1107 23:02:24.764970    8034 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I1107 23:02:24.765190    8034 kubeadm.go:322] [mark-control-plane] Marking the node addons-705389 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I1107 23:02:25.280477    8034 kubeadm.go:322] [bootstrap-token] Using token: 78ht3u.jf6rvvxbtb5ufh1p
	I1107 23:02:25.282868    8034 out.go:204]   - Configuring RBAC rules ...
	I1107 23:02:25.282995    8034 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1107 23:02:25.288567    8034 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1107 23:02:25.296829    8034 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1107 23:02:25.300771    8034 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1107 23:02:25.305267    8034 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1107 23:02:25.311290    8034 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1107 23:02:25.325110    8034 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1107 23:02:25.584087    8034 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I1107 23:02:25.693537    8034 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I1107 23:02:25.713759    8034 kubeadm.go:322] 
	I1107 23:02:25.713832    8034 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I1107 23:02:25.713838    8034 kubeadm.go:322] 
	I1107 23:02:25.713911    8034 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I1107 23:02:25.713916    8034 kubeadm.go:322] 
	I1107 23:02:25.713940    8034 kubeadm.go:322]   mkdir -p $HOME/.kube
	I1107 23:02:25.714569    8034 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1107 23:02:25.714625    8034 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1107 23:02:25.714630    8034 kubeadm.go:322] 
	I1107 23:02:25.714680    8034 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I1107 23:02:25.714685    8034 kubeadm.go:322] 
	I1107 23:02:25.714729    8034 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I1107 23:02:25.714734    8034 kubeadm.go:322] 
	I1107 23:02:25.714798    8034 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I1107 23:02:25.714869    8034 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1107 23:02:25.714933    8034 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1107 23:02:25.714938    8034 kubeadm.go:322] 
	I1107 23:02:25.715287    8034 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I1107 23:02:25.715365    8034 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I1107 23:02:25.715376    8034 kubeadm.go:322] 
	I1107 23:02:25.715714    8034 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 78ht3u.jf6rvvxbtb5ufh1p \
	I1107 23:02:25.715817    8034 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:5709f06d7c573117626cd7c3c456a905763e2bbcf0d8934c54d2ce325c654970 \
	I1107 23:02:25.716100    8034 kubeadm.go:322] 	--control-plane 
	I1107 23:02:25.716111    8034 kubeadm.go:322] 
	I1107 23:02:25.716420    8034 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I1107 23:02:25.716430    8034 kubeadm.go:322] 
	I1107 23:02:25.716754    8034 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 78ht3u.jf6rvvxbtb5ufh1p \
	I1107 23:02:25.717085    8034 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:5709f06d7c573117626cd7c3c456a905763e2bbcf0d8934c54d2ce325c654970 
	I1107 23:02:25.720833    8034 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1049-aws\n", err: exit status 1
	I1107 23:02:25.720961    8034 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1107 23:02:25.720986    8034 cni.go:84] Creating CNI manager for ""
	I1107 23:02:25.721004    8034 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1107 23:02:25.725527    8034 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I1107 23:02:25.728129    8034 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I1107 23:02:25.754579    8034 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
	I1107 23:02:25.792870    8034 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1107 23:02:25.793031    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:25.793125    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=693359050ae80510825facc3cb57aa024560c29e minikube.k8s.io/name=addons-705389 minikube.k8s.io/updated_at=2023_11_07T23_02_25_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:26.137491    8034 ops.go:34] apiserver oom_adj: -16
	I1107 23:02:26.137568    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:26.244346    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:26.860270    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:27.359950    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:27.860023    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:28.359848    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:28.859835    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:29.359582    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:29.860180    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:30.360440    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:30.860458    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:31.359765    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:31.860482    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:32.360087    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:32.860217    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:33.360093    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:33.859983    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:34.360503    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:34.859919    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:35.359553    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:35.860116    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:36.360271    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:36.859991    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:37.359576    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:37.860051    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:38.360432    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:38.859627    8034 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:02:38.991581    8034 kubeadm.go:1081] duration metric: took 13.19861207s to wait for elevateKubeSystemPrivileges.
	I1107 23:02:38.991611    8034 kubeadm.go:406] StartCluster complete in 28.555720999s
	I1107 23:02:38.991628    8034 settings.go:142] acquiring lock: {Name:mk04f69aac041878e83c593ab0ff1a4dc1e5fd90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:38.991736    8034 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17585-2228/kubeconfig
	I1107 23:02:38.992208    8034 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/kubeconfig: {Name:mkcb24add64bda4b558c43079a598eaa18708a06 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:02:38.992507    8034 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I1107 23:02:38.992800    8034 config.go:182] Loaded profile config "addons-705389": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1107 23:02:38.992843    8034 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true]
	I1107 23:02:38.992916    8034 addons.go:69] Setting volumesnapshots=true in profile "addons-705389"
	I1107 23:02:38.992950    8034 addons.go:231] Setting addon volumesnapshots=true in "addons-705389"
	I1107 23:02:38.993052    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:38.993624    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.000600    8034 addons.go:69] Setting cloud-spanner=true in profile "addons-705389"
	I1107 23:02:39.000650    8034 addons.go:231] Setting addon cloud-spanner=true in "addons-705389"
	I1107 23:02:39.000702    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.001217    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.004625    8034 addons.go:69] Setting metrics-server=true in profile "addons-705389"
	I1107 23:02:39.006941    8034 addons.go:231] Setting addon metrics-server=true in "addons-705389"
	I1107 23:02:39.007308    8034 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-705389"
	I1107 23:02:39.007336    8034 addons.go:231] Setting addon nvidia-device-plugin=true in "addons-705389"
	I1107 23:02:39.007383    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.011166    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.012065    8034 addons.go:69] Setting registry=true in profile "addons-705389"
	I1107 23:02:39.012102    8034 addons.go:231] Setting addon registry=true in "addons-705389"
	I1107 23:02:39.012151    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.012594    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.006787    8034 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-705389"
	I1107 23:02:39.035034    8034 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-705389"
	I1107 23:02:39.035098    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.035548    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.007387    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.043234    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.006804    8034 addons.go:69] Setting default-storageclass=true in profile "addons-705389"
	I1107 23:02:39.056315    8034 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-705389"
	I1107 23:02:39.006809    8034 addons.go:69] Setting gcp-auth=true in profile "addons-705389"
	I1107 23:02:39.056374    8034 mustload.go:65] Loading cluster: addons-705389
	I1107 23:02:39.006814    8034 addons.go:69] Setting ingress=true in profile "addons-705389"
	I1107 23:02:39.056476    8034 addons.go:231] Setting addon ingress=true in "addons-705389"
	I1107 23:02:39.006818    8034 addons.go:69] Setting ingress-dns=true in profile "addons-705389"
	I1107 23:02:39.056554    8034 addons.go:231] Setting addon ingress-dns=true in "addons-705389"
	I1107 23:02:39.006822    8034 addons.go:69] Setting inspektor-gadget=true in profile "addons-705389"
	I1107 23:02:39.056627    8034 addons.go:231] Setting addon inspektor-gadget=true in "addons-705389"
	I1107 23:02:39.028470    8034 addons.go:69] Setting storage-provisioner=true in profile "addons-705389"
	I1107 23:02:39.056708    8034 addons.go:231] Setting addon storage-provisioner=true in "addons-705389"
	I1107 23:02:39.028482    8034 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-705389"
	I1107 23:02:39.056783    8034 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-705389"
	I1107 23:02:39.057620    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.068388    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.068862    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.087951    8034 config.go:182] Loaded profile config "addons-705389": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1107 23:02:39.088311    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.113130    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.113584    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.114068    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.121155    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.123967    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.124624    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.161788    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.260455    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I1107 23:02:39.265220    8034 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I1107 23:02:39.265247    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I1107 23:02:39.265332    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.271859    8034 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-705389" context rescaled to 1 replicas
	I1107 23:02:39.271915    8034 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1107 23:02:39.286407    8034 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I1107 23:02:39.293092    8034 out.go:177]   - Using image docker.io/registry:2.8.3
	I1107 23:02:39.289859    8034 out.go:177] * Verifying Kubernetes components...
	I1107 23:02:39.289866    8034 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.11
	I1107 23:02:39.289870    8034 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.2
	I1107 23:02:39.293448    8034 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I1107 23:02:39.298757    8034 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I1107 23:02:39.296153    8034 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
	I1107 23:02:39.296163    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I1107 23:02:39.304821    8034 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I1107 23:02:39.304833    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I1107 23:02:39.311646    8034 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1107 23:02:39.311728    8034 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
	I1107 23:02:39.311771    8034 addons.go:423] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I1107 23:02:39.311778    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I1107 23:02:39.311818    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.342727    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I1107 23:02:39.318605    8034 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4
	I1107 23:02:39.318625    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I1107 23:02:39.318639    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I1107 23:02:39.318710    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.353256    8034 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.22.0
	I1107 23:02:39.356263    8034 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
	I1107 23:02:39.356284    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I1107 23:02:39.356350    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.383122    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I1107 23:02:39.385979    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I1107 23:02:39.389495    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I1107 23:02:39.386421    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.386480    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.386541    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.385860    8034 addons.go:231] Setting addon default-storageclass=true in "addons-705389"
	I1107 23:02:39.400712    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I1107 23:02:39.399195    8034 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I1107 23:02:39.400541    8034 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1107 23:02:39.400650    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.403634    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.403814    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I1107 23:02:39.403912    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.439928    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I1107 23:02:39.441953    8034 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I1107 23:02:39.448191    8034 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I1107 23:02:39.448214    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I1107 23:02:39.448279    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.462006    8034 addons.go:231] Setting addon storage-provisioner-rancher=true in "addons-705389"
	I1107 23:02:39.462054    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:39.462503    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:39.468465    8034 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1107 23:02:39.468485    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1107 23:02:39.468546    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.488834    8034 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.9.4
	I1107 23:02:39.467818    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.498377    8034 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1107 23:02:39.500531    8034 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1107 23:02:39.502812    8034 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I1107 23:02:39.502834    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16103 bytes)
	I1107 23:02:39.502900    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.545472    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.569830    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.623968    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.640785    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.662011    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.698752    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.705328    8034 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I1107 23:02:39.705468    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1107 23:02:39.705535    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.709383    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.718697    8034 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I1107 23:02:39.716892    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.724381    8034 out.go:177]   - Using image docker.io/busybox:stable
	I1107 23:02:39.730882    8034 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I1107 23:02:39.730905    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I1107 23:02:39.730967    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:39.742014    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.784892    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:39.790435    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:40.373726    8034 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I1107 23:02:40.373749    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I1107 23:02:40.454294    8034 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
	I1107 23:02:40.454320    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I1107 23:02:40.476223    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I1107 23:02:40.511038    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I1107 23:02:40.574047    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1107 23:02:40.647157    8034 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I1107 23:02:40.647229    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I1107 23:02:40.676184    8034 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I1107 23:02:40.676254    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I1107 23:02:40.698800    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I1107 23:02:40.701553    8034 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I1107 23:02:40.701622    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I1107 23:02:40.714853    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I1107 23:02:40.723801    8034 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I1107 23:02:40.723876    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I1107 23:02:40.797197    8034 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
	I1107 23:02:40.797266    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I1107 23:02:40.810052    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I1107 23:02:40.862074    8034 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I1107 23:02:40.862097    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I1107 23:02:40.879768    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1107 23:02:40.915536    8034 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
	I1107 23:02:40.915557    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I1107 23:02:40.944817    8034 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I1107 23:02:40.944889    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I1107 23:02:40.956687    8034 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I1107 23:02:40.956758    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I1107 23:02:41.151397    8034 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I1107 23:02:41.151470    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I1107 23:02:41.181520    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I1107 23:02:41.187411    8034 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I1107 23:02:41.187488    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I1107 23:02:41.307778    8034 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I1107 23:02:41.307849    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I1107 23:02:41.384362    8034 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I1107 23:02:41.384435    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I1107 23:02:41.441582    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I1107 23:02:41.562643    8034 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1107 23:02:41.562725    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I1107 23:02:41.637413    8034 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I1107 23:02:41.637485    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I1107 23:02:41.836387    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1107 23:02:41.838835    8034 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I1107 23:02:41.838902    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I1107 23:02:41.985527    8034 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I1107 23:02:41.985596    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I1107 23:02:42.112245    8034 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.816046943s)
	I1107 23:02:42.112417    8034 start.go:926] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I1107 23:02:42.112373    8034 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (2.794387519s)
	I1107 23:02:42.115759    8034 node_ready.go:35] waiting up to 6m0s for node "addons-705389" to be "Ready" ...
	I1107 23:02:42.125571    8034 node_ready.go:49] node "addons-705389" has status "Ready":"True"
	I1107 23:02:42.125658    8034 node_ready.go:38] duration metric: took 9.695872ms waiting for node "addons-705389" to be "Ready" ...
	I1107 23:02:42.125683    8034 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1107 23:02:42.136495    8034 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-4g56m" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:42.186726    8034 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I1107 23:02:42.186832    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I1107 23:02:42.244061    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (1.767757064s)
	I1107 23:02:42.467733    8034 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
	I1107 23:02:42.467807    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I1107 23:02:42.513277    8034 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I1107 23:02:42.513351    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I1107 23:02:42.659287    8034 pod_ready.go:92] pod "coredns-5dd5756b68-4g56m" in "kube-system" namespace has status "Ready":"True"
	I1107 23:02:42.659356    8034 pod_ready.go:81] duration metric: took 522.783652ms waiting for pod "coredns-5dd5756b68-4g56m" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:42.659382    8034 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-705389" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:42.665748    8034 pod_ready.go:92] pod "etcd-addons-705389" in "kube-system" namespace has status "Ready":"True"
	I1107 23:02:42.665815    8034 pod_ready.go:81] duration metric: took 6.414792ms waiting for pod "etcd-addons-705389" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:42.665841    8034 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-705389" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:42.672416    8034 pod_ready.go:92] pod "kube-apiserver-addons-705389" in "kube-system" namespace has status "Ready":"True"
	I1107 23:02:42.672439    8034 pod_ready.go:81] duration metric: took 6.576328ms waiting for pod "kube-apiserver-addons-705389" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:42.672450    8034 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-705389" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:42.701835    8034 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I1107 23:02:42.701903    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I1107 23:02:42.767631    8034 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I1107 23:02:42.767698    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I1107 23:02:42.916984    8034 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I1107 23:02:42.917003    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I1107 23:02:42.919441    8034 pod_ready.go:92] pod "kube-controller-manager-addons-705389" in "kube-system" namespace has status "Ready":"True"
	I1107 23:02:42.919459    8034 pod_ready.go:81] duration metric: took 247.000923ms waiting for pod "kube-controller-manager-addons-705389" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:42.919470    8034 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-cxb5l" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:43.074750    8034 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I1107 23:02:43.074823    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I1107 23:02:43.106857    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I1107 23:02:43.189025    8034 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I1107 23:02:43.189088    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I1107 23:02:43.320020    8034 pod_ready.go:92] pod "kube-proxy-cxb5l" in "kube-system" namespace has status "Ready":"True"
	I1107 23:02:43.320091    8034 pod_ready.go:81] duration metric: took 400.613034ms waiting for pod "kube-proxy-cxb5l" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:43.320116    8034 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-705389" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:43.511266    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I1107 23:02:43.696957    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.185839615s)
	I1107 23:02:43.696899    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.12276771s)
	I1107 23:02:43.720224    8034 pod_ready.go:92] pod "kube-scheduler-addons-705389" in "kube-system" namespace has status "Ready":"True"
	I1107 23:02:43.720292    8034 pod_ready.go:81] duration metric: took 400.154749ms waiting for pod "kube-scheduler-addons-705389" in "kube-system" namespace to be "Ready" ...
	I1107 23:02:43.720331    8034 pod_ready.go:38] duration metric: took 1.594623874s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1107 23:02:43.720367    8034 api_server.go:52] waiting for apiserver process to appear ...
	I1107 23:02:43.720456    8034 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1107 23:02:44.905314    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.190393247s)
	I1107 23:02:44.905274    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.206372414s)
	I1107 23:02:46.012547    8034 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I1107 23:02:46.012701    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:46.048412    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:47.033062    8034 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I1107 23:02:47.160149    8034 addons.go:231] Setting addon gcp-auth=true in "addons-705389"
	I1107 23:02:47.160204    8034 host.go:66] Checking if "addons-705389" exists ...
	I1107 23:02:47.160669    8034 cli_runner.go:164] Run: docker container inspect addons-705389 --format={{.State.Status}}
	I1107 23:02:47.202255    8034 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I1107 23:02:47.202310    8034 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-705389
	I1107 23:02:47.231191    8034 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/addons-705389/id_rsa Username:docker}
	I1107 23:02:48.897553    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.087418528s)
	I1107 23:02:48.897580    8034 addons.go:467] Verifying addon ingress=true in "addons-705389"
	I1107 23:02:48.900448    8034 out.go:177] * Verifying ingress addon...
	I1107 23:02:48.897960    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.018038646s)
	I1107 23:02:48.898024    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.716433724s)
	I1107 23:02:48.898093    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.456441302s)
	I1107 23:02:48.898183    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.061722272s)
	I1107 23:02:48.898247    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (5.791316341s)
	I1107 23:02:48.903939    8034 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I1107 23:02:48.904136    8034 addons.go:467] Verifying addon registry=true in "addons-705389"
	I1107 23:02:48.906627    8034 out.go:177] * Verifying registry addon...
	I1107 23:02:48.904291    8034 addons.go:467] Verifying addon metrics-server=true in "addons-705389"
	W1107 23:02:48.904320    8034 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I1107 23:02:48.906715    8034 retry.go:31] will retry after 197.518381ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I1107 23:02:48.909237    8034 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I1107 23:02:48.909970    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:48.910924    8034 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I1107 23:02:48.915613    8034 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I1107 23:02:48.915682    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:48.916900    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:48.920022    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:49.104838    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1107 23:02:49.439391    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:49.440552    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:49.928994    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:49.930216    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:50.324327    8034 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (6.603821794s)
	I1107 23:02:50.324489    8034 api_server.go:72] duration metric: took 11.052550469s to wait for apiserver process to appear ...
	I1107 23:02:50.324515    8034 api_server.go:88] waiting for apiserver healthz status ...
	I1107 23:02:50.324408    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.813066938s)
	I1107 23:02:50.324552    8034 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-705389"
	I1107 23:02:50.327336    8034 out.go:177] * Verifying csi-hostpath-driver addon...
	I1107 23:02:50.324750    8034 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I1107 23:02:50.324443    8034 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.122167136s)
	I1107 23:02:50.333021    8034 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1107 23:02:50.331314    8034 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I1107 23:02:50.338805    8034 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I1107 23:02:50.343610    8034 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I1107 23:02:50.343631    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I1107 23:02:50.340633    8034 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I1107 23:02:50.345008    8034 api_server.go:141] control plane version: v1.28.3
	I1107 23:02:50.345032    8034 api_server.go:131] duration metric: took 20.292571ms to wait for apiserver health ...
	I1107 23:02:50.345041    8034 system_pods.go:43] waiting for kube-system pods to appear ...
	I1107 23:02:50.350134    8034 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I1107 23:02:50.350203    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:50.358356    8034 system_pods.go:59] 17 kube-system pods found
	I1107 23:02:50.358439    8034 system_pods.go:61] "coredns-5dd5756b68-4g56m" [09b6d9ad-5a3b-44a2-aaec-6f89e92b1783] Running
	I1107 23:02:50.358462    8034 system_pods.go:61] "csi-hostpath-attacher-0" [b3d902cb-96e2-40ac-9579-394e460934f6] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I1107 23:02:50.358485    8034 system_pods.go:61] "csi-hostpath-resizer-0" [82bb9e18-21e6-4cfe-a7fc-37527e3fee5b] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I1107 23:02:50.358518    8034 system_pods.go:61] "csi-hostpathplugin-tj2dx" [c5d17ccd-34de-4d76-87cd-682184fa1584] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I1107 23:02:50.358544    8034 system_pods.go:61] "etcd-addons-705389" [7ab0c8fe-72d5-47e2-9614-4966bbcd3a4a] Running
	I1107 23:02:50.358561    8034 system_pods.go:61] "kube-apiserver-addons-705389" [faa586b7-3cd4-4e76-8f78-8dccf83a8cab] Running
	I1107 23:02:50.358580    8034 system_pods.go:61] "kube-controller-manager-addons-705389" [918fe923-e245-4c1f-8edb-09a7406bdbd9] Running
	I1107 23:02:50.358600    8034 system_pods.go:61] "kube-ingress-dns-minikube" [2ca32d7c-ca60-4f93-a6f8-ae42621f93d6] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I1107 23:02:50.358628    8034 system_pods.go:61] "kube-proxy-cxb5l" [49fbb82a-6878-4422-af0c-f1ee40ef7d74] Running
	I1107 23:02:50.358651    8034 system_pods.go:61] "kube-scheduler-addons-705389" [26584845-b2ac-4dbb-a7b1-19e1cd2bb233] Running
	I1107 23:02:50.358671    8034 system_pods.go:61] "metrics-server-7c66d45ddc-pqxs9" [5f0ccaee-940f-4c74-b17b-edcfd040d61b] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I1107 23:02:50.358691    8034 system_pods.go:61] "nvidia-device-plugin-daemonset-wsh98" [c302fe6d-1463-430f-8c15-749a50e0a2d0] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I1107 23:02:50.358713    8034 system_pods.go:61] "registry-proxy-8qm9x" [ea6a77a7-2195-4c76-867e-21193cd4573f] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I1107 23:02:50.358747    8034 system_pods.go:61] "registry-r2nhz" [6b608537-e2f4-4704-adaa-f6d86200b9ea] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I1107 23:02:50.358769    8034 system_pods.go:61] "snapshot-controller-58dbcc7b99-5b95j" [31903842-4385-42d0-ba8e-421ad962cd92] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1107 23:02:50.358793    8034 system_pods.go:61] "snapshot-controller-58dbcc7b99-rlv69" [939a0e31-19c6-4efc-9fb3-35be572e705b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1107 23:02:50.358820    8034 system_pods.go:61] "storage-provisioner" [a259a511-0c23-4c2b-8977-ab24ab0881ad] Running
	I1107 23:02:50.358842    8034 system_pods.go:74] duration metric: took 13.794439ms to wait for pod list to return data ...
	I1107 23:02:50.358864    8034 default_sa.go:34] waiting for default service account to be created ...
	I1107 23:02:50.362212    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:50.363232    8034 default_sa.go:45] found service account: "default"
	I1107 23:02:50.363296    8034 default_sa.go:55] duration metric: took 4.40934ms for default service account to be created ...
	I1107 23:02:50.363320    8034 system_pods.go:116] waiting for k8s-apps to be running ...
	I1107 23:02:50.372661    8034 system_pods.go:86] 17 kube-system pods found
	I1107 23:02:50.372730    8034 system_pods.go:89] "coredns-5dd5756b68-4g56m" [09b6d9ad-5a3b-44a2-aaec-6f89e92b1783] Running
	I1107 23:02:50.372756    8034 system_pods.go:89] "csi-hostpath-attacher-0" [b3d902cb-96e2-40ac-9579-394e460934f6] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I1107 23:02:50.372779    8034 system_pods.go:89] "csi-hostpath-resizer-0" [82bb9e18-21e6-4cfe-a7fc-37527e3fee5b] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I1107 23:02:50.372815    8034 system_pods.go:89] "csi-hostpathplugin-tj2dx" [c5d17ccd-34de-4d76-87cd-682184fa1584] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I1107 23:02:50.372839    8034 system_pods.go:89] "etcd-addons-705389" [7ab0c8fe-72d5-47e2-9614-4966bbcd3a4a] Running
	I1107 23:02:50.372859    8034 system_pods.go:89] "kube-apiserver-addons-705389" [faa586b7-3cd4-4e76-8f78-8dccf83a8cab] Running
	I1107 23:02:50.372877    8034 system_pods.go:89] "kube-controller-manager-addons-705389" [918fe923-e245-4c1f-8edb-09a7406bdbd9] Running
	I1107 23:02:50.372897    8034 system_pods.go:89] "kube-ingress-dns-minikube" [2ca32d7c-ca60-4f93-a6f8-ae42621f93d6] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I1107 23:02:50.372933    8034 system_pods.go:89] "kube-proxy-cxb5l" [49fbb82a-6878-4422-af0c-f1ee40ef7d74] Running
	I1107 23:02:50.372959    8034 system_pods.go:89] "kube-scheduler-addons-705389" [26584845-b2ac-4dbb-a7b1-19e1cd2bb233] Running
	I1107 23:02:50.372980    8034 system_pods.go:89] "metrics-server-7c66d45ddc-pqxs9" [5f0ccaee-940f-4c74-b17b-edcfd040d61b] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I1107 23:02:50.373002    8034 system_pods.go:89] "nvidia-device-plugin-daemonset-wsh98" [c302fe6d-1463-430f-8c15-749a50e0a2d0] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I1107 23:02:50.373034    8034 system_pods.go:89] "registry-proxy-8qm9x" [ea6a77a7-2195-4c76-867e-21193cd4573f] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I1107 23:02:50.373058    8034 system_pods.go:89] "registry-r2nhz" [6b608537-e2f4-4704-adaa-f6d86200b9ea] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I1107 23:02:50.373080    8034 system_pods.go:89] "snapshot-controller-58dbcc7b99-5b95j" [31903842-4385-42d0-ba8e-421ad962cd92] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1107 23:02:50.373101    8034 system_pods.go:89] "snapshot-controller-58dbcc7b99-rlv69" [939a0e31-19c6-4efc-9fb3-35be572e705b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1107 23:02:50.373119    8034 system_pods.go:89] "storage-provisioner" [a259a511-0c23-4c2b-8977-ab24ab0881ad] Running
	I1107 23:02:50.373154    8034 system_pods.go:126] duration metric: took 9.816724ms to wait for k8s-apps to be running ...
	I1107 23:02:50.373174    8034 system_svc.go:44] waiting for kubelet service to be running ....
	I1107 23:02:50.373255    8034 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1107 23:02:50.430191    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:50.431163    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:50.464814    8034 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I1107 23:02:50.464838    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I1107 23:02:50.552530    8034 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I1107 23:02:50.552554    8034 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5432 bytes)
	I1107 23:02:50.612918    8034 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I1107 23:02:50.890662    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:50.923464    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:50.926166    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:51.368517    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:51.434512    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:51.437529    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:51.778243    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.673265585s)
	I1107 23:02:51.778291    8034 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (1.40501068s)
	I1107 23:02:51.778304    8034 system_svc.go:56] duration metric: took 1.405127727s WaitForService to wait for kubelet.
	I1107 23:02:51.778314    8034 kubeadm.go:581] duration metric: took 12.506375798s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I1107 23:02:51.778336    8034 node_conditions.go:102] verifying NodePressure condition ...
	I1107 23:02:51.781611    8034 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I1107 23:02:51.781644    8034 node_conditions.go:123] node cpu capacity is 2
	I1107 23:02:51.781655    8034 node_conditions.go:105] duration metric: took 3.313718ms to run NodePressure ...
	I1107 23:02:51.781668    8034 start.go:228] waiting for startup goroutines ...
	I1107 23:02:51.868400    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:51.921934    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:51.925783    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:52.123254    8034 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.510288923s)
	I1107 23:02:52.124839    8034 addons.go:467] Verifying addon gcp-auth=true in "addons-705389"
	I1107 23:02:52.128042    8034 out.go:177] * Verifying gcp-auth addon...
	I1107 23:02:52.131292    8034 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I1107 23:02:52.137320    8034 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I1107 23:02:52.137387    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:52.142987    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:52.368258    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:52.422978    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:52.426373    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:52.647285    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:52.868655    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:52.922684    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:52.925495    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:53.147659    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:53.368662    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:53.421982    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:53.425892    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:53.646538    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:53.868191    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:53.923438    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:53.926441    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:54.147837    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:54.369850    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:54.423752    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:54.432080    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:54.647009    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:54.867845    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:54.921965    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:54.925023    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:55.146875    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:55.368478    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:55.422926    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:55.425791    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:55.646696    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:55.868875    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:55.923665    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:55.926227    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:56.147310    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:56.368109    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:56.423798    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:56.426434    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:56.647841    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:56.867828    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:56.923430    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:56.926691    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:57.150256    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:57.368783    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:57.425123    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:57.426568    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:57.646888    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:57.869887    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:57.921528    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:57.924982    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:58.147457    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:58.369086    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:58.422514    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:58.426044    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:58.651132    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:58.867554    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:58.922151    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:58.926591    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:59.146812    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:59.368720    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:59.422662    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:59.426078    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:02:59.647061    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:02:59.869238    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:02:59.921894    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:02:59.926463    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:00.156925    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:00.370985    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:00.423681    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:00.428909    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:00.647012    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:00.868669    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:00.922426    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:00.926780    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:01.146857    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:01.368836    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:01.422051    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:01.424901    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:01.647387    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:01.868026    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:01.923900    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:01.927461    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:02.147712    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:02.373049    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:02.422009    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:02.426556    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:02.647320    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:02.868740    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:02.921774    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:02.926414    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:03.147404    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:03.367939    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:03.420994    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:03.424927    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:03.646531    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:03.868733    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:03.922429    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:03.925800    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:04.147249    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:04.367829    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:04.422021    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:04.424757    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:04.646277    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:04.867586    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:04.921912    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:04.924734    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:05.147592    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:05.368541    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:05.421974    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:05.424889    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:05.646735    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:05.868692    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:05.922877    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:05.926723    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:06.147747    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:06.368406    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:06.421867    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:06.424778    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:06.646410    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:06.868652    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:06.922182    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:06.925351    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:07.147503    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:07.368529    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:07.421841    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:07.426360    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:07.647539    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:07.869220    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:07.922029    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:07.925001    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:08.146839    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:08.368995    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:08.421890    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:08.424911    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:08.647011    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:08.876660    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:08.933460    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:08.941659    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:09.147927    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:09.368794    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:09.422267    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:09.428072    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:09.647482    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:09.869450    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:09.922726    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:09.927447    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:10.147438    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:10.369296    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:10.425346    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:10.427032    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:10.647329    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:10.869153    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:10.921478    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:10.924713    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:11.147652    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:11.368588    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:11.423211    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:11.426006    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:11.646952    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:11.868729    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:11.923745    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:11.926146    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:12.147149    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:12.367770    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:12.422317    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:12.426483    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:12.647361    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:12.869343    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:12.923936    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:12.928012    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1107 23:03:13.146906    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:13.368332    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:13.429672    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:13.432506    8034 kapi.go:107] duration metric: took 24.521580458s to wait for kubernetes.io/minikube-addons=registry ...
	I1107 23:03:13.647443    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:13.868633    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:13.921900    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:14.146652    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:14.371834    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:14.423287    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:14.647232    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:14.869103    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:14.921854    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:15.147695    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:15.369332    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:15.422243    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:15.646915    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:15.869355    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:15.921852    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:16.146765    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:16.378168    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:16.421915    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:16.646802    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:16.868594    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:16.921971    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:17.146885    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:17.368466    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:17.422660    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:17.647175    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:17.868204    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:17.921014    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:18.147201    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:18.368311    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:18.421953    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:18.646481    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:18.868635    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:18.921884    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:19.146574    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:19.368875    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:19.422531    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:19.647518    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:19.869018    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:19.923737    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:20.147950    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:20.368842    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:20.423094    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:20.648098    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:20.887469    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:20.925990    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:21.147720    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:21.372315    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:21.422289    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:21.648678    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:21.868798    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:21.923570    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:22.147520    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:22.368770    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:22.422485    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:22.647394    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:22.868117    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:22.922370    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:23.147279    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:23.369266    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:23.422550    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:23.646628    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:23.868279    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:23.923244    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:24.147183    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:24.368141    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:24.422151    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:24.647089    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:24.869714    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:24.922129    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:25.147946    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:25.368503    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:25.423210    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:25.646898    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:25.869660    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:25.924202    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:26.147641    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:26.369092    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:26.422369    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:26.655405    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:26.888962    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:26.921665    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:27.147472    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:27.368445    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:27.421276    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:27.647441    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:27.869787    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:27.927800    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:28.146995    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:28.371618    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:28.422876    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:28.647600    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:28.870637    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:28.922397    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:29.148094    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:29.367496    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:29.421979    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:29.648476    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:29.868192    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:29.922029    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:30.149092    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:30.367707    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:30.421961    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:30.646497    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:30.868247    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:30.921506    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:31.148597    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:31.369048    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:31.421293    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:31.646801    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:31.868507    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:31.922080    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:32.151946    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:32.368993    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:32.421661    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:32.647440    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:32.868384    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:32.922011    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:33.146770    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:33.368441    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:33.421640    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:33.647232    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:33.868409    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:33.922332    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:34.148600    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:34.368305    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:34.421945    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:34.647371    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:34.868712    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:34.921964    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:35.147326    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:35.371471    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:35.423245    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:35.647515    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:35.868156    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:35.924064    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:36.147702    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:36.368833    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:36.422619    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:36.647630    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:36.868512    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:36.921377    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:37.147095    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:37.368442    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:37.425248    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:37.648372    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:37.868382    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:37.921973    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:38.146666    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:38.368743    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:38.421961    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:38.646742    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:38.871499    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:38.922439    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:39.148078    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:39.368271    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:39.421657    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:39.647365    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:39.869224    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:39.923215    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:40.147765    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:40.369697    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:40.422202    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:40.646665    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:40.868309    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:40.921717    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:41.146478    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:41.368131    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:41.421724    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:41.646660    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:41.867964    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:41.922191    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:42.148160    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:42.368767    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:42.423331    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:42.647809    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:42.872915    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:42.921253    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:43.147149    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:43.367550    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:43.422299    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:43.647137    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:43.868323    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:43.921307    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:44.146948    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:44.368695    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:44.421968    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:44.646551    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:44.868960    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:44.921902    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:45.151737    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:45.373485    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1107 23:03:45.425897    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:45.646282    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:45.868272    8034 kapi.go:107] duration metric: took 55.536953459s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I1107 23:03:45.922788    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:46.146516    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:46.422380    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:46.646861    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:46.921700    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:47.146249    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:47.421732    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:47.646578    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:47.924019    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:48.147203    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:48.421721    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:48.646488    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:48.921975    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:49.146909    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:49.421589    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:49.647584    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:49.921528    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:50.147666    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:50.421632    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:50.647278    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:50.921811    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:51.146924    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:51.421953    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:51.647317    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:51.921930    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:52.146277    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:52.421646    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:52.649493    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:52.923560    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:53.147380    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:53.422094    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:53.646922    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:53.921540    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:54.147433    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:54.432413    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:54.647758    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:54.923655    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:55.147708    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:55.421290    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:55.647199    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:55.923834    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:56.147348    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:56.421851    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:56.648304    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:56.921611    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:57.147836    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:57.421794    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:57.647719    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:57.922543    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:58.159751    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:58.421656    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:58.647622    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:58.922986    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:59.147197    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:59.422500    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:03:59.647857    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:03:59.921970    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:04:00.155384    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:04:00.429234    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:04:00.647230    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:04:00.922296    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:04:01.147183    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:04:01.425348    8034 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1107 23:04:01.647527    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:04:01.927645    8034 kapi.go:107] duration metric: took 1m13.023769492s to wait for app.kubernetes.io/name=ingress-nginx ...
	I1107 23:04:02.147502    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:04:02.649991    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:04:03.147530    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:04:03.648512    8034 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1107 23:04:04.149666    8034 kapi.go:107] duration metric: took 1m12.018370672s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I1107 23:04:04.152186    8034 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-705389 cluster.
	I1107 23:04:04.154408    8034 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I1107 23:04:04.156919    8034 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I1107 23:04:04.159283    8034 out.go:177] * Enabled addons: nvidia-device-plugin, ingress-dns, default-storageclass, cloud-spanner, storage-provisioner-rancher, inspektor-gadget, storage-provisioner, metrics-server, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I1107 23:04:04.161572    8034 addons.go:502] enable addons completed in 1m25.168720373s: enabled=[nvidia-device-plugin ingress-dns default-storageclass cloud-spanner storage-provisioner-rancher inspektor-gadget storage-provisioner metrics-server volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I1107 23:04:04.161627    8034 start.go:233] waiting for cluster config update ...
	I1107 23:04:04.161647    8034 start.go:242] writing updated cluster config ...
	I1107 23:04:04.162497    8034 ssh_runner.go:195] Run: rm -f paused
	I1107 23:04:04.487280    8034 start.go:600] kubectl: 1.28.3, cluster: 1.28.3 (minor skew: 0)
	I1107 23:04:04.490157    8034 out.go:177] * Done! kubectl is now configured to use "addons-705389" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Nov 07 23:05:20 addons-705389 dockerd[1099]: time="2023-11-07T23:05:20.253207936Z" level=info msg="ignoring event" container=05f1ddce8282b3d7492cd6ac18c1e0cdefc3cadcb49bdc7c165994f2cb6f6563 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:20 addons-705389 dockerd[1099]: time="2023-11-07T23:05:20.253262878Z" level=info msg="ignoring event" container=3fa3cd6f8093120661ef6d7f3be136279fb48d79c2d00b10c21c0948ffa2d873 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:20 addons-705389 dockerd[1099]: time="2023-11-07T23:05:20.257327350Z" level=info msg="ignoring event" container=39b89077c70e409794474b104761ac8f77e0383b8d649eff81f8dd37078361b7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:20 addons-705389 dockerd[1099]: time="2023-11-07T23:05:20.268219016Z" level=info msg="ignoring event" container=90b428d8312da905a6ff31368d65bfa500b4787af1792027584c4900124a413c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:20 addons-705389 dockerd[1099]: time="2023-11-07T23:05:20.303581412Z" level=info msg="ignoring event" container=c9f3d8a60a79b1fc81315f298f50d947e3114314e3040e7ffd4bfafc1881fee2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:20 addons-705389 dockerd[1099]: time="2023-11-07T23:05:20.389383401Z" level=info msg="ignoring event" container=420f621bad45b1919ee385d2eba4fe179af955f9650b0e206e09d9cab538514e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:20 addons-705389 dockerd[1099]: time="2023-11-07T23:05:20.481675327Z" level=info msg="ignoring event" container=eb331da5a2d1418793b8032da17abdf75a99eaaef7a7a4fc10c3f1402bc27bda module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:20 addons-705389 dockerd[1099]: time="2023-11-07T23:05:20.506879148Z" level=info msg="ignoring event" container=90417c072751ede908578d028da9b6ee16c30beec856fa5e5b07503a12bc6fc5 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:23 addons-705389 dockerd[1099]: time="2023-11-07T23:05:23.583127758Z" level=info msg="ignoring event" container=032a6da4b23451c0f0f97fb7bee088e29271b042a187ed8b74371c9dd340e726 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:23 addons-705389 dockerd[1099]: time="2023-11-07T23:05:23.760309690Z" level=info msg="ignoring event" container=0414396a6aa8e1584b7999ba419268a1424660b5ba8c6bfd4f29ae81035812a7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:24 addons-705389 cri-dockerd[1310]: time="2023-11-07T23:05:24Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/2b2a65c9a9668be0e030a1aecb4fa3cefb50b7ffd8849b719e319a7fe2482871/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	Nov 07 23:05:27 addons-705389 dockerd[1099]: time="2023-11-07T23:05:27.143838554Z" level=info msg="ignoring event" container=1a69400596b2f5ac650a3562904ce4b5bb24ce272ea99fde22eee370bcca3a36 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:27 addons-705389 dockerd[1099]: time="2023-11-07T23:05:27.176908482Z" level=info msg="ignoring event" container=f192c1732c89c31734a1ce4a10def7d91d0797b7dc5f77e0fe943608abe48a36 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:27 addons-705389 cri-dockerd[1310]: time="2023-11-07T23:05:27Z" level=info msg="Stop pulling image docker.io/nginx:alpine: Status: Downloaded newer image for nginx:alpine"
	Nov 07 23:05:27 addons-705389 dockerd[1099]: time="2023-11-07T23:05:27.473337430Z" level=info msg="ignoring event" container=aecc5df1540ac69a8b00c911c2ce4cf415a71a496109fa9ca49d3543a3151a4d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:27 addons-705389 dockerd[1099]: time="2023-11-07T23:05:27.500312755Z" level=info msg="ignoring event" container=d673d0edc60a31d322ab20bd283b80fc1f7e1a03ac3b2558fae1a173a49839e7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:35 addons-705389 cri-dockerd[1310]: time="2023-11-07T23:05:35Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/b94effa5a61291e76f5a4cde323380d5a7be1c211a70a5b23f652eef1e13a651/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	Nov 07 23:05:37 addons-705389 cri-dockerd[1310]: time="2023-11-07T23:05:37Z" level=info msg="Stop pulling image gcr.io/google-samples/hello-app:1.0: Status: Downloaded newer image for gcr.io/google-samples/hello-app:1.0"
	Nov 07 23:05:37 addons-705389 dockerd[1099]: time="2023-11-07T23:05:37.731150505Z" level=info msg="ignoring event" container=8eb958bae434bc04b98bbd71785de5822d54eb5b277ce778ed1ade80006d7f2d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:38 addons-705389 dockerd[1099]: time="2023-11-07T23:05:38.532165791Z" level=info msg="ignoring event" container=00df97f8bfa8885027b7ff186eeffad1b963c5492e1d2cf58ff30eac2eaafec4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:51 addons-705389 dockerd[1099]: time="2023-11-07T23:05:51.013092225Z" level=info msg="ignoring event" container=253b606aa1da064c3b35b300cad4dcb2826bb8fa03f1a7999ac43107475aa20f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:53 addons-705389 dockerd[1099]: time="2023-11-07T23:05:53.920010032Z" level=info msg="ignoring event" container=c7048c1ce251c0d400ce749a5e30571017fcce071fab4e05fa12d3420957896b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:55 addons-705389 dockerd[1099]: time="2023-11-07T23:05:55.265235603Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1
	Nov 07 23:05:55 addons-705389 dockerd[1099]: time="2023-11-07T23:05:55.349929976Z" level=info msg="ignoring event" container=4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:05:55 addons-705389 dockerd[1099]: time="2023-11-07T23:05:55.482420129Z" level=info msg="ignoring event" container=91cfe96582399894302e3518e16c7f8c32bbfa155033447fb44ce51513b4d184 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                                        CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	c7048c1ce251c       dd1b12fcb6097                                                                                                                7 seconds ago        Exited              hello-world-app           2                   b94effa5a6129       hello-world-app-5d77478584-dfbzd
	410f744d0ea89       nginx@sha256:db353d0f0c479c91bd15e01fc68ed0f33d9c4c52f3415e63332c3d0bf7a4bb77                                                33 seconds ago       Running             nginx                     0                   2b2a65c9a9668       nginx
	d2aab0992ec2a       ghcr.io/headlamp-k8s/headlamp@sha256:db0310cf5abef3ffd5aa87509b1f61a150ee705808c5b29704149101653d418b                        About a minute ago   Running             headlamp                  0                   49dca4a295606       headlamp-94b766c-sxvjx
	a9910036c43b6       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf                 About a minute ago   Running             gcp-auth                  0                   0c95f7fb53352       gcp-auth-d4c87556c-v8dl8
	aa86770e46886       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a7943503b45d552785aa3b5e457f169a5661fb94d82b8a3373bcd9ebaf9aac80   2 minutes ago        Exited              patch                     0                   2641de6fed540       ingress-nginx-admission-patch-nfsdb
	88fd1ae1fe11f       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a7943503b45d552785aa3b5e457f169a5661fb94d82b8a3373bcd9ebaf9aac80   2 minutes ago        Exited              create                    0                   82cb9ec32592e       ingress-nginx-admission-create-sx89s
	24a9fcd6d5320       ba04bb24b9575                                                                                                                3 minutes ago        Running             storage-provisioner       0                   0b873062a6268       storage-provisioner
	1991203fc8509       97e04611ad434                                                                                                                3 minutes ago        Running             coredns                   0                   fcf69ad1afc1e       coredns-5dd5756b68-4g56m
	6ae2963b5511d       a5dd5cdd6d3ef                                                                                                                3 minutes ago        Running             kube-proxy                0                   b3075a79fd7d2       kube-proxy-cxb5l
	1ea37b5c3dffe       9cdd6470f48c8                                                                                                                3 minutes ago        Running             etcd                      0                   ee08c7879892b       etcd-addons-705389
	4039e08d24e4a       42a4e73724daa                                                                                                                3 minutes ago        Running             kube-scheduler            0                   db1248cd45785       kube-scheduler-addons-705389
	74a58c85f4034       537e9a59ee2fd                                                                                                                3 minutes ago        Running             kube-apiserver            0                   bd8416b1c9b40       kube-apiserver-addons-705389
	2111588f8b9ca       8276439b4f237                                                                                                                3 minutes ago        Running             kube-controller-manager   0                   d336313b01dfd       kube-controller-manager-addons-705389
	
	* 
	* ==> coredns [1991203fc850] <==
	* [INFO] 10.244.0.18:34042 - 41528 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00021189s
	[INFO] 10.244.0.18:34042 - 61289 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001486095s
	[INFO] 10.244.0.18:57015 - 26716 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.003027174s
	[INFO] 10.244.0.18:57015 - 58446 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.004028426s
	[INFO] 10.244.0.18:34042 - 33329 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.004121382s
	[INFO] 10.244.0.18:57015 - 51024 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000258241s
	[INFO] 10.244.0.18:34042 - 61538 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.00031256s
	[INFO] 10.244.0.18:56697 - 24820 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000099947s
	[INFO] 10.244.0.18:49740 - 36242 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000091274s
	[INFO] 10.244.0.18:49740 - 55007 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000065535s
	[INFO] 10.244.0.18:56697 - 55693 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000076604s
	[INFO] 10.244.0.18:49740 - 26023 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000105051s
	[INFO] 10.244.0.18:56697 - 972 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000104599s
	[INFO] 10.244.0.18:49740 - 26584 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000099093s
	[INFO] 10.244.0.18:56697 - 46945 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00009532s
	[INFO] 10.244.0.18:49740 - 60832 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000105609s
	[INFO] 10.244.0.18:56697 - 46076 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000146314s
	[INFO] 10.244.0.18:49740 - 16237 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000069515s
	[INFO] 10.244.0.18:56697 - 16512 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000051717s
	[INFO] 10.244.0.18:56697 - 57892 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00122687s
	[INFO] 10.244.0.18:49740 - 34504 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001724235s
	[INFO] 10.244.0.18:56697 - 48269 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000818695s
	[INFO] 10.244.0.18:49740 - 52899 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001239481s
	[INFO] 10.244.0.18:49740 - 40214 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.00005888s
	[INFO] 10.244.0.18:56697 - 4818 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000054334s
	
	* 
	* ==> describe nodes <==
	* Name:               addons-705389
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-705389
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=693359050ae80510825facc3cb57aa024560c29e
	                    minikube.k8s.io/name=addons-705389
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_11_07T23_02_25_0700
	                    minikube.k8s.io/version=v1.32.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-705389
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Tue, 07 Nov 2023 23:02:22 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-705389
	  AcquireTime:     <unset>
	  RenewTime:       Tue, 07 Nov 2023 23:05:59 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Tue, 07 Nov 2023 23:04:59 +0000   Tue, 07 Nov 2023 23:02:18 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Tue, 07 Nov 2023 23:04:59 +0000   Tue, 07 Nov 2023 23:02:18 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Tue, 07 Nov 2023 23:04:59 +0000   Tue, 07 Nov 2023 23:02:18 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Tue, 07 Nov 2023 23:04:59 +0000   Tue, 07 Nov 2023 23:02:36 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-705389
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022500Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022500Ki
	  pods:               110
	System Info:
	  Machine ID:                 e73221153bac491086510b783d99e169
	  System UUID:                e8517c0f-5ddd-4939-9234-be2bd6eced6e
	  Boot ID:                    b70576f7-d3d1-43e3-aa81-4f6e70603af6
	  Kernel Version:             5.15.0-1049-aws
	  OS Image:                   Ubuntu 22.04.3 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.7
	  Kubelet Version:            v1.28.3
	  Kube-Proxy Version:         v1.28.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5d77478584-dfbzd         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         37s
	  gcp-auth                    gcp-auth-d4c87556c-v8dl8                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m8s
	  headlamp                    headlamp-94b766c-sxvjx                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         94s
	  kube-system                 coredns-5dd5756b68-4g56m                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     3m22s
	  kube-system                 etcd-addons-705389                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         3m34s
	  kube-system                 kube-apiserver-addons-705389             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m34s
	  kube-system                 kube-controller-manager-addons-705389    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m36s
	  kube-system                 kube-proxy-cxb5l                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m22s
	  kube-system                 kube-scheduler-addons-705389             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m34s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m16s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)
	  memory             170Mi (2%!)(MISSING)  170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 3m20s  kube-proxy       
	  Normal  Starting                 3m35s  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  3m35s  kubelet          Node addons-705389 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m35s  kubelet          Node addons-705389 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m35s  kubelet          Node addons-705389 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             3m35s  kubelet          Node addons-705389 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  3m35s  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                3m24s  kubelet          Node addons-705389 status is now: NodeReady
	  Normal  RegisteredNode           3m22s  node-controller  Node addons-705389 event: Registered Node addons-705389 in Controller
	
	* 
	* ==> dmesg <==
	* [Nov 7 22:21] ACPI: SRAT not present
	[  +0.000000] ACPI: SRAT not present
	[  +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
	[  +0.017437] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
	[  +1.257158] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
	[  +6.335413] kauditd_printk_skb: 26 callbacks suppressed
	[Nov 7 23:03] hrtimer: interrupt took 47030470 ns
	
	* 
	* ==> etcd [1ea37b5c3dff] <==
	* {"level":"info","ts":"2023-11-07T23:02:18.81007Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2023-11-07T23:02:18.811412Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-11-07T23:02:18.821364Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2023-11-07T23:02:18.821635Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-11-07T23:02:18.821846Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-11-07T23:02:18.822594Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2023-11-07T23:02:18.822724Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2023-11-07T23:02:19.066268Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-11-07T23:02:19.066326Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-11-07T23:02:19.066354Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-11-07T23:02:19.06637Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-11-07T23:02:19.06639Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-11-07T23:02:19.066405Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-11-07T23:02:19.066418Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-11-07T23:02:19.067332Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-705389 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-11-07T23:02:19.067373Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-11-07T23:02:19.067661Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-07T23:02:19.068699Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2023-11-07T23:02:19.071929Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-11-07T23:02:19.105168Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2023-11-07T23:02:19.072331Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-07T23:02:19.1482Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-07T23:02:19.148344Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-07T23:02:19.072827Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-11-07T23:02:19.159898Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	
	* 
	* ==> gcp-auth [a9910036c43b] <==
	* 2023/11/07 23:04:03 GCP Auth Webhook started!
	2023/11/07 23:04:11 Ready to marshal response ...
	2023/11/07 23:04:11 Ready to write response ...
	2023/11/07 23:04:11 Ready to marshal response ...
	2023/11/07 23:04:11 Ready to write response ...
	2023/11/07 23:04:14 Ready to marshal response ...
	2023/11/07 23:04:14 Ready to write response ...
	2023/11/07 23:04:22 Ready to marshal response ...
	2023/11/07 23:04:22 Ready to write response ...
	2023/11/07 23:04:26 Ready to marshal response ...
	2023/11/07 23:04:26 Ready to write response ...
	2023/11/07 23:04:26 Ready to marshal response ...
	2023/11/07 23:04:26 Ready to write response ...
	2023/11/07 23:04:26 Ready to marshal response ...
	2023/11/07 23:04:26 Ready to write response ...
	2023/11/07 23:04:42 Ready to marshal response ...
	2023/11/07 23:04:42 Ready to write response ...
	2023/11/07 23:05:08 Ready to marshal response ...
	2023/11/07 23:05:08 Ready to write response ...
	2023/11/07 23:05:23 Ready to marshal response ...
	2023/11/07 23:05:23 Ready to write response ...
	2023/11/07 23:05:34 Ready to marshal response ...
	2023/11/07 23:05:34 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  23:06:01 up 44 min,  0 users,  load average: 1.97, 1.90, 0.87
	Linux addons-705389 5.15.0-1049-aws #54~20.04.1-Ubuntu SMP Fri Oct 6 22:07:16 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.3 LTS"
	
	* 
	* ==> kube-apiserver [74a58c85f403] <==
	* W1107 23:05:12.466296       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I1107 23:05:22.327181       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I1107 23:05:23.532402       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
	I1107 23:05:23.950243       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.97.246.167"}
	I1107 23:05:26.703726       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1107 23:05:26.703776       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1107 23:05:26.730133       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1107 23:05:26.730189       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1107 23:05:26.743272       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1107 23:05:26.743330       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1107 23:05:26.792854       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1107 23:05:26.792906       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1107 23:05:26.803631       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1107 23:05:26.803684       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1107 23:05:26.840637       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1107 23:05:26.840685       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1107 23:05:26.858425       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1107 23:05:26.858467       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1107 23:05:26.872898       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1107 23:05:26.873754       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W1107 23:05:27.793751       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W1107 23:05:27.859206       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W1107 23:05:27.907498       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	I1107 23:05:27.928155       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
	I1107 23:05:35.187651       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.104.147.254"}
	
	* 
	* ==> kube-controller-manager [2111588f8b9c] <==
	* W1107 23:05:37.998584       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1107 23:05:37.998621       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I1107 23:05:38.392116       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="694.625µs"
	W1107 23:05:38.533190       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1107 23:05:38.533224       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I1107 23:05:39.013498       1 shared_informer.go:311] Waiting for caches to sync for resource quota
	I1107 23:05:39.013538       1 shared_informer.go:318] Caches are synced for resource quota
	I1107 23:05:39.354015       1 shared_informer.go:311] Waiting for caches to sync for garbage collector
	I1107 23:05:39.354411       1 shared_informer.go:318] Caches are synced for garbage collector
	I1107 23:05:39.413978       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="43.249µs"
	I1107 23:05:40.434669       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="43.939µs"
	W1107 23:05:41.686878       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1107 23:05:41.686912       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1107 23:05:46.793250       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1107 23:05:46.793289       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1107 23:05:48.051304       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1107 23:05:48.051348       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1107 23:05:49.612047       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1107 23:05:49.612158       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I1107 23:05:52.224810       1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-create"
	I1107 23:05:52.228745       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-7c6974c4d8" duration="4.931µs"
	I1107 23:05:52.232970       1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-patch"
	I1107 23:05:54.602654       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="73.551µs"
	W1107 23:05:59.065619       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1107 23:05:59.065656       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	
	* 
	* ==> kube-proxy [6ae2963b5511] <==
	* I1107 23:02:40.559981       1 server_others.go:69] "Using iptables proxy"
	I1107 23:02:40.576769       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I1107 23:02:40.625048       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I1107 23:02:40.630949       1 server_others.go:152] "Using iptables Proxier"
	I1107 23:02:40.630993       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I1107 23:02:40.631002       1 server_others.go:438] "Defaulting to no-op detect-local"
	I1107 23:02:40.631076       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I1107 23:02:40.631292       1 server.go:846] "Version info" version="v1.28.3"
	I1107 23:02:40.631309       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I1107 23:02:40.632360       1 config.go:188] "Starting service config controller"
	I1107 23:02:40.632426       1 shared_informer.go:311] Waiting for caches to sync for service config
	I1107 23:02:40.632448       1 config.go:97] "Starting endpoint slice config controller"
	I1107 23:02:40.632453       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I1107 23:02:40.635250       1 config.go:315] "Starting node config controller"
	I1107 23:02:40.635272       1 shared_informer.go:311] Waiting for caches to sync for node config
	I1107 23:02:40.733303       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I1107 23:02:40.733357       1 shared_informer.go:318] Caches are synced for service config
	I1107 23:02:40.735851       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [4039e08d24e4] <==
	* W1107 23:02:23.020745       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E1107 23:02:23.020840       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W1107 23:02:23.024214       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E1107 23:02:23.024395       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W1107 23:02:23.024587       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E1107 23:02:23.024674       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W1107 23:02:23.024816       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E1107 23:02:23.024911       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W1107 23:02:23.025074       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E1107 23:02:23.025157       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W1107 23:02:23.025309       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E1107 23:02:23.025394       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	W1107 23:02:23.027745       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E1107 23:02:23.027928       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	W1107 23:02:23.028216       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E1107 23:02:23.028316       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W1107 23:02:23.028501       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E1107 23:02:23.028588       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W1107 23:02:23.028746       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E1107 23:02:23.028940       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W1107 23:02:23.029113       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1107 23:02:23.029207       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W1107 23:02:23.926261       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E1107 23:02:23.926588       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I1107 23:02:26.601220       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Nov 07 23:05:39 addons-705389 kubelet[2314]: E1107 23:05:39.402124    2314 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5d77478584-dfbzd_default(3196ef3a-f492-4909-a8a8-174be626b7e2)\"" pod="default/hello-world-app-5d77478584-dfbzd" podUID="3196ef3a-f492-4909-a8a8-174be626b7e2"
	Nov 07 23:05:40 addons-705389 kubelet[2314]: I1107 23:05:40.421662    2314 scope.go:117] "RemoveContainer" containerID="00df97f8bfa8885027b7ff186eeffad1b963c5492e1d2cf58ff30eac2eaafec4"
	Nov 07 23:05:40 addons-705389 kubelet[2314]: E1107 23:05:40.422014    2314 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5d77478584-dfbzd_default(3196ef3a-f492-4909-a8a8-174be626b7e2)\"" pod="default/hello-world-app-5d77478584-dfbzd" podUID="3196ef3a-f492-4909-a8a8-174be626b7e2"
	Nov 07 23:05:51 addons-705389 kubelet[2314]: I1107 23:05:51.217212    2314 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv4dw\" (UniqueName: \"kubernetes.io/projected/2ca32d7c-ca60-4f93-a6f8-ae42621f93d6-kube-api-access-zv4dw\") pod \"2ca32d7c-ca60-4f93-a6f8-ae42621f93d6\" (UID: \"2ca32d7c-ca60-4f93-a6f8-ae42621f93d6\") "
	Nov 07 23:05:51 addons-705389 kubelet[2314]: I1107 23:05:51.222044    2314 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ca32d7c-ca60-4f93-a6f8-ae42621f93d6-kube-api-access-zv4dw" (OuterVolumeSpecName: "kube-api-access-zv4dw") pod "2ca32d7c-ca60-4f93-a6f8-ae42621f93d6" (UID: "2ca32d7c-ca60-4f93-a6f8-ae42621f93d6"). InnerVolumeSpecName "kube-api-access-zv4dw". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Nov 07 23:05:51 addons-705389 kubelet[2314]: I1107 23:05:51.318508    2314 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-zv4dw\" (UniqueName: \"kubernetes.io/projected/2ca32d7c-ca60-4f93-a6f8-ae42621f93d6-kube-api-access-zv4dw\") on node \"addons-705389\" DevicePath \"\""
	Nov 07 23:05:51 addons-705389 kubelet[2314]: I1107 23:05:51.543141    2314 scope.go:117] "RemoveContainer" containerID="121d8a6c4ad4ba2870d1dd779bb86007d9c31f6852f85cc53249921c21261c8f"
	Nov 07 23:05:51 addons-705389 kubelet[2314]: I1107 23:05:51.763432    2314 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ca32d7c-ca60-4f93-a6f8-ae42621f93d6" path="/var/lib/kubelet/pods/2ca32d7c-ca60-4f93-a6f8-ae42621f93d6/volumes"
	Nov 07 23:05:53 addons-705389 kubelet[2314]: I1107 23:05:53.755554    2314 scope.go:117] "RemoveContainer" containerID="00df97f8bfa8885027b7ff186eeffad1b963c5492e1d2cf58ff30eac2eaafec4"
	Nov 07 23:05:53 addons-705389 kubelet[2314]: I1107 23:05:53.774648    2314 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14bb9339-5406-4a8e-b570-e26046156634" path="/var/lib/kubelet/pods/14bb9339-5406-4a8e-b570-e26046156634/volumes"
	Nov 07 23:05:53 addons-705389 kubelet[2314]: I1107 23:05:53.776019    2314 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa69d2ba-27dc-449f-aab3-bd1710eff0a5" path="/var/lib/kubelet/pods/aa69d2ba-27dc-449f-aab3-bd1710eff0a5/volumes"
	Nov 07 23:05:54 addons-705389 kubelet[2314]: I1107 23:05:54.586513    2314 scope.go:117] "RemoveContainer" containerID="00df97f8bfa8885027b7ff186eeffad1b963c5492e1d2cf58ff30eac2eaafec4"
	Nov 07 23:05:54 addons-705389 kubelet[2314]: I1107 23:05:54.586893    2314 scope.go:117] "RemoveContainer" containerID="c7048c1ce251c0d400ce749a5e30571017fcce071fab4e05fa12d3420957896b"
	Nov 07 23:05:54 addons-705389 kubelet[2314]: E1107 23:05:54.587225    2314 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5d77478584-dfbzd_default(3196ef3a-f492-4909-a8a8-174be626b7e2)\"" pod="default/hello-world-app-5d77478584-dfbzd" podUID="3196ef3a-f492-4909-a8a8-174be626b7e2"
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.619353    2314 scope.go:117] "RemoveContainer" containerID="4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1"
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.642449    2314 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4845f93a-db6c-4621-ad30-2867930e923c-webhook-cert\") pod \"4845f93a-db6c-4621-ad30-2867930e923c\" (UID: \"4845f93a-db6c-4621-ad30-2867930e923c\") "
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.642901    2314 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz98k\" (UniqueName: \"kubernetes.io/projected/4845f93a-db6c-4621-ad30-2867930e923c-kube-api-access-jz98k\") pod \"4845f93a-db6c-4621-ad30-2867930e923c\" (UID: \"4845f93a-db6c-4621-ad30-2867930e923c\") "
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.644358    2314 scope.go:117] "RemoveContainer" containerID="4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1"
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.646193    2314 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4845f93a-db6c-4621-ad30-2867930e923c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4845f93a-db6c-4621-ad30-2867930e923c" (UID: "4845f93a-db6c-4621-ad30-2867930e923c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.647941    2314 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4845f93a-db6c-4621-ad30-2867930e923c-kube-api-access-jz98k" (OuterVolumeSpecName: "kube-api-access-jz98k") pod "4845f93a-db6c-4621-ad30-2867930e923c" (UID: "4845f93a-db6c-4621-ad30-2867930e923c"). InnerVolumeSpecName "kube-api-access-jz98k". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Nov 07 23:05:55 addons-705389 kubelet[2314]: E1107 23:05:55.648583    2314 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1" containerID="4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1"
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.648632    2314 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1"} err="failed to get container status \"4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1\": rpc error: code = Unknown desc = Error response from daemon: No such container: 4b0e5831606fcab1cebca13ce404b7af588537eae85207cdda179e4275a595c1"
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.743480    2314 reconciler_common.go:300] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4845f93a-db6c-4621-ad30-2867930e923c-webhook-cert\") on node \"addons-705389\" DevicePath \"\""
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.743525    2314 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-jz98k\" (UniqueName: \"kubernetes.io/projected/4845f93a-db6c-4621-ad30-2867930e923c-kube-api-access-jz98k\") on node \"addons-705389\" DevicePath \"\""
	Nov 07 23:05:55 addons-705389 kubelet[2314]: I1107 23:05:55.762783    2314 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4845f93a-db6c-4621-ad30-2867930e923c" path="/var/lib/kubelet/pods/4845f93a-db6c-4621-ad30-2867930e923c/volumes"
	
	* 
	* ==> storage-provisioner [24a9fcd6d532] <==
	* I1107 23:02:46.734092       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1107 23:02:46.757636       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1107 23:02:46.757731       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1107 23:02:46.767295       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1107 23:02:46.769609       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b9f1c238-9f89-4e74-92c3-a39c870cdbb1", APIVersion:"v1", ResourceVersion:"587", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-705389_070f25d5-25d7-42e3-b1f7-7c300f615d8c became leader
	I1107 23:02:46.769650       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-705389_070f25d5-25d7-42e3-b1f7-7c300f615d8c!
	I1107 23:02:46.870787       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-705389_070f25d5-25d7-42e3-b1f7-7c300f615d8c!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-705389 -n addons-705389
helpers_test.go:261: (dbg) Run:  kubectl --context addons-705389 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (39.25s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
functional_test.go:2284: (dbg) Non-zero exit: out/minikube-linux-arm64 license: exit status 40 (301.578964ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to INET_LICENSES: Failed to download licenses: download request did not return a 200, received: 404
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_license_42713f820c0ac68901ecf7b12bfdf24c2cafe65d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2285: command "\n\n" failed: exit status 40
--- FAIL: TestFunctional/parallel/License (0.30s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (52.64s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:206: (dbg) Run:  kubectl --context ingress-addon-legacy-324087 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:206: (dbg) Done: kubectl --context ingress-addon-legacy-324087 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (12.659033874s)
addons_test.go:231: (dbg) Run:  kubectl --context ingress-addon-legacy-324087 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:244: (dbg) Run:  kubectl --context ingress-addon-legacy-324087 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:249: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [e45da347-fd35-4f9e-bfd6-faa2596ab411] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [e45da347-fd35-4f9e-bfd6-faa2596ab411] Running
addons_test.go:249: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 9.017653288s
addons_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-324087 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:285: (dbg) Run:  kubectl --context ingress-addon-legacy-324087 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-324087 ip
addons_test.go:296: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:296: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.008785211s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:298: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:302: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:305: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-324087 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:305: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-324087 addons disable ingress-dns --alsologtostderr -v=1: (4.733043027s)
addons_test.go:310: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-324087 addons disable ingress --alsologtostderr -v=1
addons_test.go:310: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-324087 addons disable ingress --alsologtostderr -v=1: (7.550220059s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-324087
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-324087:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "a4e21da6089ab0be1ce44604ca9957a7e0a82761f9df5699c29fb4441b3c41cd",
	        "Created": "2023-11-07T23:12:39.859154297Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 56506,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-11-07T23:12:40.241217236Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:62753ecb37c4e3c5bf7b6c8d02fe88b543f553e92492fca245cded98b0d364dd",
	        "ResolvConfPath": "/var/lib/docker/containers/a4e21da6089ab0be1ce44604ca9957a7e0a82761f9df5699c29fb4441b3c41cd/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/a4e21da6089ab0be1ce44604ca9957a7e0a82761f9df5699c29fb4441b3c41cd/hostname",
	        "HostsPath": "/var/lib/docker/containers/a4e21da6089ab0be1ce44604ca9957a7e0a82761f9df5699c29fb4441b3c41cd/hosts",
	        "LogPath": "/var/lib/docker/containers/a4e21da6089ab0be1ce44604ca9957a7e0a82761f9df5699c29fb4441b3c41cd/a4e21da6089ab0be1ce44604ca9957a7e0a82761f9df5699c29fb4441b3c41cd-json.log",
	        "Name": "/ingress-addon-legacy-324087",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ingress-addon-legacy-324087:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "ingress-addon-legacy-324087",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/84a92cfa13d693eee39d0b1c52be57d0421479a6a3c4a5353e436b0a83254efb-init/diff:/var/lib/docker/overlay2/def196dc8a3d27299244ed5014f1d879dfc5c896a504644a641cada3a411b821/diff",
	                "MergedDir": "/var/lib/docker/overlay2/84a92cfa13d693eee39d0b1c52be57d0421479a6a3c4a5353e436b0a83254efb/merged",
	                "UpperDir": "/var/lib/docker/overlay2/84a92cfa13d693eee39d0b1c52be57d0421479a6a3c4a5353e436b0a83254efb/diff",
	                "WorkDir": "/var/lib/docker/overlay2/84a92cfa13d693eee39d0b1c52be57d0421479a6a3c4a5353e436b0a83254efb/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-324087",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-324087/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-324087",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-324087",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-324087",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "08f96e19021d14f722d6b423bdb903292c239a6e3472579c07f1b3c68c6cb511",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32792"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32791"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32788"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32790"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32789"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/08f96e19021d",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-324087": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "a4e21da6089a",
	                        "ingress-addon-legacy-324087"
	                    ],
	                    "NetworkID": "87d1289a7964c2e3e9f08174d904814b92a642ab1639c822c200a6b9d0d0f8a2",
	                    "EndpointID": "f41367469502080b4fad9299ad0cc6962e3bfbb227588756c37a1885b09aa9cc",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p ingress-addon-legacy-324087 -n ingress-addon-legacy-324087
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-324087 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-324087 logs -n 25: (1.042625905s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	|    Command     |                   Args                   |           Profile           |  User   | Version |     Start Time      |      End Time       |
	|----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| dashboard      | --url --port 36195                       | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | -p functional-729993                     |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |
	| update-context | functional-729993                        | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| update-context | functional-729993                        | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| update-context | functional-729993                        | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | update-context                           |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |
	| image          | functional-729993                        | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | image ls --format short                  |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| image          | functional-729993                        | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | image ls --format yaml                   |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| ssh            | functional-729993 ssh pgrep              | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC |                     |
	|                | buildkitd                                |                             |         |         |                     |                     |
	| image          | functional-729993 image build -t         | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | localhost/my-image:functional-729993     |                             |         |         |                     |                     |
	|                | testdata/build --alsologtostderr         |                             |         |         |                     |                     |
	| image          | functional-729993 image ls               | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	| image          | functional-729993                        | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | image ls --format json                   |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| image          | functional-729993                        | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	|                | image ls --format table                  |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	| delete         | -p functional-729993                     | functional-729993           | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:11 UTC |
	| start          | -p image-998338                          | image-998338                | jenkins | v1.32.0 | 07 Nov 23 23:11 UTC | 07 Nov 23 23:12 UTC |
	|                | --driver=docker                          |                             |         |         |                     |                     |
	|                | --container-runtime=docker               |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-998338                | jenkins | v1.32.0 | 07 Nov 23 23:12 UTC | 07 Nov 23 23:12 UTC |
	|                | ./testdata/image-build/test-normal       |                             |         |         |                     |                     |
	|                | -p image-998338                          |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-998338                | jenkins | v1.32.0 | 07 Nov 23 23:12 UTC | 07 Nov 23 23:12 UTC |
	|                | --build-opt=build-arg=ENV_A=test_env_str |                             |         |         |                     |                     |
	|                | --build-opt=no-cache                     |                             |         |         |                     |                     |
	|                | ./testdata/image-build/test-arg -p       |                             |         |         |                     |                     |
	|                | image-998338                             |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-998338                | jenkins | v1.32.0 | 07 Nov 23 23:12 UTC | 07 Nov 23 23:12 UTC |
	|                | ./testdata/image-build/test-normal       |                             |         |         |                     |                     |
	|                | --build-opt=no-cache -p                  |                             |         |         |                     |                     |
	|                | image-998338                             |                             |         |         |                     |                     |
	| image          | build -t aaa:latest                      | image-998338                | jenkins | v1.32.0 | 07 Nov 23 23:12 UTC | 07 Nov 23 23:12 UTC |
	|                | -f inner/Dockerfile                      |                             |         |         |                     |                     |
	|                | ./testdata/image-build/test-f            |                             |         |         |                     |                     |
	|                | -p image-998338                          |                             |         |         |                     |                     |
	| delete         | -p image-998338                          | image-998338                | jenkins | v1.32.0 | 07 Nov 23 23:12 UTC | 07 Nov 23 23:12 UTC |
	| start          | -p ingress-addon-legacy-324087           | ingress-addon-legacy-324087 | jenkins | v1.32.0 | 07 Nov 23 23:12 UTC | 07 Nov 23 23:14 UTC |
	|                | --kubernetes-version=v1.18.20            |                             |         |         |                     |                     |
	|                | --memory=4096 --wait=true                |                             |         |         |                     |                     |
	|                | --alsologtostderr                        |                             |         |         |                     |                     |
	|                | -v=5 --driver=docker                     |                             |         |         |                     |                     |
	|                | --container-runtime=docker               |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-324087              | ingress-addon-legacy-324087 | jenkins | v1.32.0 | 07 Nov 23 23:14 UTC | 07 Nov 23 23:14 UTC |
	|                | addons enable ingress                    |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-324087              | ingress-addon-legacy-324087 | jenkins | v1.32.0 | 07 Nov 23 23:14 UTC | 07 Nov 23 23:14 UTC |
	|                | addons enable ingress-dns                |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |
	| ssh            | ingress-addon-legacy-324087              | ingress-addon-legacy-324087 | jenkins | v1.32.0 | 07 Nov 23 23:15 UTC | 07 Nov 23 23:15 UTC |
	|                | ssh curl -s http://127.0.0.1/            |                             |         |         |                     |                     |
	|                | -H 'Host: nginx.example.com'             |                             |         |         |                     |                     |
	| ip             | ingress-addon-legacy-324087 ip           | ingress-addon-legacy-324087 | jenkins | v1.32.0 | 07 Nov 23 23:15 UTC | 07 Nov 23 23:15 UTC |
	| addons         | ingress-addon-legacy-324087              | ingress-addon-legacy-324087 | jenkins | v1.32.0 | 07 Nov 23 23:15 UTC | 07 Nov 23 23:15 UTC |
	|                | addons disable ingress-dns               |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-324087              | ingress-addon-legacy-324087 | jenkins | v1.32.0 | 07 Nov 23 23:15 UTC | 07 Nov 23 23:15 UTC |
	|                | addons disable ingress                   |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |
	|----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/07 23:12:22
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.21.3 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1107 23:12:22.700142   56054 out.go:296] Setting OutFile to fd 1 ...
	I1107 23:12:22.700338   56054 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:12:22.700347   56054 out.go:309] Setting ErrFile to fd 2...
	I1107 23:12:22.700353   56054 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:12:22.700716   56054 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
	I1107 23:12:22.701201   56054 out.go:303] Setting JSON to false
	I1107 23:12:22.702383   56054 start.go:128] hostinfo: {"hostname":"ip-172-31-30-239","uptime":3079,"bootTime":1699395664,"procs":355,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1049-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I1107 23:12:22.702475   56054 start.go:138] virtualization:  
	I1107 23:12:22.705755   56054 out.go:177] * [ingress-addon-legacy-324087] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	I1107 23:12:22.708362   56054 out.go:177]   - MINIKUBE_LOCATION=17585
	I1107 23:12:22.708501   56054 notify.go:220] Checking for updates...
	I1107 23:12:22.710161   56054 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1107 23:12:22.712026   56054 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	I1107 23:12:22.713785   56054 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	I1107 23:12:22.715451   56054 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1107 23:12:22.717228   56054 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1107 23:12:22.719431   56054 driver.go:378] Setting default libvirt URI to qemu:///system
	I1107 23:12:22.743557   56054 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1107 23:12:22.743672   56054 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:12:22.836226   56054 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-11-07 23:12:22.826333788 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:12:22.836329   56054 docker.go:295] overlay module found
	I1107 23:12:22.838631   56054 out.go:177] * Using the docker driver based on user configuration
	I1107 23:12:22.840305   56054 start.go:298] selected driver: docker
	I1107 23:12:22.840322   56054 start.go:902] validating driver "docker" against <nil>
	I1107 23:12:22.840334   56054 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1107 23:12:22.840939   56054 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:12:22.922523   56054 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-11-07 23:12:22.912902417 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:12:22.922684   56054 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1107 23:12:22.922917   56054 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1107 23:12:22.924978   56054 out.go:177] * Using Docker driver with root privileges
	I1107 23:12:22.926781   56054 cni.go:84] Creating CNI manager for ""
	I1107 23:12:22.926808   56054 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1107 23:12:22.926820   56054 start_flags.go:323] config:
	{Name:ingress-addon-legacy-324087 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-324087 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:doc
ker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:12:22.929117   56054 out.go:177] * Starting control plane node ingress-addon-legacy-324087 in cluster ingress-addon-legacy-324087
	I1107 23:12:22.930871   56054 cache.go:121] Beginning downloading kic base image for docker with docker
	I1107 23:12:22.932520   56054 out.go:177] * Pulling base image ...
	I1107 23:12:22.934250   56054 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1107 23:12:22.934335   56054 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local docker daemon
	I1107 23:12:22.955594   56054 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local docker daemon, skipping pull
	I1107 23:12:22.955617   56054 cache.go:144] gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 exists in daemon, skipping load
	I1107 23:12:23.006946   56054 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I1107 23:12:23.006976   56054 cache.go:56] Caching tarball of preloaded images
	I1107 23:12:23.007139   56054 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1107 23:12:23.009365   56054 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I1107 23:12:23.011156   56054 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:12:23.156144   56054 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4?checksum=md5:c8c260b886393123ce9d312d8ac2379e -> /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I1107 23:12:32.489834   56054 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:12:32.489940   56054 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:12:33.599929   56054 cache.go:59] Finished verifying existence of preloaded tar for  v1.18.20 on docker
	I1107 23:12:33.600378   56054 profile.go:148] Saving config to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/config.json ...
	I1107 23:12:33.600412   56054 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/config.json: {Name:mk51f828ce053ecfaa51117b9b53e16fef6d255e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:12:33.600590   56054 cache.go:194] Successfully downloaded all kic artifacts
	I1107 23:12:33.600648   56054 start.go:365] acquiring machines lock for ingress-addon-legacy-324087: {Name:mke98cada4156779d5ace41843ccec824d8ed521 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1107 23:12:33.600706   56054 start.go:369] acquired machines lock for "ingress-addon-legacy-324087" in 44.029µs
	I1107 23:12:33.600727   56054 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-324087 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-324087 Namespace:default APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1107 23:12:33.600798   56054 start.go:125] createHost starting for "" (driver="docker")
	I1107 23:12:33.603448   56054 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I1107 23:12:33.603682   56054 start.go:159] libmachine.API.Create for "ingress-addon-legacy-324087" (driver="docker")
	I1107 23:12:33.603713   56054 client.go:168] LocalClient.Create starting
	I1107 23:12:33.603786   56054 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem
	I1107 23:12:33.603822   56054 main.go:141] libmachine: Decoding PEM data...
	I1107 23:12:33.603842   56054 main.go:141] libmachine: Parsing certificate...
	I1107 23:12:33.603919   56054 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem
	I1107 23:12:33.603945   56054 main.go:141] libmachine: Decoding PEM data...
	I1107 23:12:33.603960   56054 main.go:141] libmachine: Parsing certificate...
	I1107 23:12:33.604317   56054 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-324087 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W1107 23:12:33.622423   56054 cli_runner.go:211] docker network inspect ingress-addon-legacy-324087 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I1107 23:12:33.622510   56054 network_create.go:281] running [docker network inspect ingress-addon-legacy-324087] to gather additional debugging logs...
	I1107 23:12:33.622531   56054 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-324087
	W1107 23:12:33.640452   56054 cli_runner.go:211] docker network inspect ingress-addon-legacy-324087 returned with exit code 1
	I1107 23:12:33.640479   56054 network_create.go:284] error running [docker network inspect ingress-addon-legacy-324087]: docker network inspect ingress-addon-legacy-324087: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-324087 not found
	I1107 23:12:33.640491   56054 network_create.go:286] output of [docker network inspect ingress-addon-legacy-324087]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-324087 not found
	
	** /stderr **
	I1107 23:12:33.640589   56054 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1107 23:12:33.658042   56054 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400062fce0}
	I1107 23:12:33.658084   56054 network_create.go:124] attempt to create docker network ingress-addon-legacy-324087 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I1107 23:12:33.658143   56054 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-324087 ingress-addon-legacy-324087
	I1107 23:12:33.727146   56054 network_create.go:108] docker network ingress-addon-legacy-324087 192.168.49.0/24 created
	I1107 23:12:33.727181   56054 kic.go:121] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-324087" container
	I1107 23:12:33.727263   56054 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I1107 23:12:33.743960   56054 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-324087 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-324087 --label created_by.minikube.sigs.k8s.io=true
	I1107 23:12:33.763770   56054 oci.go:103] Successfully created a docker volume ingress-addon-legacy-324087
	I1107 23:12:33.763855   56054 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-324087-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-324087 --entrypoint /usr/bin/test -v ingress-addon-legacy-324087:/var gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -d /var/lib
	I1107 23:12:35.110182   56054 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-324087-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-324087 --entrypoint /usr/bin/test -v ingress-addon-legacy-324087:/var gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -d /var/lib: (1.346251658s)
	I1107 23:12:35.110352   56054 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-324087
	I1107 23:12:35.110372   56054 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1107 23:12:35.110394   56054 kic.go:194] Starting extracting preloaded images to volume ...
	I1107 23:12:35.110511   56054 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-324087:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir
	I1107 23:12:39.771571   56054 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-324087:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir: (4.661017848s)
	I1107 23:12:39.771599   56054 kic.go:203] duration metric: took 4.661204 seconds to extract preloaded images to volume
	W1107 23:12:39.771737   56054 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I1107 23:12:39.771859   56054 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I1107 23:12:39.842682   56054 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-324087 --name ingress-addon-legacy-324087 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-324087 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-324087 --network ingress-addon-legacy-324087 --ip 192.168.49.2 --volume ingress-addon-legacy-324087:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0
	I1107 23:12:40.252689   56054 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-324087 --format={{.State.Running}}
	I1107 23:12:40.275756   56054 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-324087 --format={{.State.Status}}
	I1107 23:12:40.301093   56054 cli_runner.go:164] Run: docker exec ingress-addon-legacy-324087 stat /var/lib/dpkg/alternatives/iptables
	I1107 23:12:40.379091   56054 oci.go:144] the created container "ingress-addon-legacy-324087" has a running status.
	I1107 23:12:40.379125   56054 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa...
	I1107 23:12:41.267341   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I1107 23:12:41.267391   56054 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I1107 23:12:41.292982   56054 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-324087 --format={{.State.Status}}
	I1107 23:12:41.335776   56054 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I1107 23:12:41.335797   56054 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-324087 chown docker:docker /home/docker/.ssh/authorized_keys]
	I1107 23:12:41.430443   56054 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-324087 --format={{.State.Status}}
	I1107 23:12:41.453034   56054 machine.go:88] provisioning docker machine ...
	I1107 23:12:41.453081   56054 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-324087"
	I1107 23:12:41.453176   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:41.474375   56054 main.go:141] libmachine: Using SSH client type: native
	I1107 23:12:41.474809   56054 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32792 <nil> <nil>}
	I1107 23:12:41.474823   56054 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-324087 && echo "ingress-addon-legacy-324087" | sudo tee /etc/hostname
	I1107 23:12:41.629620   56054 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-324087
	
	I1107 23:12:41.629737   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:41.652003   56054 main.go:141] libmachine: Using SSH client type: native
	I1107 23:12:41.652451   56054 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32792 <nil> <nil>}
	I1107 23:12:41.652474   56054 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-324087' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-324087/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-324087' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1107 23:12:41.789187   56054 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1107 23:12:41.789216   56054 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17585-2228/.minikube CaCertPath:/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17585-2228/.minikube}
	I1107 23:12:41.789235   56054 ubuntu.go:177] setting up certificates
	I1107 23:12:41.789245   56054 provision.go:83] configureAuth start
	I1107 23:12:41.789308   56054 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-324087
	I1107 23:12:41.807915   56054 provision.go:138] copyHostCerts
	I1107 23:12:41.807961   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17585-2228/.minikube/key.pem
	I1107 23:12:41.807993   56054 exec_runner.go:144] found /home/jenkins/minikube-integration/17585-2228/.minikube/key.pem, removing ...
	I1107 23:12:41.808005   56054 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17585-2228/.minikube/key.pem
	I1107 23:12:41.808082   56054 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17585-2228/.minikube/key.pem (1679 bytes)
	I1107 23:12:41.808165   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17585-2228/.minikube/ca.pem
	I1107 23:12:41.808188   56054 exec_runner.go:144] found /home/jenkins/minikube-integration/17585-2228/.minikube/ca.pem, removing ...
	I1107 23:12:41.808196   56054 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17585-2228/.minikube/ca.pem
	I1107 23:12:41.808227   56054 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17585-2228/.minikube/ca.pem (1082 bytes)
	I1107 23:12:41.808281   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17585-2228/.minikube/cert.pem
	I1107 23:12:41.808301   56054 exec_runner.go:144] found /home/jenkins/minikube-integration/17585-2228/.minikube/cert.pem, removing ...
	I1107 23:12:41.808309   56054 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17585-2228/.minikube/cert.pem
	I1107 23:12:41.808334   56054 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17585-2228/.minikube/cert.pem (1123 bytes)
	I1107 23:12:41.808383   56054 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17585-2228/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-324087 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-324087]
	I1107 23:12:42.803226   56054 provision.go:172] copyRemoteCerts
	I1107 23:12:42.803297   56054 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1107 23:12:42.803347   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:42.822066   56054 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32792 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa Username:docker}
	I1107 23:12:42.914557   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I1107 23:12:42.914614   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I1107 23:12:42.943037   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/machines/server.pem -> /etc/docker/server.pem
	I1107 23:12:42.943100   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)
	I1107 23:12:42.971796   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I1107 23:12:42.971857   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I1107 23:12:43.004148   56054 provision.go:86] duration metric: configureAuth took 1.214885267s
	I1107 23:12:43.004174   56054 ubuntu.go:193] setting minikube options for container-runtime
	I1107 23:12:43.004507   56054 config.go:182] Loaded profile config "ingress-addon-legacy-324087": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1107 23:12:43.004606   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:43.023422   56054 main.go:141] libmachine: Using SSH client type: native
	I1107 23:12:43.023838   56054 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32792 <nil> <nil>}
	I1107 23:12:43.023855   56054 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I1107 23:12:43.149690   56054 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I1107 23:12:43.149713   56054 ubuntu.go:71] root file system type: overlay
	I1107 23:12:43.149838   56054 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I1107 23:12:43.149909   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:43.168601   56054 main.go:141] libmachine: Using SSH client type: native
	I1107 23:12:43.169028   56054 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32792 <nil> <nil>}
	I1107 23:12:43.169112   56054 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I1107 23:12:43.315362   56054 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I1107 23:12:43.315454   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:43.335120   56054 main.go:141] libmachine: Using SSH client type: native
	I1107 23:12:43.335546   56054 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3bdf40] 0x3c06b0 <nil>  [] 0s} 127.0.0.1 32792 <nil> <nil>}
	I1107 23:12:43.335571   56054 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I1107 23:12:44.169440   56054 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-10-26 09:06:20.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-11-07 23:12:43.310854095 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I1107 23:12:44.169472   56054 machine.go:91] provisioned docker machine in 2.716414687s
	I1107 23:12:44.169482   56054 client.go:171] LocalClient.Create took 10.565763174s
	I1107 23:12:44.169505   56054 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-324087" took 10.56581782s
	I1107 23:12:44.169515   56054 start.go:300] post-start starting for "ingress-addon-legacy-324087" (driver="docker")
	I1107 23:12:44.169534   56054 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1107 23:12:44.169606   56054 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1107 23:12:44.169651   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:44.188964   56054 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32792 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa Username:docker}
	I1107 23:12:44.286721   56054 ssh_runner.go:195] Run: cat /etc/os-release
	I1107 23:12:44.291034   56054 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I1107 23:12:44.291071   56054 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I1107 23:12:44.291103   56054 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I1107 23:12:44.291114   56054 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I1107 23:12:44.291125   56054 filesync.go:126] Scanning /home/jenkins/minikube-integration/17585-2228/.minikube/addons for local assets ...
	I1107 23:12:44.291201   56054 filesync.go:126] Scanning /home/jenkins/minikube-integration/17585-2228/.minikube/files for local assets ...
	I1107 23:12:44.291278   56054 filesync.go:149] local asset: /home/jenkins/minikube-integration/17585-2228/.minikube/files/etc/ssl/certs/75272.pem -> 75272.pem in /etc/ssl/certs
	I1107 23:12:44.291289   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/files/etc/ssl/certs/75272.pem -> /etc/ssl/certs/75272.pem
	I1107 23:12:44.291388   56054 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I1107 23:12:44.302120   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/files/etc/ssl/certs/75272.pem --> /etc/ssl/certs/75272.pem (1708 bytes)
	I1107 23:12:44.331035   56054 start.go:303] post-start completed in 161.493097ms
	I1107 23:12:44.331451   56054 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-324087
	I1107 23:12:44.349456   56054 profile.go:148] Saving config to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/config.json ...
	I1107 23:12:44.349759   56054 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1107 23:12:44.349812   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:44.367817   56054 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32792 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa Username:docker}
	I1107 23:12:44.458013   56054 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I1107 23:12:44.463947   56054 start.go:128] duration metric: createHost completed in 10.863134414s
	I1107 23:12:44.463979   56054 start.go:83] releasing machines lock for "ingress-addon-legacy-324087", held for 10.863253905s
	I1107 23:12:44.464047   56054 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-324087
	I1107 23:12:44.482464   56054 ssh_runner.go:195] Run: cat /version.json
	I1107 23:12:44.482520   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:44.482743   56054 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1107 23:12:44.482796   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:12:44.509589   56054 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32792 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa Username:docker}
	I1107 23:12:44.524696   56054 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32792 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa Username:docker}
	I1107 23:12:44.795089   56054 ssh_runner.go:195] Run: systemctl --version
	I1107 23:12:44.800700   56054 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I1107 23:12:44.806209   56054 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I1107 23:12:44.836449   56054 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I1107 23:12:44.836547   56054 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I1107 23:12:44.857404   56054 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I1107 23:12:44.877843   56054 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I1107 23:12:44.877871   56054 start.go:472] detecting cgroup driver to use...
	I1107 23:12:44.877903   56054 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I1107 23:12:44.878003   56054 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1107 23:12:44.900014   56054 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I1107 23:12:44.912292   56054 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1107 23:12:44.924336   56054 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I1107 23:12:44.924416   56054 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1107 23:12:44.936383   56054 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1107 23:12:44.948031   56054 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1107 23:12:44.959752   56054 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1107 23:12:44.972409   56054 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1107 23:12:44.984648   56054 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1107 23:12:45.013880   56054 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1107 23:12:45.041821   56054 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1107 23:12:45.061751   56054 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1107 23:12:45.248807   56054 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1107 23:12:45.390822   56054 start.go:472] detecting cgroup driver to use...
	I1107 23:12:45.390873   56054 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I1107 23:12:45.390940   56054 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I1107 23:12:45.425484   56054 cruntime.go:279] skipping containerd shutdown because we are bound to it
	I1107 23:12:45.426162   56054 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1107 23:12:45.453736   56054 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock
	" | sudo tee /etc/crictl.yaml"
	I1107 23:12:45.480885   56054 ssh_runner.go:195] Run: which cri-dockerd
	I1107 23:12:45.486658   56054 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I1107 23:12:45.508561   56054 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I1107 23:12:45.536589   56054 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I1107 23:12:45.651764   56054 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I1107 23:12:45.754790   56054 docker.go:560] configuring docker to use "cgroupfs" as cgroup driver...
	I1107 23:12:45.754987   56054 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I1107 23:12:45.779286   56054 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1107 23:12:45.880048   56054 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1107 23:12:46.178730   56054 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1107 23:12:46.208789   56054 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1107 23:12:46.243547   56054 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 24.0.7 ...
	I1107 23:12:46.243638   56054 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-324087 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1107 23:12:46.261978   56054 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I1107 23:12:46.266807   56054 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1107 23:12:46.280644   56054 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1107 23:12:46.280714   56054 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1107 23:12:46.303096   56054 docker.go:671] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I1107 23:12:46.303117   56054 docker.go:677] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I1107 23:12:46.303185   56054 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1107 23:12:46.314499   56054 ssh_runner.go:195] Run: which lz4
	I1107 23:12:46.319235   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4
	I1107 23:12:46.319334   56054 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I1107 23:12:46.324005   56054 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I1107 23:12:46.324043   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (459739018 bytes)
	I1107 23:12:48.408695   56054 docker.go:635] Took 2.089393 seconds to copy over tarball
	I1107 23:12:48.408827   56054 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I1107 23:12:50.893455   56054 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.484576971s)
	I1107 23:12:50.893501   56054 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I1107 23:12:50.968251   56054 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1107 23:12:50.979184   56054 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)
	I1107 23:12:51.002411   56054 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1107 23:12:51.106648   56054 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1107 23:12:53.774349   56054 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.667658085s)
	I1107 23:12:53.774437   56054 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1107 23:12:53.796289   56054 docker.go:671] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I1107 23:12:53.796309   56054 docker.go:677] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I1107 23:12:53.796319   56054 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I1107 23:12:53.798450   56054 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I1107 23:12:53.798450   56054 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I1107 23:12:53.798621   56054 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I1107 23:12:53.798724   56054 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I1107 23:12:53.798750   56054 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I1107 23:12:53.798791   56054 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I1107 23:12:53.798836   56054 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I1107 23:12:53.798880   56054 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1107 23:12:53.800275   56054 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	I1107 23:12:53.800316   56054 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I1107 23:12:53.800364   56054 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I1107 23:12:53.800408   56054 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1107 23:12:53.800448   56054 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I1107 23:12:53.800280   56054 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	I1107 23:12:53.800679   56054 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	I1107 23:12:53.800698   56054 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	I1107 23:12:54.338459   56054 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2
	I1107 23:12:54.362392   56054 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime
	I1107 23:12:54.362445   56054 docker.go:323] Removing image: registry.k8s.io/pause:3.2
	I1107 23:12:54.362509   56054 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2
	W1107 23:12:54.368507   56054 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing
	I1107 23:12:54.368815   56054 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0
	I1107 23:12:54.394143   56054 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2
	I1107 23:12:54.404705   56054 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime
	I1107 23:12:54.404810   56054 docker.go:323] Removing image: registry.k8s.io/etcd:3.4.3-0
	I1107 23:12:54.404873   56054 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0
	W1107 23:12:54.407301   56054 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing
	I1107 23:12:54.407583   56054 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7
	W1107 23:12:54.413817   56054 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I1107 23:12:54.414072   56054 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20
	W1107 23:12:54.417076   56054 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I1107 23:12:54.417330   56054 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20
	W1107 23:12:54.422106   56054 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I1107 23:12:54.422355   56054 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20
	W1107 23:12:54.428409   56054 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I1107 23:12:54.428822   56054 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0
	I1107 23:12:54.429060   56054 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20
	I1107 23:12:54.453331   56054 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime
	I1107 23:12:54.453374   56054 docker.go:323] Removing image: registry.k8s.io/coredns:1.6.7
	I1107 23:12:54.453431   56054 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7
	I1107 23:12:54.507428   56054 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime
	I1107 23:12:54.507480   56054 docker.go:323] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I1107 23:12:54.507501   56054 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime
	I1107 23:12:54.507540   56054 docker.go:323] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I1107 23:12:54.507585   56054 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime
	I1107 23:12:54.507614   56054 docker.go:323] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I1107 23:12:54.507639   56054 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20
	I1107 23:12:54.507675   56054 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime
	I1107 23:12:54.507704   56054 docker.go:323] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I1107 23:12:54.507642   56054 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20
	I1107 23:12:54.507732   56054 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20
	I1107 23:12:54.507770   56054 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7
	I1107 23:12:54.507550   56054 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I1107 23:12:54.560869   56054 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20
	I1107 23:12:54.561065   56054 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20
	I1107 23:12:54.565783   56054 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20
	I1107 23:12:54.565911   56054 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20
	W1107 23:12:55.505674   56054 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I1107 23:12:55.505842   56054 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I1107 23:12:55.527415   56054 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I1107 23:12:55.527463   56054 docker.go:323] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1107 23:12:55.527514   56054 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I1107 23:12:55.565515   56054 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I1107 23:12:55.565592   56054 cache_images.go:92] LoadImages completed in 1.769248367s
	W1107 23:12:55.565649   56054 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17585-2228/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2: no such file or directory
	I1107 23:12:55.565710   56054 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I1107 23:12:55.631490   56054 cni.go:84] Creating CNI manager for ""
	I1107 23:12:55.631518   56054 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1107 23:12:55.631546   56054 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I1107 23:12:55.631573   56054 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-324087 NodeName:ingress-addon-legacy-324087 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.
crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I1107 23:12:55.631735   56054 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /var/run/dockershim.sock
	  name: "ingress-addon-legacy-324087"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1107 23:12:55.631807   56054 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-324087 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-324087 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I1107 23:12:55.631916   56054 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I1107 23:12:55.642827   56054 binaries.go:44] Found k8s binaries, skipping transfer
	I1107 23:12:55.642903   56054 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1107 23:12:55.653400   56054 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (354 bytes)
	I1107 23:12:55.674947   56054 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I1107 23:12:55.696651   56054 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2124 bytes)
	I1107 23:12:55.718310   56054 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I1107 23:12:55.723021   56054 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1107 23:12:55.736621   56054 certs.go:56] Setting up /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087 for IP: 192.168.49.2
	I1107 23:12:55.736656   56054 certs.go:190] acquiring lock for shared ca certs: {Name:mk9a3e4d35b7079db49eb191a7c695fba58dc729 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:12:55.736802   56054 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17585-2228/.minikube/ca.key
	I1107 23:12:55.736858   56054 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.key
	I1107 23:12:55.736932   56054 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.key
	I1107 23:12:55.736947   56054 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt with IP's: []
	I1107 23:12:56.005877   56054 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt ...
	I1107 23:12:56.005912   56054 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: {Name:mke289be0f3cff0133c548624c13b99a66fe7c08 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:12:56.006108   56054 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.key ...
	I1107 23:12:56.006118   56054 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.key: {Name:mk8de88476015c460a8765bb01dc94a6bc35bb0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:12:56.006196   56054 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.key.dd3b5fb2
	I1107 23:12:56.006214   56054 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I1107 23:12:56.705665   56054 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.crt.dd3b5fb2 ...
	I1107 23:12:56.705697   56054 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.crt.dd3b5fb2: {Name:mk8d46878727d919e53e20ff5eddc4a4107521c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:12:56.705881   56054 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.key.dd3b5fb2 ...
	I1107 23:12:56.705897   56054 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.key.dd3b5fb2: {Name:mkc0481a82afe8f87ca1fde742db32fcea08d340 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:12:56.706052   56054 certs.go:337] copying /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.crt
	I1107 23:12:56.706146   56054 certs.go:341] copying /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.key
	I1107 23:12:56.706207   56054 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.key
	I1107 23:12:56.706219   56054 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.crt with IP's: []
	I1107 23:12:56.882446   56054 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.crt ...
	I1107 23:12:56.882480   56054 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.crt: {Name:mke38068e26c048e88b575663aafc8a028da7f6e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:12:56.882670   56054 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.key ...
	I1107 23:12:56.882687   56054 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.key: {Name:mk76a6530ff63294ca5d45234d3f1161e663c158 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:12:56.882791   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I1107 23:12:56.882834   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I1107 23:12:56.882849   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I1107 23:12:56.882862   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I1107 23:12:56.882884   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I1107 23:12:56.882899   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I1107 23:12:56.882910   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I1107 23:12:56.882926   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I1107 23:12:56.882989   56054 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/7527.pem (1338 bytes)
	W1107 23:12:56.883033   56054 certs.go:433] ignoring /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/7527_empty.pem, impossibly tiny 0 bytes
	I1107 23:12:56.883047   56054 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca-key.pem (1679 bytes)
	I1107 23:12:56.883074   56054 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/ca.pem (1082 bytes)
	I1107 23:12:56.883098   56054 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/cert.pem (1123 bytes)
	I1107 23:12:56.883127   56054 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/home/jenkins/minikube-integration/17585-2228/.minikube/certs/key.pem (1679 bytes)
	I1107 23:12:56.883179   56054 certs.go:437] found cert: /home/jenkins/minikube-integration/17585-2228/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17585-2228/.minikube/files/etc/ssl/certs/75272.pem (1708 bytes)
	I1107 23:12:56.883219   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I1107 23:12:56.883234   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/certs/7527.pem -> /usr/share/ca-certificates/7527.pem
	I1107 23:12:56.883250   56054 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17585-2228/.minikube/files/etc/ssl/certs/75272.pem -> /usr/share/ca-certificates/75272.pem
	I1107 23:12:56.883841   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I1107 23:12:56.914859   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I1107 23:12:56.944629   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1107 23:12:56.973431   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I1107 23:12:57.010720   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1107 23:12:57.044127   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I1107 23:12:57.076476   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1107 23:12:57.110022   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I1107 23:12:57.140752   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1107 23:12:57.171297   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/certs/7527.pem --> /usr/share/ca-certificates/7527.pem (1338 bytes)
	I1107 23:12:57.200435   56054 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17585-2228/.minikube/files/etc/ssl/certs/75272.pem --> /usr/share/ca-certificates/75272.pem (1708 bytes)
	I1107 23:12:57.230163   56054 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I1107 23:12:57.252496   56054 ssh_runner.go:195] Run: openssl version
	I1107 23:12:57.259651   56054 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7527.pem && ln -fs /usr/share/ca-certificates/7527.pem /etc/ssl/certs/7527.pem"
	I1107 23:12:57.271481   56054 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7527.pem
	I1107 23:12:57.276192   56054 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Nov  7 23:07 /usr/share/ca-certificates/7527.pem
	I1107 23:12:57.276260   56054 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7527.pem
	I1107 23:12:57.285074   56054 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7527.pem /etc/ssl/certs/51391683.0"
	I1107 23:12:57.297407   56054 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/75272.pem && ln -fs /usr/share/ca-certificates/75272.pem /etc/ssl/certs/75272.pem"
	I1107 23:12:57.309959   56054 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/75272.pem
	I1107 23:12:57.315458   56054 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Nov  7 23:07 /usr/share/ca-certificates/75272.pem
	I1107 23:12:57.315595   56054 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/75272.pem
	I1107 23:12:57.325855   56054 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/75272.pem /etc/ssl/certs/3ec20f2e.0"
	I1107 23:12:57.338074   56054 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1107 23:12:57.350315   56054 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1107 23:12:57.355375   56054 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Nov  7 23:02 /usr/share/ca-certificates/minikubeCA.pem
	I1107 23:12:57.355517   56054 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1107 23:12:57.364832   56054 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1107 23:12:57.376834   56054 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I1107 23:12:57.381474   56054 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I1107 23:12:57.381548   56054 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-324087 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-324087 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMe
trics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:12:57.381678   56054 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1107 23:12:57.402885   56054 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1107 23:12:57.413723   56054 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1107 23:12:57.424662   56054 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I1107 23:12:57.424738   56054 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1107 23:12:57.435818   56054 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1107 23:12:57.435937   56054 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I1107 23:12:57.494155   56054 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I1107 23:12:57.494309   56054 kubeadm.go:322] [preflight] Running pre-flight checks
	I1107 23:12:57.724643   56054 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I1107 23:12:57.724714   56054 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1049-aws
	I1107 23:12:57.724764   56054 kubeadm.go:322] DOCKER_VERSION: 24.0.7
	I1107 23:12:57.724800   56054 kubeadm.go:322] OS: Linux
	I1107 23:12:57.724846   56054 kubeadm.go:322] CGROUPS_CPU: enabled
	I1107 23:12:57.724894   56054 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I1107 23:12:57.724942   56054 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I1107 23:12:57.724991   56054 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I1107 23:12:57.725041   56054 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I1107 23:12:57.725089   56054 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I1107 23:12:57.817343   56054 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1107 23:12:57.817449   56054 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1107 23:12:57.817548   56054 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1107 23:12:58.039858   56054 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1107 23:12:58.041458   56054 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1107 23:12:58.041775   56054 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I1107 23:12:58.156286   56054 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1107 23:12:58.158522   56054 out.go:204]   - Generating certificates and keys ...
	I1107 23:12:58.158666   56054 kubeadm.go:322] [certs] Using existing ca certificate authority
	I1107 23:12:58.158731   56054 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I1107 23:12:58.608520   56054 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I1107 23:12:58.903617   56054 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I1107 23:12:59.516785   56054 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I1107 23:13:00.125952   56054 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I1107 23:13:00.461870   56054 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I1107 23:13:00.462629   56054 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-324087 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I1107 23:13:00.804278   56054 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I1107 23:13:00.804608   56054 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-324087 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I1107 23:13:01.026514   56054 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I1107 23:13:01.524446   56054 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I1107 23:13:01.885778   56054 kubeadm.go:322] [certs] Generating "sa" key and public key
	I1107 23:13:01.886174   56054 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1107 23:13:02.720913   56054 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1107 23:13:03.498743   56054 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1107 23:13:03.919737   56054 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1107 23:13:04.750607   56054 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1107 23:13:04.751408   56054 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1107 23:13:04.754198   56054 out.go:204]   - Booting up control plane ...
	I1107 23:13:04.754308   56054 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1107 23:13:04.768794   56054 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1107 23:13:04.768879   56054 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1107 23:13:04.768961   56054 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1107 23:13:04.769755   56054 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1107 23:13:17.272854   56054 kubeadm.go:322] [apiclient] All control plane components are healthy after 12.502594 seconds
	I1107 23:13:17.272967   56054 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1107 23:13:17.292379   56054 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I1107 23:13:17.812480   56054 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I1107 23:13:17.812622   56054 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-324087 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I1107 23:13:18.321873   56054 kubeadm.go:322] [bootstrap-token] Using token: 5e6p6j.dpvxo2mc07bn9n3g
	I1107 23:13:18.324369   56054 out.go:204]   - Configuring RBAC rules ...
	I1107 23:13:18.324508   56054 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1107 23:13:18.334891   56054 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1107 23:13:18.344886   56054 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1107 23:13:18.350656   56054 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1107 23:13:18.356030   56054 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1107 23:13:18.359387   56054 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1107 23:13:18.372368   56054 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1107 23:13:18.690053   56054 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I1107 23:13:18.755713   56054 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I1107 23:13:18.757524   56054 kubeadm.go:322] 
	I1107 23:13:18.757597   56054 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I1107 23:13:18.757609   56054 kubeadm.go:322] 
	I1107 23:13:18.757682   56054 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I1107 23:13:18.757691   56054 kubeadm.go:322] 
	I1107 23:13:18.757715   56054 kubeadm.go:322]   mkdir -p $HOME/.kube
	I1107 23:13:18.757790   56054 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1107 23:13:18.757843   56054 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1107 23:13:18.757852   56054 kubeadm.go:322] 
	I1107 23:13:18.757900   56054 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I1107 23:13:18.757974   56054 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1107 23:13:18.758042   56054 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1107 23:13:18.758050   56054 kubeadm.go:322] 
	I1107 23:13:18.758129   56054 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I1107 23:13:18.758209   56054 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I1107 23:13:18.758217   56054 kubeadm.go:322] 
	I1107 23:13:18.758296   56054 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 5e6p6j.dpvxo2mc07bn9n3g \
	I1107 23:13:18.758398   56054 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:5709f06d7c573117626cd7c3c456a905763e2bbcf0d8934c54d2ce325c654970 \
	I1107 23:13:18.758422   56054 kubeadm.go:322]     --control-plane 
	I1107 23:13:18.758431   56054 kubeadm.go:322] 
	I1107 23:13:18.758510   56054 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I1107 23:13:18.758518   56054 kubeadm.go:322] 
	I1107 23:13:18.758595   56054 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 5e6p6j.dpvxo2mc07bn9n3g \
	I1107 23:13:18.758696   56054 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:5709f06d7c573117626cd7c3c456a905763e2bbcf0d8934c54d2ce325c654970 
	I1107 23:13:18.762116   56054 kubeadm.go:322] W1107 23:12:57.493294    1654 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I1107 23:13:18.762296   56054 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
	I1107 23:13:18.762422   56054 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03
	I1107 23:13:18.762622   56054 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1049-aws\n", err: exit status 1
	I1107 23:13:18.762722   56054 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1107 23:13:18.762842   56054 kubeadm.go:322] W1107 23:13:04.759890    1654 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I1107 23:13:18.762963   56054 kubeadm.go:322] W1107 23:13:04.762250    1654 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I1107 23:13:18.762985   56054 cni.go:84] Creating CNI manager for ""
	I1107 23:13:18.763001   56054 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1107 23:13:18.763021   56054 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1107 23:13:18.763143   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:18.763223   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=693359050ae80510825facc3cb57aa024560c29e minikube.k8s.io/name=ingress-addon-legacy-324087 minikube.k8s.io/updated_at=2023_11_07T23_13_18_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:19.224023   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:19.224087   56054 ops.go:34] apiserver oom_adj: -16
	I1107 23:13:19.335278   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:19.938630   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:20.438866   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:20.938819   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:21.438430   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:21.938363   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:22.438291   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:22.938755   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:23.438105   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:23.939129   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:24.438135   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:24.938789   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:25.438971   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:25.938921   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:26.438140   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:26.938923   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:27.438718   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:27.939128   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:28.438152   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:28.938487   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:29.438329   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:29.938718   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:30.438993   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:30.938560   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:31.438705   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:31.938585   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:32.438765   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:32.938781   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:33.438693   56054 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1107 23:13:33.556313   56054 kubeadm.go:1081] duration metric: took 14.793217494s to wait for elevateKubeSystemPrivileges.
	I1107 23:13:33.556359   56054 kubeadm.go:406] StartCluster complete in 36.174800917s
	I1107 23:13:33.556377   56054 settings.go:142] acquiring lock: {Name:mk04f69aac041878e83c593ab0ff1a4dc1e5fd90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:13:33.556440   56054 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17585-2228/kubeconfig
	I1107 23:13:33.557139   56054 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/kubeconfig: {Name:mkcb24add64bda4b558c43079a598eaa18708a06 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:13:33.557965   56054 kapi.go:59] client config for ingress-addon-legacy-324087: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt", KeyFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.key", CAFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(ni
l), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16bdc10), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1107 23:13:33.559354   56054 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I1107 23:13:33.559612   56054 config.go:182] Loaded profile config "ingress-addon-legacy-324087": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1107 23:13:33.559653   56054 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false]
	I1107 23:13:33.559720   56054 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-324087"
	I1107 23:13:33.559736   56054 addons.go:231] Setting addon storage-provisioner=true in "ingress-addon-legacy-324087"
	I1107 23:13:33.559773   56054 host.go:66] Checking if "ingress-addon-legacy-324087" exists ...
	I1107 23:13:33.560282   56054 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-324087 --format={{.State.Status}}
	I1107 23:13:33.560359   56054 cert_rotation.go:137] Starting client certificate rotation controller
	I1107 23:13:33.560392   56054 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-324087"
	I1107 23:13:33.560406   56054 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-324087"
	I1107 23:13:33.560698   56054 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-324087 --format={{.State.Status}}
	I1107 23:13:33.596719   56054 kapi.go:59] client config for ingress-addon-legacy-324087: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt", KeyFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.key", CAFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(ni
l), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16bdc10), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1107 23:13:33.596990   56054 addons.go:231] Setting addon default-storageclass=true in "ingress-addon-legacy-324087"
	I1107 23:13:33.597020   56054 host.go:66] Checking if "ingress-addon-legacy-324087" exists ...
	I1107 23:13:33.600273   56054 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-324087 --format={{.State.Status}}
	I1107 23:13:33.637187   56054 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1107 23:13:33.639801   56054 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1107 23:13:33.639824   56054 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1107 23:13:33.639920   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:13:33.655932   56054 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I1107 23:13:33.655952   56054 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1107 23:13:33.656010   56054 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-324087
	I1107 23:13:33.676531   56054 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-324087" context rescaled to 1 replicas
	I1107 23:13:33.676569   56054 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1107 23:13:33.678725   56054 out.go:177] * Verifying Kubernetes components...
	I1107 23:13:33.680927   56054 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1107 23:13:33.678096   56054 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32792 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa Username:docker}
	I1107 23:13:33.700357   56054 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32792 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/ingress-addon-legacy-324087/id_rsa Username:docker}
	I1107 23:13:33.913918   56054 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1107 23:13:33.917196   56054 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I1107 23:13:33.918029   56054 kapi.go:59] client config for ingress-addon-legacy-324087: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt", KeyFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.key", CAFile:"/home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(ni
l), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16bdc10), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1107 23:13:33.918370   56054 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-324087" to be "Ready" ...
	I1107 23:13:33.921927   56054 node_ready.go:49] node "ingress-addon-legacy-324087" has status "Ready":"True"
	I1107 23:13:33.921996   56054 node_ready.go:38] duration metric: took 3.574929ms waiting for node "ingress-addon-legacy-324087" to be "Ready" ...
	I1107 23:13:33.922022   56054 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1107 23:13:33.930562   56054 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-m82vj" in "kube-system" namespace to be "Ready" ...
	I1107 23:13:33.941033   56054 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1107 23:13:34.807494   56054 start.go:926] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I1107 23:13:34.830890   56054 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I1107 23:13:34.833424   56054 addons.go:502] enable addons completed in 1.273760435s: enabled=[storage-provisioner default-storageclass]
	I1107 23:13:35.963363   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:37.968037   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:40.463393   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:42.465501   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:44.964001   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:47.464099   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:49.962844   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:51.963317   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:54.463255   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:56.464013   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:13:58.964038   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:00.964231   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:03.464017   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:05.963250   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:07.963955   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:10.469210   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:12.963540   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:14.963972   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:17.464324   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:19.963442   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:21.964126   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:24.463950   56054 pod_ready.go:102] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"False"
	I1107 23:14:25.464236   56054 pod_ready.go:92] pod "coredns-66bff467f8-m82vj" in "kube-system" namespace has status "Ready":"True"
	I1107 23:14:25.464265   56054 pod_ready.go:81] duration metric: took 51.533622553s waiting for pod "coredns-66bff467f8-m82vj" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.464278   56054 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-324087" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.469631   56054 pod_ready.go:92] pod "etcd-ingress-addon-legacy-324087" in "kube-system" namespace has status "Ready":"True"
	I1107 23:14:25.469659   56054 pod_ready.go:81] duration metric: took 5.373786ms waiting for pod "etcd-ingress-addon-legacy-324087" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.469679   56054 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-324087" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.538251   56054 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-324087" in "kube-system" namespace has status "Ready":"True"
	I1107 23:14:25.538341   56054 pod_ready.go:81] duration metric: took 68.652724ms waiting for pod "kube-apiserver-ingress-addon-legacy-324087" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.538370   56054 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-324087" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.548623   56054 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-324087" in "kube-system" namespace has status "Ready":"True"
	I1107 23:14:25.548708   56054 pod_ready.go:81] duration metric: took 10.292661ms waiting for pod "kube-controller-manager-ingress-addon-legacy-324087" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.548736   56054 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-thc4l" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.553944   56054 pod_ready.go:92] pod "kube-proxy-thc4l" in "kube-system" namespace has status "Ready":"True"
	I1107 23:14:25.554015   56054 pod_ready.go:81] duration metric: took 5.259356ms waiting for pod "kube-proxy-thc4l" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.554041   56054 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-324087" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.658335   56054 request.go:629] Waited for 104.20812ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-324087
	I1107 23:14:25.858788   56054 request.go:629] Waited for 197.384254ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-324087
	I1107 23:14:25.861545   56054 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-324087" in "kube-system" namespace has status "Ready":"True"
	I1107 23:14:25.861569   56054 pod_ready.go:81] duration metric: took 307.509735ms waiting for pod "kube-scheduler-ingress-addon-legacy-324087" in "kube-system" namespace to be "Ready" ...
	I1107 23:14:25.861580   56054 pod_ready.go:38] duration metric: took 51.93951602s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1107 23:14:25.861597   56054 api_server.go:52] waiting for apiserver process to appear ...
	I1107 23:14:25.861660   56054 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1107 23:14:25.875650   56054 api_server.go:72] duration metric: took 52.199046559s to wait for apiserver process to appear ...
	I1107 23:14:25.875676   56054 api_server.go:88] waiting for apiserver healthz status ...
	I1107 23:14:25.875694   56054 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I1107 23:14:25.885058   56054 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I1107 23:14:25.885963   56054 api_server.go:141] control plane version: v1.18.20
	I1107 23:14:25.885996   56054 api_server.go:131] duration metric: took 10.312681ms to wait for apiserver health ...
	I1107 23:14:25.886005   56054 system_pods.go:43] waiting for kube-system pods to appear ...
	I1107 23:14:26.058352   56054 request.go:629] Waited for 172.270762ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I1107 23:14:26.064138   56054 system_pods.go:59] 7 kube-system pods found
	I1107 23:14:26.064177   56054 system_pods.go:61] "coredns-66bff467f8-m82vj" [4cdb062b-bf7b-4c80-9605-ec43c5c20b01] Running
	I1107 23:14:26.064184   56054 system_pods.go:61] "etcd-ingress-addon-legacy-324087" [337b57c3-c8d6-4565-a8b1-daa981eaa5ec] Running
	I1107 23:14:26.064190   56054 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-324087" [ed0484b0-87f5-41a1-a638-374edb3882c8] Running
	I1107 23:14:26.064197   56054 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-324087" [1853a37d-1380-4aa5-a3e4-d640f072a7dc] Running
	I1107 23:14:26.064202   56054 system_pods.go:61] "kube-proxy-thc4l" [1faed6d9-7012-4db4-bbba-5b66bd639d11] Running
	I1107 23:14:26.064207   56054 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-324087" [f0bba364-0f60-4ac4-89b6-e4ca6e3c252a] Running
	I1107 23:14:26.064217   56054 system_pods.go:61] "storage-provisioner" [e5f566cf-da24-46f6-93f4-e389f0432bea] Running
	I1107 23:14:26.064223   56054 system_pods.go:74] duration metric: took 178.213502ms to wait for pod list to return data ...
	I1107 23:14:26.064243   56054 default_sa.go:34] waiting for default service account to be created ...
	I1107 23:14:26.258656   56054 request.go:629] Waited for 194.342611ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I1107 23:14:26.261037   56054 default_sa.go:45] found service account: "default"
	I1107 23:14:26.261063   56054 default_sa.go:55] duration metric: took 196.812855ms for default service account to be created ...
	I1107 23:14:26.261073   56054 system_pods.go:116] waiting for k8s-apps to be running ...
	I1107 23:14:26.458356   56054 request.go:629] Waited for 197.223875ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I1107 23:14:26.464034   56054 system_pods.go:86] 7 kube-system pods found
	I1107 23:14:26.464062   56054 system_pods.go:89] "coredns-66bff467f8-m82vj" [4cdb062b-bf7b-4c80-9605-ec43c5c20b01] Running
	I1107 23:14:26.464070   56054 system_pods.go:89] "etcd-ingress-addon-legacy-324087" [337b57c3-c8d6-4565-a8b1-daa981eaa5ec] Running
	I1107 23:14:26.464076   56054 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-324087" [ed0484b0-87f5-41a1-a638-374edb3882c8] Running
	I1107 23:14:26.464101   56054 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-324087" [1853a37d-1380-4aa5-a3e4-d640f072a7dc] Running
	I1107 23:14:26.464112   56054 system_pods.go:89] "kube-proxy-thc4l" [1faed6d9-7012-4db4-bbba-5b66bd639d11] Running
	I1107 23:14:26.464118   56054 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-324087" [f0bba364-0f60-4ac4-89b6-e4ca6e3c252a] Running
	I1107 23:14:26.464123   56054 system_pods.go:89] "storage-provisioner" [e5f566cf-da24-46f6-93f4-e389f0432bea] Running
	I1107 23:14:26.464134   56054 system_pods.go:126] duration metric: took 203.055771ms to wait for k8s-apps to be running ...
	I1107 23:14:26.464147   56054 system_svc.go:44] waiting for kubelet service to be running ....
	I1107 23:14:26.464212   56054 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1107 23:14:26.478251   56054 system_svc.go:56] duration metric: took 14.094822ms WaitForService to wait for kubelet.
	I1107 23:14:26.478318   56054 kubeadm.go:581] duration metric: took 52.801720281s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I1107 23:14:26.478343   56054 node_conditions.go:102] verifying NodePressure condition ...
	I1107 23:14:26.658740   56054 request.go:629] Waited for 180.329889ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I1107 23:14:26.661724   56054 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I1107 23:14:26.661757   56054 node_conditions.go:123] node cpu capacity is 2
	I1107 23:14:26.661768   56054 node_conditions.go:105] duration metric: took 183.420501ms to run NodePressure ...
	I1107 23:14:26.661783   56054 start.go:228] waiting for startup goroutines ...
	I1107 23:14:26.661790   56054 start.go:233] waiting for cluster config update ...
	I1107 23:14:26.661800   56054 start.go:242] writing updated cluster config ...
	I1107 23:14:26.662098   56054 ssh_runner.go:195] Run: rm -f paused
	I1107 23:14:26.723935   56054 start.go:600] kubectl: 1.28.3, cluster: 1.18.20 (minor skew: 10)
	I1107 23:14:26.726451   56054 out.go:177] 
	W1107 23:14:26.728578   56054 out.go:239] ! /usr/local/bin/kubectl is version 1.28.3, which may have incompatibilities with Kubernetes 1.18.20.
	I1107 23:14:26.730742   56054 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I1107 23:14:26.732957   56054 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-324087" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Nov 07 23:12:53 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:12:53.740235874Z" level=info msg="Docker daemon" commit=311b9ff graphdriver=overlay2 version=24.0.7
	Nov 07 23:12:53 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:12:53.740301819Z" level=info msg="Daemon has completed initialization"
	Nov 07 23:12:53 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:12:53.771170371Z" level=info msg="API listen on /var/run/docker.sock"
	Nov 07 23:12:53 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:12:53.771280320Z" level=info msg="API listen on [::]:2376"
	Nov 07 23:12:53 ingress-addon-legacy-324087 systemd[1]: Started Docker Application Container Engine.
	Nov 07 23:14:28 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:28.383547314Z" level=warning msg="reference for unknown type: " digest="sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7" remote="docker.io/jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7"
	Nov 07 23:14:30 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:30.699486356Z" level=info msg="ignoring event" container=dd669f8d81dafe00aaf9cc6bc0f1080e80bcb94a69c1ead641549033153a35f7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:14:30 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:30.780828088Z" level=info msg="ignoring event" container=079817c5448316b5e42c0c3ca44eea9fe15af8d2d19f5db9ff5492d357cc35a4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:14:31 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:31.382313657Z" level=info msg="ignoring event" container=7b31916a255f8865cdb95882de789e49b373369cab3132c15e21274db77e7026 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:14:31 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:31.385457248Z" level=info msg="ignoring event" container=3463d4f874f116951a3f66a88252aa2a0caab17c361821a116efa111e6cbad8b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:14:31 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:31.969757507Z" level=warning msg="reference for unknown type: " digest="sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324" remote="registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324"
	Nov 07 23:14:39 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:39.770965387Z" level=warning msg="Published ports are discarded when using host network mode"
	Nov 07 23:14:39 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:39.809234530Z" level=warning msg="Published ports are discarded when using host network mode"
	Nov 07 23:14:40 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:40.065828870Z" level=warning msg="reference for unknown type: " digest="sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" remote="docker.io/cryptexlabs/minikube-ingress-dns@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab"
	Nov 07 23:14:47 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:47.315728838Z" level=info msg="ignoring event" container=f1039c909ce28f9fd3934f1f82a9732169324864747eee73ebca465b39f47011 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:14:47 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:14:47.628793038Z" level=info msg="ignoring event" container=1c25907843407c0133b5bf79d7420b39268eb7ef8da9d3a6c8cb6f3a38e38077 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:15:01 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:01.417287848Z" level=info msg="ignoring event" container=fc526099f08504c6eae02d7ee1fdd9398391713f73fcd4c3edbcfbf32e785f17 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:15:06 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:06.268996515Z" level=info msg="ignoring event" container=f8ede2d75506a5135de188a906e5fb57f24029a6aafad383bc841d49881f2a62 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:15:06 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:06.841421441Z" level=info msg="ignoring event" container=270d65ab95d53b888cc7cc71ebd5b06b9072e002e6b0d3a9da396f6fe890d5cb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:15:18 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:18.312861919Z" level=info msg="ignoring event" container=e522103da23dc17c2dc2cc26ed6d559f7f67c4269a7dfae6c316aeda5f4ca44c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:15:21 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:21.407461971Z" level=info msg="ignoring event" container=89940e18b967ead5509e84f09611c407d90d1f68d007a2aa6d3d0fbc49504803 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:15:25 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:25.214351871Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=08bb8157cb1414ee28b72532d184d87d8b77f7dee733e32f9e507dece52d1dda
	Nov 07 23:15:25 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:25.237662597Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=08bb8157cb1414ee28b72532d184d87d8b77f7dee733e32f9e507dece52d1dda
	Nov 07 23:15:25 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:25.291234742Z" level=info msg="ignoring event" container=08bb8157cb1414ee28b72532d184d87d8b77f7dee733e32f9e507dece52d1dda module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 07 23:15:25 ingress-addon-legacy-324087 dockerd[1300]: time="2023-11-07T23:15:25.361339820Z" level=info msg="ignoring event" container=dd32a339dc7c9419ed6766b3bb44e147ee7d975dc790b17eff17a439a47eab00 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                              CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	89940e18b967e       dd1b12fcb6097                                                                                                      9 seconds ago        Exited              hello-world-app           2                   142a13fe71015       hello-world-app-5f5d8b66bb-tkztg
	a11698837ec44       nginx@sha256:db353d0f0c479c91bd15e01fc68ed0f33d9c4c52f3415e63332c3d0bf7a4bb77                                      35 seconds ago       Running             nginx                     0                   6880b3b50a489       nginx
	08bb8157cb141       registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324   53 seconds ago       Exited              controller                0                   dd32a339dc7c9       ingress-nginx-controller-7fcf777cb7-9qvkm
	079817c544831       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              patch                     0                   7b31916a255f8       ingress-nginx-admission-patch-hvkv2
	dd669f8d81daf       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              create                    0                   3463d4f874f11       ingress-nginx-admission-create-g2jw9
	4e539404433e9       gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944    About a minute ago   Running             storage-provisioner       0                   0d357f0133aab       storage-provisioner
	2c3db53224579       6e17ba78cf3eb                                                                                                      About a minute ago   Running             coredns                   0                   340b7f2d1ef1b       coredns-66bff467f8-m82vj
	5f934e6b34ed4       565297bc6f7d4                                                                                                      About a minute ago   Running             kube-proxy                0                   62eabfb22aec7       kube-proxy-thc4l
	b63d8c20b5e5c       095f37015706d                                                                                                      2 minutes ago        Running             kube-scheduler            0                   fa71e7d3534ab       kube-scheduler-ingress-addon-legacy-324087
	1633e3c4f2f21       ab707b0a0ea33                                                                                                      2 minutes ago        Running             etcd                      0                   efaa8db06c0b6       etcd-ingress-addon-legacy-324087
	98c4ede1137cd       68a4fac29a865                                                                                                      2 minutes ago        Running             kube-controller-manager   0                   2226b0647adcc       kube-controller-manager-ingress-addon-legacy-324087
	5cc11beaba189       2694cf044d665                                                                                                      2 minutes ago        Running             kube-apiserver            0                   4042290728cf7       kube-apiserver-ingress-addon-legacy-324087
	
	* 
	* ==> coredns [2c3db5322457] <==
	* [INFO] 172.17.0.1:56926 - 19849 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000058134s
	[INFO] 172.17.0.1:49862 - 51478 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000035897s
	[INFO] 172.17.0.1:53901 - 46046 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002529362s
	[INFO] 172.17.0.1:49862 - 35336 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000045038s
	[INFO] 172.17.0.1:49862 - 22027 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000051734s
	[INFO] 172.17.0.1:56926 - 48687 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001092886s
	[INFO] 172.17.0.1:49862 - 45835 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000041715s
	[INFO] 172.17.0.1:53901 - 14915 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001574126s
	[INFO] 172.17.0.1:53901 - 4644 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000120682s
	[INFO] 172.17.0.1:49862 - 24254 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000030523s
	[INFO] 172.17.0.1:56926 - 43091 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001022724s
	[INFO] 172.17.0.1:56926 - 36036 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000045825s
	[INFO] 172.17.0.1:49862 - 52733 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000027562s
	[INFO] 172.17.0.1:2961 - 10239 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.0000341s
	[INFO] 172.17.0.1:2961 - 25468 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000042478s
	[INFO] 172.17.0.1:2961 - 7212 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000067151s
	[INFO] 172.17.0.1:2961 - 55393 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000065986s
	[INFO] 172.17.0.1:49862 - 57715 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001309255s
	[INFO] 172.17.0.1:2961 - 54321 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000353683s
	[INFO] 172.17.0.1:49862 - 59237 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001039495s
	[INFO] 172.17.0.1:49862 - 7428 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000165022s
	[INFO] 172.17.0.1:2961 - 33674 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000042191s
	[INFO] 172.17.0.1:2961 - 18761 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001081496s
	[INFO] 172.17.0.1:2961 - 46578 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000819982s
	[INFO] 172.17.0.1:2961 - 7735 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000042462s
	
	* 
	* ==> describe nodes <==
	* Name:               ingress-addon-legacy-324087
	Roles:              master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=ingress-addon-legacy-324087
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=693359050ae80510825facc3cb57aa024560c29e
	                    minikube.k8s.io/name=ingress-addon-legacy-324087
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_11_07T23_13_18_0700
	                    minikube.k8s.io/version=v1.32.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Tue, 07 Nov 2023 23:13:15 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-324087
	  AcquireTime:     <unset>
	  RenewTime:       Tue, 07 Nov 2023 23:15:22 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Tue, 07 Nov 2023 23:15:22 +0000   Tue, 07 Nov 2023 23:13:08 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Tue, 07 Nov 2023 23:15:22 +0000   Tue, 07 Nov 2023 23:13:08 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Tue, 07 Nov 2023 23:15:22 +0000   Tue, 07 Nov 2023 23:13:08 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Tue, 07 Nov 2023 23:15:22 +0000   Tue, 07 Nov 2023 23:13:32 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-324087
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022500Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022500Ki
	  pods:               110
	System Info:
	  Machine ID:                 d5a1b56ae3c14caf97e44e281088c758
	  System UUID:                a09b857e-6c45-4efc-84e7-4b899fa638cf
	  Boot ID:                    b70576f7-d3d1-43e3-aa81-4f6e70603af6
	  Kernel Version:             5.15.0-1049-aws
	  OS Image:                   Ubuntu 22.04.3 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.7
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-tkztg                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         29s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39s
	  kube-system                 coredns-66bff467f8-m82vj                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     118s
	  kube-system                 etcd-ingress-addon-legacy-324087                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m9s
	  kube-system                 kube-apiserver-ingress-addon-legacy-324087             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m9s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-324087    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m9s
	  kube-system                 kube-proxy-thc4l                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         118s
	  kube-system                 kube-scheduler-ingress-addon-legacy-324087             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m9s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         117s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)
	  memory             70Mi (0%!)(MISSING)   170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From        Message
	  ----    ------                   ----                   ----        -------
	  Normal  NodeHasSufficientMemory  2m24s (x4 over 2m24s)  kubelet     Node ingress-addon-legacy-324087 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m24s (x4 over 2m24s)  kubelet     Node ingress-addon-legacy-324087 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m24s (x3 over 2m24s)  kubelet     Node ingress-addon-legacy-324087 status is now: NodeHasSufficientPID
	  Normal  Starting                 2m9s                   kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m9s                   kubelet     Node ingress-addon-legacy-324087 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m9s                   kubelet     Node ingress-addon-legacy-324087 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m9s                   kubelet     Node ingress-addon-legacy-324087 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             2m9s                   kubelet     Node ingress-addon-legacy-324087 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  2m9s                   kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                119s                   kubelet     Node ingress-addon-legacy-324087 status is now: NodeReady
	  Normal  Starting                 117s                   kube-proxy  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +0.000739] FS-Cache: N-cookie c=0000000c [p=00000003 fl=2 nc=0 na=1]
	[  +0.000982] FS-Cache: N-cookie d=00000000638441a6{9p.inode} n=000000002cc58566
	[  +0.001114] FS-Cache: N-key=[8] '936ced0000000000'
	[  +0.005375] FS-Cache: Duplicate cookie detected
	[  +0.000729] FS-Cache: O-cookie c=00000006 [p=00000003 fl=226 nc=0 na=1]
	[  +0.001045] FS-Cache: O-cookie d=00000000638441a6{9p.inode} n=0000000055e0bf8d
	[  +0.001083] FS-Cache: O-key=[8] '936ced0000000000'
	[  +0.000734] FS-Cache: N-cookie c=0000000d [p=00000003 fl=2 nc=0 na=1]
	[  +0.000967] FS-Cache: N-cookie d=00000000638441a6{9p.inode} n=00000000bf1d78c1
	[  +0.001121] FS-Cache: N-key=[8] '936ced0000000000'
	[  +1.834043] FS-Cache: Duplicate cookie detected
	[  +0.000733] FS-Cache: O-cookie c=00000004 [p=00000003 fl=226 nc=0 na=1]
	[  +0.001000] FS-Cache: O-cookie d=00000000638441a6{9p.inode} n=000000003be9b999
	[  +0.001182] FS-Cache: O-key=[8] '926ced0000000000'
	[  +0.000761] FS-Cache: N-cookie c=0000000f [p=00000003 fl=2 nc=0 na=1]
	[  +0.000979] FS-Cache: N-cookie d=00000000638441a6{9p.inode} n=00000000f2038d7d
	[  +0.001102] FS-Cache: N-key=[8] '926ced0000000000'
	[  +0.326153] FS-Cache: Duplicate cookie detected
	[  +0.000756] FS-Cache: O-cookie c=00000009 [p=00000003 fl=226 nc=0 na=1]
	[  +0.001012] FS-Cache: O-cookie d=00000000638441a6{9p.inode} n=000000009f18296c
	[  +0.001124] FS-Cache: O-key=[8] '9a6ced0000000000'
	[  +0.000734] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
	[  +0.000995] FS-Cache: N-cookie d=00000000638441a6{9p.inode} n=000000007982252f
	[  +0.001090] FS-Cache: N-key=[8] '9a6ced0000000000'
	[Nov 7 23:13] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
	
	* 
	* ==> etcd [1633e3c4f2f2] <==
	* raft2023/11/07 23:13:10 INFO: aec36adc501070cc became follower at term 0
	raft2023/11/07 23:13:10 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	raft2023/11/07 23:13:10 INFO: aec36adc501070cc became follower at term 1
	raft2023/11/07 23:13:10 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-11-07 23:13:11.084942 W | auth: simple token is not cryptographically signed
	2023-11-07 23:13:11.093173 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	2023-11-07 23:13:11.095815 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2023-11-07 23:13:11.096276 I | embed: listening for metrics on http://127.0.0.1:2381
	2023-11-07 23:13:11.096726 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	2023-11-07 23:13:11.097339 I | embed: listening for peers on 192.168.49.2:2380
	raft2023/11/07 23:13:11 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-11-07 23:13:11.097978 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	raft2023/11/07 23:13:11 INFO: aec36adc501070cc is starting a new election at term 1
	raft2023/11/07 23:13:11 INFO: aec36adc501070cc became candidate at term 2
	raft2023/11/07 23:13:11 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2023/11/07 23:13:11 INFO: aec36adc501070cc became leader at term 2
	raft2023/11/07 23:13:11 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2023-11-07 23:13:11.496147 I | etcdserver: setting up the initial cluster version to 3.4
	2023-11-07 23:13:11.497137 N | etcdserver/membership: set the initial cluster version to 3.4
	2023-11-07 23:13:11.497191 I | etcdserver/api: enabled capabilities for version 3.4
	2023-11-07 23:13:11.497221 I | etcdserver: published {Name:ingress-addon-legacy-324087 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2023-11-07 23:13:11.497344 I | embed: ready to serve client requests
	2023-11-07 23:13:11.498773 I | embed: serving client requests on 192.168.49.2:2379
	2023-11-07 23:13:11.498835 I | embed: ready to serve client requests
	2023-11-07 23:13:11.499954 I | embed: serving client requests on 127.0.0.1:2379
	
	* 
	* ==> kernel <==
	*  23:15:31 up 54 min,  0 users,  load average: 0.74, 1.37, 1.17
	Linux ingress-addon-legacy-324087 5.15.0-1049-aws #54~20.04.1-Ubuntu SMP Fri Oct 6 22:07:16 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.3 LTS"
	
	* 
	* ==> kube-apiserver [5cc11beaba18] <==
	* I1107 23:13:15.627792       1 dynamic_cafile_content.go:167] Starting request-header::/var/lib/minikube/certs/front-proxy-ca.crt
	E1107 23:13:15.639911       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.49.2, ResourceVersion: 0, AdditionalErrorMsg: 
	I1107 23:13:15.768868       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I1107 23:13:15.770777       1 cache.go:39] Caches are synced for autoregister controller
	I1107 23:13:15.771246       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I1107 23:13:15.774135       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I1107 23:13:15.780962       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I1107 23:13:16.555273       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I1107 23:13:16.555487       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I1107 23:13:16.564307       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I1107 23:13:16.570042       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I1107 23:13:16.570067       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I1107 23:13:17.086711       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I1107 23:13:17.131094       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W1107 23:13:17.284461       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I1107 23:13:17.285602       1 controller.go:609] quota admission added evaluator for: endpoints
	I1107 23:13:17.293137       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I1107 23:13:17.494689       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I1107 23:13:17.930259       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I1107 23:13:18.668497       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I1107 23:13:18.741908       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I1107 23:13:33.585750       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I1107 23:13:33.733053       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I1107 23:14:27.592265       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I1107 23:14:52.489894       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	
	* 
	* ==> kube-controller-manager [98c4ede1137c] <==
	* I1107 23:13:33.692630       1 node_lifecycle_controller.go:1433] Initializing eviction metric for zone: 
	W1107 23:13:33.692674       1 node_lifecycle_controller.go:1048] Missing timestamp for Node ingress-addon-legacy-324087. Assuming now as a timestamp.
	I1107 23:13:33.692717       1 node_lifecycle_controller.go:1249] Controller detected that zone  is now in state Normal.
	I1107 23:13:33.693125       1 taint_manager.go:187] Starting NoExecuteTaintManager
	I1107 23:13:33.693550       1 event.go:278] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"ingress-addon-legacy-324087", UID:"7193077e-49ae-4655-b625-64473cb71a53", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node ingress-addon-legacy-324087 event: Registered Node ingress-addon-legacy-324087 in Controller
	I1107 23:13:33.726647       1 shared_informer.go:230] Caches are synced for deployment 
	I1107 23:13:33.776644       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"0f40ff7f-a4ca-4fef-98ef-d6c5800a8ab9", APIVersion:"apps/v1", ResourceVersion:"331", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-66bff467f8 to 1
	I1107 23:13:33.780926       1 shared_informer.go:230] Caches are synced for disruption 
	I1107 23:13:33.780944       1 disruption.go:339] Sending events to api server.
	I1107 23:13:33.788995       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"d70f924c-139d-4406-85b7-ecd76bceb99e", APIVersion:"apps/v1", ResourceVersion:"339", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-66bff467f8-m82vj
	I1107 23:13:33.927680       1 shared_informer.go:230] Caches are synced for resource quota 
	I1107 23:13:33.939834       1 shared_informer.go:230] Caches are synced for garbage collector 
	I1107 23:13:33.939855       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I1107 23:13:33.981393       1 shared_informer.go:230] Caches are synced for resource quota 
	I1107 23:13:34.080340       1 request.go:621] Throttling request took 1.035165728s, request: GET:https://control-plane.minikube.internal:8443/apis/storage.k8s.io/v1beta1?timeout=32s
	I1107 23:13:34.531919       1 shared_informer.go:223] Waiting for caches to sync for garbage collector
	I1107 23:13:34.531967       1 shared_informer.go:230] Caches are synced for garbage collector 
	I1107 23:14:27.582492       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"17fcba71-9cc3-498d-9813-6d15afc31cc2", APIVersion:"apps/v1", ResourceVersion:"460", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I1107 23:14:27.616577       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"72915674-f990-4ca7-a7a5-0de8dd8e0393", APIVersion:"apps/v1", ResourceVersion:"461", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-9qvkm
	I1107 23:14:27.652060       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"246cbeaf-a7d3-422f-885b-285d112929aa", APIVersion:"batch/v1", ResourceVersion:"462", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-g2jw9
	I1107 23:14:27.715254       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"b30a0464-aa39-4526-a06f-565d4e75f34d", APIVersion:"batch/v1", ResourceVersion:"478", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-hvkv2
	I1107 23:14:31.305446       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"246cbeaf-a7d3-422f-885b-285d112929aa", APIVersion:"batch/v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I1107 23:14:31.349850       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"b30a0464-aa39-4526-a06f-565d4e75f34d", APIVersion:"batch/v1", ResourceVersion:"486", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I1107 23:15:02.295055       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"ae330df4-5307-4a2f-a369-7ede246649dc", APIVersion:"apps/v1", ResourceVersion:"597", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	I1107 23:15:02.313740       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"d156452f-fab7-41a3-af8f-deba98cb93a6", APIVersion:"apps/v1", ResourceVersion:"598", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-tkztg
	
	* 
	* ==> kube-proxy [5f934e6b34ed] <==
	* W1107 23:13:34.930447       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I1107 23:13:34.943232       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I1107 23:13:34.943283       1 server_others.go:186] Using iptables Proxier.
	I1107 23:13:34.944866       1 server.go:583] Version: v1.18.20
	I1107 23:13:34.947259       1 config.go:315] Starting service config controller
	I1107 23:13:34.947333       1 shared_informer.go:223] Waiting for caches to sync for service config
	I1107 23:13:34.948351       1 config.go:133] Starting endpoints config controller
	I1107 23:13:34.948374       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I1107 23:13:35.047609       1 shared_informer.go:230] Caches are synced for service config 
	I1107 23:13:35.048510       1 shared_informer.go:230] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [b63d8c20b5e5] <==
	* I1107 23:13:10.097018       1 serving.go:313] Generated self-signed cert in-memory
	W1107 23:13:15.683197       1 authentication.go:349] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W1107 23:13:15.683419       1 authentication.go:297] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W1107 23:13:15.683517       1 authentication.go:298] Continuing without authentication configuration. This may treat all requests as anonymous.
	W1107 23:13:15.683606       1 authentication.go:299] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I1107 23:13:15.734678       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I1107 23:13:15.734898       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I1107 23:13:15.736987       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
	I1107 23:13:15.744219       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1107 23:13:15.744413       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1107 23:13:15.744539       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E1107 23:13:15.763642       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E1107 23:13:15.763803       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E1107 23:13:15.764014       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1107 23:13:15.764130       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E1107 23:13:15.764433       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E1107 23:13:15.764678       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E1107 23:13:15.764884       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E1107 23:13:15.765074       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E1107 23:13:15.765292       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E1107 23:13:15.769240       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E1107 23:13:15.776170       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E1107 23:13:15.776476       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E1107 23:13:16.863346       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	I1107 23:13:17.344628       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* Nov 07 23:15:08 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:08.732383    2839 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 270d65ab95d53b888cc7cc71ebd5b06b9072e002e6b0d3a9da396f6fe890d5cb
	Nov 07 23:15:08 ingress-addon-legacy-324087 kubelet[2839]: E1107 23:15:08.732642    2839 pod_workers.go:191] Error syncing pod 20382d8b-1e84-4c35-a116-ef1e3cc2c1f3 ("hello-world-app-5f5d8b66bb-tkztg_default(20382d8b-1e84-4c35-a116-ef1e3cc2c1f3)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-tkztg_default(20382d8b-1e84-4c35-a116-ef1e3cc2c1f3)"
	Nov 07 23:15:14 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:14.270633    2839 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: fc526099f08504c6eae02d7ee1fdd9398391713f73fcd4c3edbcfbf32e785f17
	Nov 07 23:15:14 ingress-addon-legacy-324087 kubelet[2839]: E1107 23:15:14.270953    2839 pod_workers.go:191] Error syncing pod 0b5b18cc-53dd-4930-9f78-42536c4c2679 ("kube-ingress-dns-minikube_kube-system(0b5b18cc-53dd-4930-9f78-42536c4c2679)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with CrashLoopBackOff: "back-off 20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(0b5b18cc-53dd-4930-9f78-42536c4c2679)"
	Nov 07 23:15:18 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:18.254852    2839 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-569k6" (UniqueName: "kubernetes.io/secret/0b5b18cc-53dd-4930-9f78-42536c4c2679-minikube-ingress-dns-token-569k6") pod "0b5b18cc-53dd-4930-9f78-42536c4c2679" (UID: "0b5b18cc-53dd-4930-9f78-42536c4c2679")
	Nov 07 23:15:18 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:18.259300    2839 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b5b18cc-53dd-4930-9f78-42536c4c2679-minikube-ingress-dns-token-569k6" (OuterVolumeSpecName: "minikube-ingress-dns-token-569k6") pod "0b5b18cc-53dd-4930-9f78-42536c4c2679" (UID: "0b5b18cc-53dd-4930-9f78-42536c4c2679"). InnerVolumeSpecName "minikube-ingress-dns-token-569k6". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Nov 07 23:15:18 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:18.355174    2839 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-569k6" (UniqueName: "kubernetes.io/secret/0b5b18cc-53dd-4930-9f78-42536c4c2679-minikube-ingress-dns-token-569k6") on node "ingress-addon-legacy-324087" DevicePath ""
	Nov 07 23:15:18 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:18.821197    2839 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: fc526099f08504c6eae02d7ee1fdd9398391713f73fcd4c3edbcfbf32e785f17
	Nov 07 23:15:21 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:21.270605    2839 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 270d65ab95d53b888cc7cc71ebd5b06b9072e002e6b0d3a9da396f6fe890d5cb
	Nov 07 23:15:21 ingress-addon-legacy-324087 kubelet[2839]: W1107 23:15:21.436192    2839 container.go:412] Failed to create summary reader for "/kubepods/besteffort/pod20382d8b-1e84-4c35-a116-ef1e3cc2c1f3/89940e18b967ead5509e84f09611c407d90d1f68d007a2aa6d3d0fbc49504803": none of the resources are being tracked.
	Nov 07 23:15:21 ingress-addon-legacy-324087 kubelet[2839]: W1107 23:15:21.849682    2839 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-tkztg through plugin: invalid network status for
	Nov 07 23:15:21 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:21.855395    2839 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 270d65ab95d53b888cc7cc71ebd5b06b9072e002e6b0d3a9da396f6fe890d5cb
	Nov 07 23:15:21 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:21.855724    2839 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 89940e18b967ead5509e84f09611c407d90d1f68d007a2aa6d3d0fbc49504803
	Nov 07 23:15:21 ingress-addon-legacy-324087 kubelet[2839]: E1107 23:15:21.856035    2839 pod_workers.go:191] Error syncing pod 20382d8b-1e84-4c35-a116-ef1e3cc2c1f3 ("hello-world-app-5f5d8b66bb-tkztg_default(20382d8b-1e84-4c35-a116-ef1e3cc2c1f3)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-tkztg_default(20382d8b-1e84-4c35-a116-ef1e3cc2c1f3)"
	Nov 07 23:15:22 ingress-addon-legacy-324087 kubelet[2839]: W1107 23:15:22.864776    2839 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-tkztg through plugin: invalid network status for
	Nov 07 23:15:23 ingress-addon-legacy-324087 kubelet[2839]: E1107 23:15:23.196390    2839 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-9qvkm.17957a511caa4daf", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-9qvkm", UID:"6d80227c-cf3a-4cb3-8630-f550fe384530", APIVersion:"v1", ResourceVersion:"467", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-324087"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc14acf22cb919faf, ext:124614805950, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc14acf22cb919faf, ext:124614805950, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-9qvkm.17957a511caa4daf" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Nov 07 23:15:23 ingress-addon-legacy-324087 kubelet[2839]: E1107 23:15:23.217192    2839 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-9qvkm.17957a511caa4daf", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-9qvkm", UID:"6d80227c-cf3a-4cb3-8630-f550fe384530", APIVersion:"v1", ResourceVersion:"467", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-324087"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc14acf22cb919faf, ext:124614805950, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc14acf22cc11a17f, ext:124623195022, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-9qvkm.17957a511caa4daf" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Nov 07 23:15:25 ingress-addon-legacy-324087 kubelet[2839]: W1107 23:15:25.904985    2839 pod_container_deletor.go:77] Container "dd32a339dc7c9419ed6766b3bb44e147ee7d975dc790b17eff17a439a47eab00" not found in pod's containers
	Nov 07 23:15:27 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:27.383979    2839 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6d80227c-cf3a-4cb3-8630-f550fe384530-webhook-cert") pod "6d80227c-cf3a-4cb3-8630-f550fe384530" (UID: "6d80227c-cf3a-4cb3-8630-f550fe384530")
	Nov 07 23:15:27 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:27.384056    2839 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-pj8wg" (UniqueName: "kubernetes.io/secret/6d80227c-cf3a-4cb3-8630-f550fe384530-ingress-nginx-token-pj8wg") pod "6d80227c-cf3a-4cb3-8630-f550fe384530" (UID: "6d80227c-cf3a-4cb3-8630-f550fe384530")
	Nov 07 23:15:27 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:27.390759    2839 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d80227c-cf3a-4cb3-8630-f550fe384530-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6d80227c-cf3a-4cb3-8630-f550fe384530" (UID: "6d80227c-cf3a-4cb3-8630-f550fe384530"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Nov 07 23:15:27 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:27.392425    2839 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d80227c-cf3a-4cb3-8630-f550fe384530-ingress-nginx-token-pj8wg" (OuterVolumeSpecName: "ingress-nginx-token-pj8wg") pod "6d80227c-cf3a-4cb3-8630-f550fe384530" (UID: "6d80227c-cf3a-4cb3-8630-f550fe384530"). InnerVolumeSpecName "ingress-nginx-token-pj8wg". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Nov 07 23:15:27 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:27.484386    2839 reconciler.go:319] Volume detached for volume "ingress-nginx-token-pj8wg" (UniqueName: "kubernetes.io/secret/6d80227c-cf3a-4cb3-8630-f550fe384530-ingress-nginx-token-pj8wg") on node "ingress-addon-legacy-324087" DevicePath ""
	Nov 07 23:15:27 ingress-addon-legacy-324087 kubelet[2839]: I1107 23:15:27.484439    2839 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6d80227c-cf3a-4cb3-8630-f550fe384530-webhook-cert") on node "ingress-addon-legacy-324087" DevicePath ""
	Nov 07 23:15:28 ingress-addon-legacy-324087 kubelet[2839]: W1107 23:15:28.280175    2839 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/6d80227c-cf3a-4cb3-8630-f550fe384530/volumes" does not exist
	
	* 
	* ==> storage-provisioner [4e539404433e] <==
	* I1107 23:13:37.868941       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1107 23:13:37.881448       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1107 23:13:37.882698       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1107 23:13:37.890797       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1107 23:13:37.891313       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-324087_4aee98fa-da45-467c-b16f-1cf7f3e325ef!
	I1107 23:13:37.891564       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"4afccdbf-b5ac-4871-8049-963478f79710", APIVersion:"v1", ResourceVersion:"381", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-324087_4aee98fa-da45-467c-b16f-1cf7f3e325ef became leader
	I1107 23:13:37.993012       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-324087_4aee98fa-da45-467c-b16f-1cf7f3e325ef!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-324087 -n ingress-addon-legacy-324087
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-324087 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (52.64s)

                                                
                                    

Test pass (296/323)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 21.02
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.1
10 TestDownloadOnly/v1.28.3/json-events 10.69
11 TestDownloadOnly/v1.28.3/preload-exists 0
15 TestDownloadOnly/v1.28.3/LogsDuration 0.09
16 TestDownloadOnly/DeleteAll 0.25
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.19
19 TestBinaryMirror 0.71
20 TestOffline 103.13
23 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.09
24 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.1
25 TestAddons/Setup 147.76
27 TestAddons/parallel/Registry 15.37
29 TestAddons/parallel/InspektorGadget 10.84
30 TestAddons/parallel/MetricsServer 5.91
33 TestAddons/parallel/CSI 48.47
34 TestAddons/parallel/Headlamp 13.28
35 TestAddons/parallel/CloudSpanner 5.59
36 TestAddons/parallel/LocalPath 55.76
37 TestAddons/parallel/NvidiaDevicePlugin 5.64
40 TestAddons/serial/GCPAuth/Namespaces 0.19
41 TestAddons/StoppedEnableDisable 11.25
42 TestCertOptions 42.16
43 TestCertExpiration 261.24
44 TestDockerFlags 47.03
45 TestForceSystemdFlag 46.63
46 TestForceSystemdEnv 41.69
52 TestErrorSpam/setup 34.93
53 TestErrorSpam/start 0.93
54 TestErrorSpam/status 1.2
55 TestErrorSpam/pause 1.52
56 TestErrorSpam/unpause 1.65
57 TestErrorSpam/stop 11.12
60 TestFunctional/serial/CopySyncFile 0
61 TestFunctional/serial/StartWithProxy 86.15
62 TestFunctional/serial/AuditLog 0
63 TestFunctional/serial/SoftStart 35.87
64 TestFunctional/serial/KubeContext 0.08
65 TestFunctional/serial/KubectlGetPods 0.1
68 TestFunctional/serial/CacheCmd/cache/add_remote 4.14
69 TestFunctional/serial/CacheCmd/cache/add_local 1.31
70 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.08
71 TestFunctional/serial/CacheCmd/cache/list 0.07
72 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.39
73 TestFunctional/serial/CacheCmd/cache/cache_reload 2.02
74 TestFunctional/serial/CacheCmd/cache/delete 0.17
75 TestFunctional/serial/MinikubeKubectlCmd 0.17
76 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.16
77 TestFunctional/serial/ExtraConfig 44.24
78 TestFunctional/serial/ComponentHealth 0.11
79 TestFunctional/serial/LogsCmd 1.33
80 TestFunctional/serial/LogsFileCmd 1.41
81 TestFunctional/serial/InvalidService 4.47
83 TestFunctional/parallel/ConfigCmd 0.72
84 TestFunctional/parallel/DashboardCmd 11.87
85 TestFunctional/parallel/DryRun 0.79
86 TestFunctional/parallel/InternationalLanguage 0.35
87 TestFunctional/parallel/StatusCmd 1.21
91 TestFunctional/parallel/ServiceCmdConnect 8.74
92 TestFunctional/parallel/AddonsCmd 0.2
93 TestFunctional/parallel/PersistentVolumeClaim 28.82
95 TestFunctional/parallel/SSHCmd 0.8
96 TestFunctional/parallel/CpCmd 1.65
98 TestFunctional/parallel/FileSync 0.37
99 TestFunctional/parallel/CertSync 2.54
103 TestFunctional/parallel/NodeLabels 0.19
105 TestFunctional/parallel/NonActiveRuntimeDisabled 0.41
108 TestFunctional/parallel/Version/short 0.09
109 TestFunctional/parallel/Version/components 0.81
110 TestFunctional/parallel/ImageCommands/ImageListShort 0.31
111 TestFunctional/parallel/ImageCommands/ImageListTable 0.34
112 TestFunctional/parallel/ImageCommands/ImageListJson 0.32
113 TestFunctional/parallel/ImageCommands/ImageListYaml 0.34
114 TestFunctional/parallel/ImageCommands/ImageBuild 3.2
115 TestFunctional/parallel/ImageCommands/Setup 2.19
116 TestFunctional/parallel/DockerEnv/bash 1.41
117 TestFunctional/parallel/UpdateContextCmd/no_changes 0.26
118 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.28
119 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.29
120 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 4.43
121 TestFunctional/parallel/ServiceCmd/DeployApp 12.31
122 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 3.07
123 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 13.16
124 TestFunctional/parallel/ServiceCmd/List 0.39
125 TestFunctional/parallel/ServiceCmd/JSONOutput 0.42
126 TestFunctional/parallel/ServiceCmd/HTTPS 0.58
127 TestFunctional/parallel/ServiceCmd/Format 0.65
128 TestFunctional/parallel/ServiceCmd/URL 0.53
130 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.73
131 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
133 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 11.66
134 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.96
135 TestFunctional/parallel/ImageCommands/ImageRemove 0.64
136 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 1.71
137 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 1
138 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.11
139 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0.01
143 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
144 TestFunctional/parallel/ProfileCmd/profile_not_create 0.45
145 TestFunctional/parallel/ProfileCmd/profile_list 0.46
146 TestFunctional/parallel/ProfileCmd/profile_json_output 0.46
147 TestFunctional/parallel/MountCmd/any-port 7.4
148 TestFunctional/parallel/MountCmd/specific-port 2.08
149 TestFunctional/parallel/MountCmd/VerifyCleanup 1.58
150 TestFunctional/delete_addon-resizer_images 0.09
151 TestFunctional/delete_my-image_image 0.02
152 TestFunctional/delete_minikube_cached_images 0.02
156 TestImageBuild/serial/Setup 35.14
157 TestImageBuild/serial/NormalBuild 1.94
158 TestImageBuild/serial/BuildWithBuildArg 0.97
159 TestImageBuild/serial/BuildWithDockerIgnore 0.76
160 TestImageBuild/serial/BuildWithSpecifiedDockerfile 0.86
163 TestIngressAddonLegacy/StartLegacyK8sCluster 124.15
165 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 12.04
166 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.62
170 TestJSONOutput/start/Command 49.63
171 TestJSONOutput/start/Audit 0
173 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
174 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
176 TestJSONOutput/pause/Command 0.66
177 TestJSONOutput/pause/Audit 0
179 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
180 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
182 TestJSONOutput/unpause/Command 0.6
183 TestJSONOutput/unpause/Audit 0
185 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
186 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
188 TestJSONOutput/stop/Command 11
189 TestJSONOutput/stop/Audit 0
191 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
192 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
193 TestErrorJSONOutput 0.29
195 TestKicCustomNetwork/create_custom_network 34.62
196 TestKicCustomNetwork/use_default_bridge_network 34.92
197 TestKicExistingNetwork 38.41
198 TestKicCustomSubnet 36.17
199 TestKicStaticIP 35.58
200 TestMainNoArgs 0.07
201 TestMinikubeProfile 74.22
204 TestMountStart/serial/StartWithMountFirst 12.11
205 TestMountStart/serial/VerifyMountFirst 0.31
206 TestMountStart/serial/StartWithMountSecond 11.03
207 TestMountStart/serial/VerifyMountSecond 0.3
208 TestMountStart/serial/DeleteFirst 1.56
209 TestMountStart/serial/VerifyMountPostDelete 0.31
210 TestMountStart/serial/Stop 1.24
211 TestMountStart/serial/RestartStopped 8.99
212 TestMountStart/serial/VerifyMountPostStop 0.3
215 TestMultiNode/serial/FreshStart2Nodes 81.81
216 TestMultiNode/serial/DeployApp2Nodes 48.1
217 TestMultiNode/serial/PingHostFrom2Pods 1.23
218 TestMultiNode/serial/AddNode 19.38
219 TestMultiNode/serial/ProfileList 0.44
220 TestMultiNode/serial/CopyFile 11.86
221 TestMultiNode/serial/StopNode 2.49
222 TestMultiNode/serial/StartAfterStop 13.94
223 TestMultiNode/serial/RestartKeepsNodes 121.92
224 TestMultiNode/serial/DeleteNode 5.37
225 TestMultiNode/serial/StopMultiNode 21.79
226 TestMultiNode/serial/RestartMultiNode 82.17
227 TestMultiNode/serial/ValidateNameConflict 38.09
232 TestPreload 140.19
234 TestScheduledStopUnix 110.03
235 TestSkaffold 110.96
237 TestInsufficientStorage 14.61
238 TestRunningBinaryUpgrade 104.08
240 TestKubernetesUpgrade 411.75
241 TestMissingContainerUpgrade 159.1
243 TestNoKubernetes/serial/StartNoK8sWithVersion 0.13
244 TestNoKubernetes/serial/StartWithK8s 44.1
245 TestNoKubernetes/serial/StartWithStopK8s 8.93
246 TestNoKubernetes/serial/Start 11.46
247 TestNoKubernetes/serial/VerifyK8sNotRunning 0.32
248 TestNoKubernetes/serial/ProfileList 1.07
249 TestNoKubernetes/serial/Stop 1.27
250 TestNoKubernetes/serial/StartNoArgs 8.83
251 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.34
263 TestStoppedBinaryUpgrade/Setup 1.44
264 TestStoppedBinaryUpgrade/Upgrade 149.33
265 TestStoppedBinaryUpgrade/MinikubeLogs 1.72
274 TestPause/serial/Start 92.63
275 TestPause/serial/SecondStartNoReconfiguration 34.56
276 TestPause/serial/Pause 1.22
277 TestPause/serial/VerifyStatus 0.78
278 TestPause/serial/Unpause 0.9
279 TestPause/serial/PauseAgain 1.11
280 TestPause/serial/DeletePaused 2.66
281 TestPause/serial/VerifyDeletedResources 5.27
282 TestNetworkPlugins/group/auto/Start 93.92
283 TestNetworkPlugins/group/kindnet/Start 67.31
284 TestNetworkPlugins/group/auto/KubeletFlags 0.39
285 TestNetworkPlugins/group/auto/NetCatPod 11.6
286 TestNetworkPlugins/group/auto/DNS 0.29
287 TestNetworkPlugins/group/auto/Localhost 0.2
288 TestNetworkPlugins/group/auto/HairPin 0.23
289 TestNetworkPlugins/group/kindnet/ControllerPod 5.04
290 TestNetworkPlugins/group/kindnet/KubeletFlags 0.63
291 TestNetworkPlugins/group/kindnet/NetCatPod 12.54
292 TestNetworkPlugins/group/calico/Start 89.05
293 TestNetworkPlugins/group/kindnet/DNS 0.25
294 TestNetworkPlugins/group/kindnet/Localhost 0.2
295 TestNetworkPlugins/group/kindnet/HairPin 0.29
296 TestNetworkPlugins/group/custom-flannel/Start 72.44
297 TestNetworkPlugins/group/calico/ControllerPod 5.06
298 TestNetworkPlugins/group/calico/KubeletFlags 0.49
299 TestNetworkPlugins/group/calico/NetCatPod 13.69
300 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.37
301 TestNetworkPlugins/group/custom-flannel/NetCatPod 11.51
302 TestNetworkPlugins/group/calico/DNS 0.28
303 TestNetworkPlugins/group/calico/Localhost 0.21
304 TestNetworkPlugins/group/calico/HairPin 0.23
305 TestNetworkPlugins/group/custom-flannel/DNS 0.3
306 TestNetworkPlugins/group/custom-flannel/Localhost 0.33
307 TestNetworkPlugins/group/custom-flannel/HairPin 0.31
308 TestNetworkPlugins/group/false/Start 58.4
309 TestNetworkPlugins/group/enable-default-cni/Start 60.76
310 TestNetworkPlugins/group/false/KubeletFlags 0.36
311 TestNetworkPlugins/group/false/NetCatPod 10.45
312 TestNetworkPlugins/group/false/DNS 0.37
313 TestNetworkPlugins/group/false/Localhost 0.3
314 TestNetworkPlugins/group/false/HairPin 0.33
315 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.33
316 TestNetworkPlugins/group/enable-default-cni/NetCatPod 12.37
317 TestNetworkPlugins/group/enable-default-cni/DNS 0.36
318 TestNetworkPlugins/group/enable-default-cni/Localhost 0.25
319 TestNetworkPlugins/group/enable-default-cni/HairPin 0.31
320 TestNetworkPlugins/group/flannel/Start 72.54
321 TestNetworkPlugins/group/bridge/Start 93.1
322 TestNetworkPlugins/group/flannel/ControllerPod 5.07
323 TestNetworkPlugins/group/flannel/KubeletFlags 0.35
324 TestNetworkPlugins/group/flannel/NetCatPod 11.37
325 TestNetworkPlugins/group/flannel/DNS 0.47
326 TestNetworkPlugins/group/flannel/Localhost 0.24
327 TestNetworkPlugins/group/flannel/HairPin 0.19
328 TestNetworkPlugins/group/bridge/KubeletFlags 0.43
329 TestNetworkPlugins/group/bridge/NetCatPod 15.49
330 TestNetworkPlugins/group/kubenet/Start 94.09
331 TestNetworkPlugins/group/bridge/DNS 0.27
332 TestNetworkPlugins/group/bridge/Localhost 0.28
333 TestNetworkPlugins/group/bridge/HairPin 0.33
335 TestStartStop/group/old-k8s-version/serial/FirstStart 133.35
336 TestNetworkPlugins/group/kubenet/KubeletFlags 0.39
337 TestNetworkPlugins/group/kubenet/NetCatPod 12.55
338 TestNetworkPlugins/group/kubenet/DNS 0.22
339 TestNetworkPlugins/group/kubenet/Localhost 0.18
340 TestNetworkPlugins/group/kubenet/HairPin 0.19
342 TestStartStop/group/no-preload/serial/FirstStart 94.77
343 TestStartStop/group/old-k8s-version/serial/DeployApp 9.55
344 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.1
345 TestStartStop/group/old-k8s-version/serial/Stop 11.29
346 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.26
347 TestStartStop/group/old-k8s-version/serial/SecondStart 432.78
348 TestStartStop/group/no-preload/serial/DeployApp 9.66
349 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.57
350 TestStartStop/group/no-preload/serial/Stop 11.46
351 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.3
352 TestStartStop/group/no-preload/serial/SecondStart 333.27
353 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 20.04
354 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.11
355 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.42
356 TestStartStop/group/no-preload/serial/Pause 3.46
358 TestStartStop/group/embed-certs/serial/FirstStart 93.86
359 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.03
360 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.18
361 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.61
362 TestStartStop/group/old-k8s-version/serial/Pause 4.78
364 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 53.38
365 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 9.55
366 TestStartStop/group/embed-certs/serial/DeployApp 9.48
367 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.28
368 TestStartStop/group/default-k8s-diff-port/serial/Stop 10.87
369 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.18
370 TestStartStop/group/embed-certs/serial/Stop 11.03
371 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.24
372 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 337.96
373 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.23
374 TestStartStop/group/embed-certs/serial/SecondStart 335.69
375 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 14.06
376 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 13.03
377 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.16
378 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.18
379 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.69
380 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.72
381 TestStartStop/group/embed-certs/serial/Pause 5.3
382 TestStartStop/group/default-k8s-diff-port/serial/Pause 5.17
384 TestStartStop/group/newest-cni/serial/FirstStart 49.34
385 TestStartStop/group/newest-cni/serial/DeployApp 0
386 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.13
387 TestStartStop/group/newest-cni/serial/Stop 11.07
388 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.23
389 TestStartStop/group/newest-cni/serial/SecondStart 33.19
390 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
391 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
392 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.39
393 TestStartStop/group/newest-cni/serial/Pause 3.48
x
+
TestDownloadOnly/v1.16.0/json-events (21.02s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-729698 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-729698 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker: (21.017169999s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (21.02s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.1s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-729698
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-729698: exit status 85 (94.722944ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-729698 | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC |          |
	|         | -p download-only-729698        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/07 23:01:02
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.21.3 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1107 23:01:02.840134    7532 out.go:296] Setting OutFile to fd 1 ...
	I1107 23:01:02.840343    7532 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:01:02.840354    7532 out.go:309] Setting ErrFile to fd 2...
	I1107 23:01:02.840361    7532 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:01:02.840617    7532 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
	W1107 23:01:02.840744    7532 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17585-2228/.minikube/config/config.json: open /home/jenkins/minikube-integration/17585-2228/.minikube/config/config.json: no such file or directory
	I1107 23:01:02.841143    7532 out.go:303] Setting JSON to true
	I1107 23:01:02.841905    7532 start.go:128] hostinfo: {"hostname":"ip-172-31-30-239","uptime":2399,"bootTime":1699395664,"procs":149,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1049-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I1107 23:01:02.841973    7532 start.go:138] virtualization:  
	I1107 23:01:02.845370    7532 out.go:97] [download-only-729698] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	W1107 23:01:02.845580    7532 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball: no such file or directory
	I1107 23:01:02.845702    7532 notify.go:220] Checking for updates...
	I1107 23:01:02.848727    7532 out.go:169] MINIKUBE_LOCATION=17585
	I1107 23:01:02.852862    7532 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1107 23:01:02.855371    7532 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	I1107 23:01:02.857539    7532 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	I1107 23:01:02.859852    7532 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W1107 23:01:02.864182    7532 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1107 23:01:02.864449    7532 driver.go:378] Setting default libvirt URI to qemu:///system
	I1107 23:01:02.889447    7532 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1107 23:01:02.889555    7532 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:01:03.289207    7532 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-11-07 23:01:03.278998796 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:01:03.289308    7532 docker.go:295] overlay module found
	I1107 23:01:03.291543    7532 out.go:97] Using the docker driver based on user configuration
	I1107 23:01:03.291577    7532 start.go:298] selected driver: docker
	I1107 23:01:03.291588    7532 start.go:902] validating driver "docker" against <nil>
	I1107 23:01:03.291703    7532 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:01:03.366482    7532 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-11-07 23:01:03.357188267 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:01:03.366634    7532 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1107 23:01:03.366918    7532 start_flags.go:394] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I1107 23:01:03.367103    7532 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I1107 23:01:03.369687    7532 out.go:169] Using Docker driver with root privileges
	I1107 23:01:03.372013    7532 cni.go:84] Creating CNI manager for ""
	I1107 23:01:03.372049    7532 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1107 23:01:03.372060    7532 start_flags.go:323] config:
	{Name:download-only-729698 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-729698 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:01:03.374723    7532 out.go:97] Starting control plane node download-only-729698 in cluster download-only-729698
	I1107 23:01:03.374752    7532 cache.go:121] Beginning downloading kic base image for docker with docker
	I1107 23:01:03.377051    7532 out.go:97] Pulling base image ...
	I1107 23:01:03.377082    7532 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1107 23:01:03.377246    7532 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local docker daemon
	I1107 23:01:03.394739    7532 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 to local cache
	I1107 23:01:03.394920    7532 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local cache directory
	I1107 23:01:03.395023    7532 image.go:118] Writing gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 to local cache
	I1107 23:01:03.439437    7532 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1107 23:01:03.439482    7532 cache.go:56] Caching tarball of preloaded images
	I1107 23:01:03.439639    7532 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1107 23:01:03.442542    7532 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I1107 23:01:03.442565    7532 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:01:03.597511    7532 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1107 23:01:13.736534    7532 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:01:13.736620    7532 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:01:14.652066    7532 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1107 23:01:14.652459    7532 profile.go:148] Saving config to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/download-only-729698/config.json ...
	I1107 23:01:14.652491    7532 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/download-only-729698/config.json: {Name:mkb83e5b86a5f578bfa3d0fc694757c9b358c497 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1107 23:01:14.652670    7532 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1107 23:01:14.652865    7532 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl.sha1 -> /home/jenkins/minikube-integration/17585-2228/.minikube/cache/linux/arm64/v1.16.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-729698"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.10s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/json-events (10.69s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-729698 --force --alsologtostderr --kubernetes-version=v1.28.3 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-729698 --force --alsologtostderr --kubernetes-version=v1.28.3 --container-runtime=docker --driver=docker  --container-runtime=docker: (10.690601206s)
--- PASS: TestDownloadOnly/v1.28.3/json-events (10.69s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/preload-exists
--- PASS: TestDownloadOnly/v1.28.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/LogsDuration (0.09s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-729698
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-729698: exit status 85 (90.308775ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-729698 | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC |          |
	|         | -p download-only-729698        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-729698 | jenkins | v1.32.0 | 07 Nov 23 23:01 UTC |          |
	|         | -p download-only-729698        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.28.3   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/07 23:01:23
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.21.3 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1107 23:01:23.954121    7607 out.go:296] Setting OutFile to fd 1 ...
	I1107 23:01:23.954370    7607 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:01:23.954399    7607 out.go:309] Setting ErrFile to fd 2...
	I1107 23:01:23.954419    7607 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:01:23.954704    7607 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
	W1107 23:01:23.954872    7607 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17585-2228/.minikube/config/config.json: open /home/jenkins/minikube-integration/17585-2228/.minikube/config/config.json: no such file or directory
	I1107 23:01:23.955113    7607 out.go:303] Setting JSON to true
	I1107 23:01:23.955900    7607 start.go:128] hostinfo: {"hostname":"ip-172-31-30-239","uptime":2420,"bootTime":1699395664,"procs":145,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1049-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I1107 23:01:23.956012    7607 start.go:138] virtualization:  
	I1107 23:01:23.959013    7607 out.go:97] [download-only-729698] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	I1107 23:01:23.959389    7607 notify.go:220] Checking for updates...
	I1107 23:01:23.962772    7607 out.go:169] MINIKUBE_LOCATION=17585
	I1107 23:01:23.964925    7607 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1107 23:01:23.967314    7607 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	I1107 23:01:23.969818    7607 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	I1107 23:01:23.972203    7607 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W1107 23:01:23.976746    7607 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1107 23:01:23.977299    7607 config.go:182] Loaded profile config "download-only-729698": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W1107 23:01:23.977344    7607 start.go:810] api.Load failed for download-only-729698: filestore "download-only-729698": Docker machine "download-only-729698" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1107 23:01:23.977446    7607 driver.go:378] Setting default libvirt URI to qemu:///system
	W1107 23:01:23.977477    7607 start.go:810] api.Load failed for download-only-729698: filestore "download-only-729698": Docker machine "download-only-729698" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1107 23:01:24.005484    7607 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1107 23:01:24.005611    7607 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:01:24.092417    7607 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-11-07 23:01:24.081539404 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:01:24.092550    7607 docker.go:295] overlay module found
	I1107 23:01:24.094823    7607 out.go:97] Using the docker driver based on existing profile
	I1107 23:01:24.094855    7607 start.go:298] selected driver: docker
	I1107 23:01:24.094863    7607 start.go:902] validating driver "docker" against &{Name:download-only-729698 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-729698 Namespace:default APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:01:24.095043    7607 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:01:24.177432    7607 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-11-07 23:01:24.16826587 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:01:24.177854    7607 cni.go:84] Creating CNI manager for ""
	I1107 23:01:24.177876    7607 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1107 23:01:24.177891    7607 start_flags.go:323] config:
	{Name:download-only-729698 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:download-only-729698 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:01:24.180436    7607 out.go:97] Starting control plane node download-only-729698 in cluster download-only-729698
	I1107 23:01:24.180476    7607 cache.go:121] Beginning downloading kic base image for docker with docker
	I1107 23:01:24.182456    7607 out.go:97] Pulling base image ...
	I1107 23:01:24.182484    7607 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1107 23:01:24.182527    7607 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local docker daemon
	I1107 23:01:24.199687    7607 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 to local cache
	I1107 23:01:24.199830    7607 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local cache directory
	I1107 23:01:24.199848    7607 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local cache directory, skipping pull
	I1107 23:01:24.199853    7607 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 exists in cache, skipping pull
	I1107 23:01:24.199874    7607 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 as a tarball
	I1107 23:01:24.255825    7607 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.3/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4
	I1107 23:01:24.255883    7607 cache.go:56] Caching tarball of preloaded images
	I1107 23:01:24.256059    7607 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1107 23:01:24.258984    7607 out.go:97] Downloading Kubernetes v1.28.3 preload ...
	I1107 23:01:24.259016    7607 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:01:24.403783    7607 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.3/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4?checksum=md5:afa72052808cee1859e38c1ae6d1a426 -> /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4
	I1107 23:01:32.739912    7607 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:01:32.740005    7607 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17585-2228/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4 ...
	I1107 23:01:33.571950    7607 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1107 23:01:33.572082    7607 profile.go:148] Saving config to /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/download-only-729698/config.json ...
	I1107 23:01:33.572300    7607 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1107 23:01:33.572504    7607 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.3/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/linux/arm64/kubectl.sha256 -> /home/jenkins/minikube-integration/17585-2228/.minikube/cache/linux/arm64/v1.28.3/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-729698"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.3/LogsDuration (0.09s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.25s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:190: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.25s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.19s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:202: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-729698
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.19s)

                                                
                                    
x
+
TestBinaryMirror (0.71s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:307: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-431297 --alsologtostderr --binary-mirror http://127.0.0.1:39335 --driver=docker  --container-runtime=docker
helpers_test.go:175: Cleaning up "binary-mirror-431297" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-431297
--- PASS: TestBinaryMirror (0.71s)

                                                
                                    
x
+
TestOffline (103.13s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-arm64 start -p offline-docker-620165 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-arm64 start -p offline-docker-620165 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker: (1m40.660469741s)
helpers_test.go:175: Cleaning up "offline-docker-620165" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p offline-docker-620165
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p offline-docker-620165: (2.472306133s)
--- PASS: TestOffline (103.13s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.09s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:927: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-705389
addons_test.go:927: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-705389: exit status 85 (88.988601ms)

                                                
                                                
-- stdout --
	* Profile "addons-705389" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-705389"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.09s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.1s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:938: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-705389
addons_test.go:938: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-705389: exit status 85 (95.088868ms)

                                                
                                                
-- stdout --
	* Profile "addons-705389" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-705389"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.10s)

                                                
                                    
x
+
TestAddons/Setup (147.76s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-linux-arm64 start -p addons-705389 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns
addons_test.go:109: (dbg) Done: out/minikube-linux-arm64 start -p addons-705389 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns: (2m27.762737578s)
--- PASS: TestAddons/Setup (147.76s)

                                                
                                    
x
+
TestAddons/parallel/Registry (15.37s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:329: registry stabilized in 36.082605ms
addons_test.go:331: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-r2nhz" [6b608537-e2f4-4704-adaa-f6d86200b9ea] Running
addons_test.go:331: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.022656823s
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-8qm9x" [ea6a77a7-2195-4c76-867e-21193cd4573f] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.016570601s
addons_test.go:339: (dbg) Run:  kubectl --context addons-705389 delete po -l run=registry-test --now
addons_test.go:344: (dbg) Run:  kubectl --context addons-705389 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:344: (dbg) Done: kubectl --context addons-705389 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.036195457s)
addons_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 ip
2023/11/07 23:04:18 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:387: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (15.37s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.84s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:837: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-qprv5" [06e0b73b-c1cb-4afb-8385-a259cc66ca95] Running
addons_test.go:837: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.017691435s
addons_test.go:840: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-705389
addons_test.go:840: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-705389: (5.822836941s)
--- PASS: TestAddons/parallel/InspektorGadget (10.84s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.91s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:406: metrics-server stabilized in 4.620454ms
addons_test.go:408: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-7c66d45ddc-pqxs9" [5f0ccaee-940f-4c74-b17b-edcfd040d61b] Running
addons_test.go:408: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.014279518s
addons_test.go:414: (dbg) Run:  kubectl --context addons-705389 top pods -n kube-system
addons_test.go:431: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.91s)

                                                
                                    
x
+
TestAddons/parallel/CSI (48.47s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:560: csi-hostpath-driver pods stabilized in 5.323729ms
addons_test.go:563: (dbg) Run:  kubectl --context addons-705389 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:568: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:573: (dbg) Run:  kubectl --context addons-705389 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:578: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [84a64f26-d243-485a-a7ad-eb9e1e89b981] Pending
helpers_test.go:344: "task-pv-pod" [84a64f26-d243-485a-a7ad-eb9e1e89b981] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [84a64f26-d243-485a-a7ad-eb9e1e89b981] Running
addons_test.go:578: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.021801914s
addons_test.go:583: (dbg) Run:  kubectl --context addons-705389 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:588: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-705389 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-705389 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-705389 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:593: (dbg) Run:  kubectl --context addons-705389 delete pod task-pv-pod
addons_test.go:593: (dbg) Done: kubectl --context addons-705389 delete pod task-pv-pod: (1.407751933s)
addons_test.go:599: (dbg) Run:  kubectl --context addons-705389 delete pvc hpvc
addons_test.go:605: (dbg) Run:  kubectl --context addons-705389 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:610: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:615: (dbg) Run:  kubectl --context addons-705389 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:620: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [ff2094e7-f0b7-4f7f-81c4-d59665c59e76] Pending
helpers_test.go:344: "task-pv-pod-restore" [ff2094e7-f0b7-4f7f-81c4-d59665c59e76] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [ff2094e7-f0b7-4f7f-81c4-d59665c59e76] Running
addons_test.go:620: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 9.019412838s
addons_test.go:625: (dbg) Run:  kubectl --context addons-705389 delete pod task-pv-pod-restore
addons_test.go:625: (dbg) Done: kubectl --context addons-705389 delete pod task-pv-pod-restore: (1.32037778s)
addons_test.go:629: (dbg) Run:  kubectl --context addons-705389 delete pvc hpvc-restore
addons_test.go:633: (dbg) Run:  kubectl --context addons-705389 delete volumesnapshot new-snapshot-demo
addons_test.go:637: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:637: (dbg) Done: out/minikube-linux-arm64 -p addons-705389 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.787014771s)
addons_test.go:641: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:641: (dbg) Done: out/minikube-linux-arm64 -p addons-705389 addons disable volumesnapshots --alsologtostderr -v=1: (1.140097672s)
--- PASS: TestAddons/parallel/CSI (48.47s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (13.28s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:823: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-705389 --alsologtostderr -v=1
addons_test.go:823: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-705389 --alsologtostderr -v=1: (1.243480464s)
addons_test.go:828: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-94b766c-sxvjx" [4ea6d189-0dd6-4c0f-bb12-e9e3daa9cd50] Pending
helpers_test.go:344: "headlamp-94b766c-sxvjx" [4ea6d189-0dd6-4c0f-bb12-e9e3daa9cd50] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-94b766c-sxvjx" [4ea6d189-0dd6-4c0f-bb12-e9e3daa9cd50] Running
addons_test.go:828: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 12.033140033s
--- PASS: TestAddons/parallel/Headlamp (13.28s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.59s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:856: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-56665cdfc-8vcz7" [65b6fcb4-163e-4785-bc9c-480f6849a465] Running
addons_test.go:856: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.010899715s
addons_test.go:859: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-705389
--- PASS: TestAddons/parallel/CloudSpanner (5.59s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (55.76s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:872: (dbg) Run:  kubectl --context addons-705389 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:878: (dbg) Run:  kubectl --context addons-705389 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:882: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-705389 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:885: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [be26de0d-524d-4932-8f95-79effb2ec97c] Pending
helpers_test.go:344: "test-local-path" [be26de0d-524d-4932-8f95-79effb2ec97c] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [be26de0d-524d-4932-8f95-79effb2ec97c] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [be26de0d-524d-4932-8f95-79effb2ec97c] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:885: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 5.010733253s
addons_test.go:890: (dbg) Run:  kubectl --context addons-705389 get pvc test-pvc -o=json
addons_test.go:899: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 ssh "cat /opt/local-path-provisioner/pvc-855d3783-d5df-4f86-983d-e2cf8016b546_default_test-pvc/file1"
addons_test.go:911: (dbg) Run:  kubectl --context addons-705389 delete pod test-local-path
addons_test.go:915: (dbg) Run:  kubectl --context addons-705389 delete pvc test-pvc
addons_test.go:919: (dbg) Run:  out/minikube-linux-arm64 -p addons-705389 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:919: (dbg) Done: out/minikube-linux-arm64 -p addons-705389 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.406135064s)
--- PASS: TestAddons/parallel/LocalPath (55.76s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.64s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:951: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-wsh98" [c302fe6d-1463-430f-8c15-749a50e0a2d0] Running
addons_test.go:951: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.051495088s
addons_test.go:954: (dbg) Run:  out/minikube-linux-arm64 addons disable nvidia-device-plugin -p addons-705389
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.64s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.19s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:649: (dbg) Run:  kubectl --context addons-705389 create ns new-namespace
addons_test.go:663: (dbg) Run:  kubectl --context addons-705389 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.19s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (11.25s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:171: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-705389
addons_test.go:171: (dbg) Done: out/minikube-linux-arm64 stop -p addons-705389: (10.918979641s)
addons_test.go:175: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-705389
addons_test.go:179: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-705389
addons_test.go:184: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-705389
--- PASS: TestAddons/StoppedEnableDisable (11.25s)

                                                
                                    
x
+
TestCertOptions (42.16s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-685848 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-685848 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker: (39.216881475s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-685848 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-685848 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-685848 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-685848" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-685848
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-685848: (2.165348901s)
--- PASS: TestCertOptions (42.16s)

                                                
                                    
x
+
TestCertExpiration (261.24s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-856884 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-856884 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker: (42.270527765s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-856884 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-856884 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker: (35.15976409s)
helpers_test.go:175: Cleaning up "cert-expiration-856884" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-856884
E1107 23:42:07.565159    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-856884: (3.806988541s)
--- PASS: TestCertExpiration (261.24s)

                                                
                                    
x
+
TestDockerFlags (47.03s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-linux-arm64 start -p docker-flags-201732 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:51: (dbg) Done: out/minikube-linux-arm64 start -p docker-flags-201732 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (43.869404496s)
docker_test.go:56: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-201732 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:67: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-201732 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
helpers_test.go:175: Cleaning up "docker-flags-201732" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-flags-201732
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-flags-201732: (2.318157938s)
--- PASS: TestDockerFlags (47.03s)

                                                
                                    
x
+
TestForceSystemdFlag (46.63s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-621311 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-621311 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (43.748847967s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-621311 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-flag-621311" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-621311
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-621311: (2.331909368s)
--- PASS: TestForceSystemdFlag (46.63s)

                                                
                                    
x
+
TestForceSystemdEnv (41.69s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-705693 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-705693 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (38.846299362s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-705693 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-env-705693" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-705693
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-705693: (2.311237236s)
--- PASS: TestForceSystemdEnv (41.69s)

                                                
                                    
x
+
TestErrorSpam/setup (34.93s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-638916 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-638916 --driver=docker  --container-runtime=docker
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-638916 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-638916 --driver=docker  --container-runtime=docker: (34.930599302s)
--- PASS: TestErrorSpam/setup (34.93s)

                                                
                                    
x
+
TestErrorSpam/start (0.93s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 start --dry-run
--- PASS: TestErrorSpam/start (0.93s)

                                                
                                    
x
+
TestErrorSpam/status (1.2s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 status
--- PASS: TestErrorSpam/status (1.20s)

                                                
                                    
x
+
TestErrorSpam/pause (1.52s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 pause
--- PASS: TestErrorSpam/pause (1.52s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.65s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 unpause
--- PASS: TestErrorSpam/unpause (1.65s)

                                                
                                    
x
+
TestErrorSpam/stop (11.12s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 stop: (10.883749651s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-638916 --log_dir /tmp/nospam-638916 stop
--- PASS: TestErrorSpam/stop (11.12s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/17585-2228/.minikube/files/etc/test/nested/copy/7527/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (86.15s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-729993 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-729993 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker: (1m26.154500269s)
--- PASS: TestFunctional/serial/StartWithProxy (86.15s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (35.87s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-729993 --alsologtostderr -v=8
E1107 23:09:04.512212    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:04.519177    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:04.529506    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:04.549797    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:04.590064    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:04.670363    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:04.830757    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:05.151386    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:05.792278    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:07.073248    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:09.633939    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:14.754221    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:09:24.997759    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-729993 --alsologtostderr -v=8: (35.869259535s)
functional_test.go:659: soft start took 35.871384081s for "functional-729993" cluster.
--- PASS: TestFunctional/serial/SoftStart (35.87s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.08s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-729993 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.10s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (4.14s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 cache add registry.k8s.io/pause:3.1: (1.396980889s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 cache add registry.k8s.io/pause:3.3: (1.487687951s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 cache add registry.k8s.io/pause:latest: (1.256118374s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.14s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.31s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-729993 /tmp/TestFunctionalserialCacheCmdcacheadd_local1065625197/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 cache add minikube-local-cache-test:functional-729993
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 cache delete minikube-local-cache-test:functional-729993
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-729993
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.31s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.08s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.07s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.39s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.39s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.02s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-729993 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (367.821004ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.02s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.17s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.17s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.17s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 kubectl -- --context functional-729993 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.17s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.16s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-729993 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.16s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (44.24s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-729993 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E1107 23:09:45.478244    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-729993 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (44.236502904s)
functional_test.go:757: restart took 44.236602694s for "functional-729993" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (44.24s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-729993 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.33s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 logs: (1.332721912s)
--- PASS: TestFunctional/serial/LogsCmd (1.33s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.41s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 logs --file /tmp/TestFunctionalserialLogsFileCmd2550556776/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 logs --file /tmp/TestFunctionalserialLogsFileCmd2550556776/001/logs.txt: (1.40600788s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.41s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.47s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-729993 apply -f testdata/invalidsvc.yaml
E1107 23:10:26.440099    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-729993
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-729993: exit status 115 (628.860847ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:31741 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-729993 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.47s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-729993 config get cpus: exit status 14 (130.007476ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-729993 config get cpus: exit status 14 (154.72098ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.72s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (11.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-729993 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-729993 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 50333: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (11.87s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.79s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-729993 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-729993 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (288.612746ms)

                                                
                                                
-- stdout --
	* [functional-729993] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1107 23:11:25.465418   49750 out.go:296] Setting OutFile to fd 1 ...
	I1107 23:11:25.465620   49750 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:11:25.465625   49750 out.go:309] Setting ErrFile to fd 2...
	I1107 23:11:25.465631   49750 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:11:25.465890   49750 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
	I1107 23:11:25.466229   49750 out.go:303] Setting JSON to false
	I1107 23:11:25.467191   49750 start.go:128] hostinfo: {"hostname":"ip-172-31-30-239","uptime":3022,"bootTime":1699395664,"procs":288,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1049-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I1107 23:11:25.467261   49750 start.go:138] virtualization:  
	I1107 23:11:25.470072   49750 out.go:177] * [functional-729993] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	I1107 23:11:25.471570   49750 out.go:177]   - MINIKUBE_LOCATION=17585
	I1107 23:11:25.473605   49750 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1107 23:11:25.471690   49750 notify.go:220] Checking for updates...
	I1107 23:11:25.475759   49750 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	I1107 23:11:25.477872   49750 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	I1107 23:11:25.479810   49750 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1107 23:11:25.481867   49750 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1107 23:11:25.484375   49750 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1107 23:11:25.485028   49750 driver.go:378] Setting default libvirt URI to qemu:///system
	I1107 23:11:25.509683   49750 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1107 23:11:25.509810   49750 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:11:25.659377   49750 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-11-07 23:11:25.648415819 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:11:25.659486   49750 docker.go:295] overlay module found
	I1107 23:11:25.662523   49750 out.go:177] * Using the docker driver based on existing profile
	I1107 23:11:25.664229   49750 start.go:298] selected driver: docker
	I1107 23:11:25.664247   49750 start.go:902] validating driver "docker" against &{Name:functional-729993 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-729993 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:11:25.664336   49750 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1107 23:11:25.666673   49750 out.go:177] 
	W1107 23:11:25.668390   49750 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I1107 23:11:25.670061   49750 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-729993 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
--- PASS: TestFunctional/parallel/DryRun (0.79s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-729993 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-729993 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (349.012718ms)

                                                
                                                
-- stdout --
	* [functional-729993] minikube v1.32.0 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1107 23:11:25.934471   49814 out.go:296] Setting OutFile to fd 1 ...
	I1107 23:11:25.934707   49814 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:11:25.934734   49814 out.go:309] Setting ErrFile to fd 2...
	I1107 23:11:25.934752   49814 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:11:25.935177   49814 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
	I1107 23:11:25.935633   49814 out.go:303] Setting JSON to false
	I1107 23:11:25.936753   49814 start.go:128] hostinfo: {"hostname":"ip-172-31-30-239","uptime":3022,"bootTime":1699395664,"procs":292,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1049-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I1107 23:11:25.936870   49814 start.go:138] virtualization:  
	I1107 23:11:25.939330   49814 out.go:177] * [functional-729993] minikube v1.32.0 sur Ubuntu 20.04 (arm64)
	I1107 23:11:25.941828   49814 out.go:177]   - MINIKUBE_LOCATION=17585
	I1107 23:11:25.944156   49814 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1107 23:11:25.942028   49814 notify.go:220] Checking for updates...
	I1107 23:11:25.947799   49814 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	I1107 23:11:25.950312   49814 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	I1107 23:11:25.952090   49814 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1107 23:11:25.953960   49814 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1107 23:11:25.956540   49814 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1107 23:11:25.957306   49814 driver.go:378] Setting default libvirt URI to qemu:///system
	I1107 23:11:25.997218   49814 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1107 23:11:25.997357   49814 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:11:26.148786   49814 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-11-07 23:11:26.138025649 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:11:26.148896   49814 docker.go:295] overlay module found
	I1107 23:11:26.151101   49814 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I1107 23:11:26.152953   49814 start.go:298] selected driver: docker
	I1107 23:11:26.152974   49814 start.go:902] validating driver "docker" against &{Name:functional-729993 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-729993 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1107 23:11:26.153073   49814 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1107 23:11:26.155757   49814 out.go:177] 
	W1107 23:11:26.157803   49814 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I1107 23:11:26.160748   49814 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.21s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (8.74s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-729993 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-729993 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-7799dfb7c6-jbhqm" [ac4af682-a71c-45b0-b798-30c77e403f93] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-7799dfb7c6-jbhqm" [ac4af682-a71c-45b0-b798-30c77e403f93] Running
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 8.017976976s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:30351
functional_test.go:1674: http://192.168.49.2:30351: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-7799dfb7c6-jbhqm

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:30351
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (8.74s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (28.82s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [e8fc29b1-d752-4230-8748-e34f86718907] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.015082792s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-729993 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-729993 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-729993 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-729993 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [cf99a337-b22a-4179-8d4b-fc9195c9a807] Pending
helpers_test.go:344: "sp-pod" [cf99a337-b22a-4179-8d4b-fc9195c9a807] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [cf99a337-b22a-4179-8d4b-fc9195c9a807] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 12.020528551s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-729993 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-729993 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-729993 delete -f testdata/storage-provisioner/pod.yaml: (1.284367346s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-729993 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [16f219d0-fbbf-4705-a5c6-c0c413eff48f] Pending
helpers_test.go:344: "sp-pod" [16f219d0-fbbf-4705-a5c6-c0c413eff48f] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [16f219d0-fbbf-4705-a5c6-c0c413eff48f] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 9.019380777s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-729993 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (28.82s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.8s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.80s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh -n functional-729993 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 cp functional-729993:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd1555878381/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh -n functional-729993 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.65s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/7527/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo cat /etc/test/nested/copy/7527/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/7527.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo cat /etc/ssl/certs/7527.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/7527.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo cat /usr/share/ca-certificates/7527.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/75272.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo cat /etc/ssl/certs/75272.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/75272.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo cat /usr/share/ca-certificates/75272.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.54s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-729993 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-729993 ssh "sudo systemctl is-active crio": exit status 1 (414.094762ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 version --short
--- PASS: TestFunctional/parallel/Version/short (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.81s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.81s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-729993 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.28.3
registry.k8s.io/kube-proxy:v1.28.3
registry.k8s.io/kube-controller-manager:v1.28.3
registry.k8s.io/kube-apiserver:v1.28.3
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-729993
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-729993
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-729993 image ls --format short --alsologtostderr:
I1107 23:11:28.015117   50256 out.go:296] Setting OutFile to fd 1 ...
I1107 23:11:28.015309   50256 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:28.015314   50256 out.go:309] Setting ErrFile to fd 2...
I1107 23:11:28.015320   50256 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:28.015613   50256 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
I1107 23:11:28.016360   50256 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:28.016518   50256 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:28.017094   50256 cli_runner.go:164] Run: docker container inspect functional-729993 --format={{.State.Status}}
I1107 23:11:28.043554   50256 ssh_runner.go:195] Run: systemctl --version
I1107 23:11:28.043626   50256 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-729993
I1107 23:11:28.065484   50256 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/functional-729993/id_rsa Username:docker}
I1107 23:11:28.179231   50256 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-729993 image ls --format table --alsologtostderr:
|---------------------------------------------|-------------------|---------------|--------|
|                    Image                    |        Tag        |   Image ID    |  Size  |
|---------------------------------------------|-------------------|---------------|--------|
| docker.io/library/nginx                     | alpine            | aae348c9fbd40 | 48.4MB |
| registry.k8s.io/kube-proxy                  | v1.28.3           | a5dd5cdd6d3ef | 68.3MB |
| registry.k8s.io/pause                       | 3.9               | 829e9de338bd5 | 514kB  |
| gcr.io/k8s-minikube/storage-provisioner     | v5                | ba04bb24b9575 | 29MB   |
| registry.k8s.io/pause                       | 3.3               | 3d18732f8686c | 484kB  |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc      | 1611cd07b61d5 | 3.55MB |
| registry.k8s.io/pause                       | 3.1               | 8057e0500773a | 525kB  |
| docker.io/library/minikube-local-cache-test | functional-729993 | 001bd9cd667dc | 30B    |
| docker.io/library/nginx                     | latest            | 81be380254394 | 192MB  |
| gcr.io/google-containers/addon-resizer      | functional-729993 | ffd4cfbbe753e | 32.9MB |
| docker.io/localhost/my-image                | functional-729993 | b63d40ce2aa64 | 1.41MB |
| registry.k8s.io/kube-scheduler              | v1.28.3           | 42a4e73724daa | 57.8MB |
| registry.k8s.io/kube-controller-manager     | v1.28.3           | 8276439b4f237 | 116MB  |
| registry.k8s.io/etcd                        | 3.5.9-0           | 9cdd6470f48c8 | 181MB  |
| registry.k8s.io/coredns/coredns             | v1.10.1           | 97e04611ad434 | 51.4MB |
| registry.k8s.io/kube-apiserver              | v1.28.3           | 537e9a59ee2fd | 120MB  |
| registry.k8s.io/echoserver-arm              | 1.8               | 72565bf5bbedf | 85MB   |
| registry.k8s.io/pause                       | latest            | 8cb2091f603e7 | 240kB  |
|---------------------------------------------|-------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-729993 image ls --format table --alsologtostderr:
I1107 23:11:32.191695   50858 out.go:296] Setting OutFile to fd 1 ...
I1107 23:11:32.192011   50858 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:32.192042   50858 out.go:309] Setting ErrFile to fd 2...
I1107 23:11:32.192075   50858 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:32.192470   50858 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
I1107 23:11:32.193418   50858 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:32.193938   50858 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:32.194764   50858 cli_runner.go:164] Run: docker container inspect functional-729993 --format={{.State.Status}}
I1107 23:11:32.217543   50858 ssh_runner.go:195] Run: systemctl --version
I1107 23:11:32.217595   50858 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-729993
I1107 23:11:32.254797   50858 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/functional-729993/id_rsa Username:docker}
I1107 23:11:32.354922   50858 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
2023/11/07 23:11:37 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-729993 image ls --format json --alsologtostderr:
[{"id":"aae348c9fbd40035f9fc24e2c9ccb9ac0a8977a3f3441a997bb40f6011d45e9b","repoDigests":[],"repoTags":["docker.io/library/nginx:alpine"],"size":"48400000"},{"id":"8276439b4f237dda1f7820b0fcef600bb5662e441aa00e7b7c45843e60f04a16","repoDigests":[],"repoTags":["registry.k8s.io/kube-controller-manager:v1.28.3"],"size":"116000000"},{"id":"829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.9"],"size":"514000"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29000000"},{"id":"001bd9cd667dce9389827b928806bf24f6f3e955290034e86d1bbe88c6173cfd","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-729993"],"size":"30"},{"id":"a5dd5cdd6d3ef8058b7fbcecacbcee7f522fa8b9f3bb53bac6570e62ba2cbdbd","repoDigests":[],"repoTags":["registry.k8s.io/kube-proxy:v1.28.3"],"size":"68300000"},{"id":"97e04611ad43405a2e5863ae17
c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":[],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"51400000"},{"id":"537e9a59ee2fdef3cc7f5ebd14f9c4c77047176fca2bc5599db196217efeb5d7","repoDigests":[],"repoTags":["registry.k8s.io/kube-apiserver:v1.28.3"],"size":"120000000"},{"id":"42a4e73724daac2ee0c96eeeb79b9cf5f242fc3927ccfdc4df63b58140097314","repoDigests":[],"repoTags":["registry.k8s.io/kube-scheduler:v1.28.3"],"size":"57800000"},{"id":"9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace","repoDigests":[],"repoTags":["registry.k8s.io/etcd:3.5.9-0"],"size":"181000000"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-729993"],"size":"32900000"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"484000"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDiges
ts":[],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3550000"},{"id":"b63d40ce2aa6437dfef3c934f48ef36be517e6ba13cc88e93aa861bc45e1a11c","repoDigests":[],"repoTags":["docker.io/localhost/my-image:functional-729993"],"size":"1410000"},{"id":"81be38025439476d1b7303cb575df80e419fd1b3be4a639f3b3e51cf95720c7b","repoDigests":[],"repoTags":["docker.io/library/nginx:latest"],"size":"192000000"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"525000"},{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":[],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"85000000"},{"id":"8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"240000"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-729993 image ls --format json --alsologtostderr:
I1107 23:11:31.859539   50833 out.go:296] Setting OutFile to fd 1 ...
I1107 23:11:31.859751   50833 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:31.859763   50833 out.go:309] Setting ErrFile to fd 2...
I1107 23:11:31.859769   50833 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:31.860196   50833 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
I1107 23:11:31.863414   50833 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:31.863606   50833 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:31.864377   50833 cli_runner.go:164] Run: docker container inspect functional-729993 --format={{.State.Status}}
I1107 23:11:31.888593   50833 ssh_runner.go:195] Run: systemctl --version
I1107 23:11:31.888656   50833 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-729993
I1107 23:11:31.928540   50833 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/functional-729993/id_rsa Username:docker}
I1107 23:11:32.026396   50833 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.32s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-729993 image ls --format yaml --alsologtostderr:
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29000000"
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3550000"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "525000"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests: []
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "85000000"
- id: 001bd9cd667dce9389827b928806bf24f6f3e955290034e86d1bbe88c6173cfd
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-729993
size: "30"
- id: 81be38025439476d1b7303cb575df80e419fd1b3be4a639f3b3e51cf95720c7b
repoDigests: []
repoTags:
- docker.io/library/nginx:latest
size: "192000000"
- id: 42a4e73724daac2ee0c96eeeb79b9cf5f242fc3927ccfdc4df63b58140097314
repoDigests: []
repoTags:
- registry.k8s.io/kube-scheduler:v1.28.3
size: "57800000"
- id: a5dd5cdd6d3ef8058b7fbcecacbcee7f522fa8b9f3bb53bac6570e62ba2cbdbd
repoDigests: []
repoTags:
- registry.k8s.io/kube-proxy:v1.28.3
size: "68300000"
- id: 9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace
repoDigests: []
repoTags:
- registry.k8s.io/etcd:3.5.9-0
size: "181000000"
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-729993
size: "32900000"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "240000"
- id: aae348c9fbd40035f9fc24e2c9ccb9ac0a8977a3f3441a997bb40f6011d45e9b
repoDigests: []
repoTags:
- docker.io/library/nginx:alpine
size: "48400000"
- id: 537e9a59ee2fdef3cc7f5ebd14f9c4c77047176fca2bc5599db196217efeb5d7
repoDigests: []
repoTags:
- registry.k8s.io/kube-apiserver:v1.28.3
size: "120000000"
- id: 97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests: []
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "51400000"
- id: 829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.9
size: "514000"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "484000"
- id: 8276439b4f237dda1f7820b0fcef600bb5662e441aa00e7b7c45843e60f04a16
repoDigests: []
repoTags:
- registry.k8s.io/kube-controller-manager:v1.28.3
size: "116000000"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-729993 image ls --format yaml --alsologtostderr:
I1107 23:11:28.339682   50283 out.go:296] Setting OutFile to fd 1 ...
I1107 23:11:28.340126   50283 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:28.340136   50283 out.go:309] Setting ErrFile to fd 2...
I1107 23:11:28.340142   50283 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:28.340452   50283 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
I1107 23:11:28.341124   50283 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:28.341273   50283 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:28.341832   50283 cli_runner.go:164] Run: docker container inspect functional-729993 --format={{.State.Status}}
I1107 23:11:28.379951   50283 ssh_runner.go:195] Run: systemctl --version
I1107 23:11:28.380009   50283 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-729993
I1107 23:11:28.402461   50283 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/functional-729993/id_rsa Username:docker}
I1107 23:11:28.528097   50283 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-729993 ssh pgrep buildkitd: exit status 1 (418.456873ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image build -t localhost/my-image:functional-729993 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 image build -t localhost/my-image:functional-729993 testdata/build --alsologtostderr: (2.487615475s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-729993 image build -t localhost/my-image:functional-729993 testdata/build --alsologtostderr:
I1107 23:11:29.064846   50370 out.go:296] Setting OutFile to fd 1 ...
I1107 23:11:29.065029   50370 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:29.065037   50370 out.go:309] Setting ErrFile to fd 2...
I1107 23:11:29.065043   50370 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1107 23:11:29.065327   50370 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
I1107 23:11:29.065999   50370 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:29.066676   50370 config.go:182] Loaded profile config "functional-729993": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1107 23:11:29.067222   50370 cli_runner.go:164] Run: docker container inspect functional-729993 --format={{.State.Status}}
I1107 23:11:29.089413   50370 ssh_runner.go:195] Run: systemctl --version
I1107 23:11:29.089473   50370 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-729993
I1107 23:11:29.108417   50370 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/functional-729993/id_rsa Username:docker}
I1107 23:11:29.197801   50370 build_images.go:151] Building image from path: /tmp/build.3994269166.tar
I1107 23:11:29.197871   50370 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I1107 23:11:29.209246   50370 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.3994269166.tar
I1107 23:11:29.214147   50370 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.3994269166.tar: stat -c "%s %y" /var/lib/minikube/build/build.3994269166.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.3994269166.tar': No such file or directory
I1107 23:11:29.214177   50370 ssh_runner.go:362] scp /tmp/build.3994269166.tar --> /var/lib/minikube/build/build.3994269166.tar (3072 bytes)
I1107 23:11:29.247491   50370 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.3994269166
I1107 23:11:29.261244   50370 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.3994269166 -xf /var/lib/minikube/build/build.3994269166.tar
I1107 23:11:29.275048   50370 docker.go:346] Building image: /var/lib/minikube/build/build.3994269166
I1107 23:11:29.275131   50370 ssh_runner.go:195] Run: docker build -t localhost/my-image:functional-729993 /var/lib/minikube/build/build.3994269166
#0 building with "default" instance using docker driver

                                                
                                                
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.1s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.9s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 770B / 770B done
#5 sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9 527B / 527B done
#5 sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02 1.47kB / 1.47kB done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.1s
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.3s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.0s done
#5 DONE 0.5s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.2s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.0s done
#8 writing image sha256:b63d40ce2aa6437dfef3c934f48ef36be517e6ba13cc88e93aa861bc45e1a11c done
#8 naming to localhost/my-image:functional-729993 done
#8 DONE 0.0s
I1107 23:11:31.447113   50370 ssh_runner.go:235] Completed: docker build -t localhost/my-image:functional-729993 /var/lib/minikube/build/build.3994269166: (2.171950368s)
I1107 23:11:31.447219   50370 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.3994269166
I1107 23:11:31.458678   50370 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.3994269166.tar
I1107 23:11:31.469646   50370 build_images.go:207] Built localhost/my-image:functional-729993 from /tmp/build.3994269166.tar
I1107 23:11:31.469680   50370 build_images.go:123] succeeded building to: functional-729993
I1107 23:11:31.469685   50370 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.20s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (2.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.15639283s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-729993
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.19s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (1.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-729993 docker-env) && out/minikube-linux-arm64 status -p functional-729993"
functional_test.go:518: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-729993 docker-env) && docker images"
--- PASS: TestFunctional/parallel/DockerEnv/bash (1.41s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image load --daemon gcr.io/google-containers/addon-resizer:functional-729993 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 image load --daemon gcr.io/google-containers/addon-resizer:functional-729993 --alsologtostderr: (4.165276211s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.43s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (12.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-729993 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-729993 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-759d89bdcc-s8pdc" [1bc2ed64-0ce3-493f-a1d4-d73c71abe60f] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-759d89bdcc-s8pdc" [1bc2ed64-0ce3-493f-a1d4-d73c71abe60f] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 12.035598564s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (12.31s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (3.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image load --daemon gcr.io/google-containers/addon-resizer:functional-729993 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 image load --daemon gcr.io/google-containers/addon-resizer:functional-729993 --alsologtostderr: (2.788821812s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (3.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (13.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (8.522969233s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-729993
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image load --daemon gcr.io/google-containers/addon-resizer:functional-729993 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 image load --daemon gcr.io/google-containers/addon-resizer:functional-729993 --alsologtostderr: (4.337367527s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (13.16s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 service list -o json
functional_test.go:1493: Took "415.788235ms" to run "out/minikube-linux-arm64 -p functional-729993 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.49.2:30091
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.58s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.65s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:30091
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-729993 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-729993 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-729993 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 46383: os: process already finished
helpers_test.go:502: unable to terminate pid 46280: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-729993 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.73s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-729993 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (11.66s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-729993 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [b6e74c89-fa7f-4a15-8995-f1d062f3f003] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [b6e74c89-fa7f-4a15-8995-f1d062f3f003] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 11.02238419s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (11.66s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.96s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image save gcr.io/google-containers/addon-resizer:functional-729993 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.96s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image rm gcr.io/google-containers/addon-resizer:functional-729993 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.64s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.71s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:408: (dbg) Done: out/minikube-linux-arm64 -p functional-729993 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.452506311s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.71s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-729993
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 image save --daemon gcr.io/google-containers/addon-resizer:functional-729993 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-729993
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-729993 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.102.66.192 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-729993 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1314: Took "372.060954ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1328: Took "91.443887ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.46s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1365: Took "379.42679ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1378: Took "77.785121ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.46s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdany-port3835343416/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1699398674335682032" to /tmp/TestFunctionalparallelMountCmdany-port3835343416/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1699398674335682032" to /tmp/TestFunctionalparallelMountCmdany-port3835343416/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1699398674335682032" to /tmp/TestFunctionalparallelMountCmdany-port3835343416/001/test-1699398674335682032
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (429.820541ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Nov  7 23:11 created-by-test
-rw-r--r-- 1 docker docker 24 Nov  7 23:11 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Nov  7 23:11 test-1699398674335682032
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh cat /mount-9p/test-1699398674335682032
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-729993 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [5ece7fa1-0d99-4c52-963b-a12f27cb5ef3] Pending
helpers_test.go:344: "busybox-mount" [5ece7fa1-0d99-4c52-963b-a12f27cb5ef3] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [5ece7fa1-0d99-4c52-963b-a12f27cb5ef3] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [5ece7fa1-0d99-4c52-963b-a12f27cb5ef3] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.028361049s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-729993 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdany-port3835343416/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.40s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdspecific-port2818402627/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (406.057401ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdspecific-port2818402627/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-729993 ssh "sudo umount -f /mount-9p": exit status 1 (312.278048ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-729993 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdspecific-port2818402627/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.08s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3986408633/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3986408633/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3986408633/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-729993 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-729993 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3986408633/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3986408633/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-729993 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3986408633/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.58s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.09s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-729993
--- PASS: TestFunctional/delete_addon-resizer_images (0.09s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-729993
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-729993
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (35.14s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -p image-998338 --driver=docker  --container-runtime=docker
E1107 23:11:48.363516    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
image_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -p image-998338 --driver=docker  --container-runtime=docker: (35.142857028s)
--- PASS: TestImageBuild/serial/Setup (35.14s)

                                                
                                    
x
+
TestImageBuild/serial/NormalBuild (1.94s)

                                                
                                                
=== RUN   TestImageBuild/serial/NormalBuild
image_test.go:78: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-998338
image_test.go:78: (dbg) Done: out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-998338: (1.94338974s)
--- PASS: TestImageBuild/serial/NormalBuild (1.94s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithBuildArg (0.97s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithBuildArg
image_test.go:99: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-998338
--- PASS: TestImageBuild/serial/BuildWithBuildArg (0.97s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithDockerIgnore (0.76s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithDockerIgnore
image_test.go:133: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal --build-opt=no-cache -p image-998338
--- PASS: TestImageBuild/serial/BuildWithDockerIgnore (0.76s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.86s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithSpecifiedDockerfile
image_test.go:88: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest -f inner/Dockerfile ./testdata/image-build/test-f -p image-998338
--- PASS: TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.86s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (124.15s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-arm64 start -p ingress-addon-legacy-324087 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E1107 23:14:04.511564    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-arm64 start -p ingress-addon-legacy-324087 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (2m4.14986724s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (124.15s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (12.04s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-324087 addons enable ingress --alsologtostderr -v=5
E1107 23:14:32.203756    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-324087 addons enable ingress --alsologtostderr -v=5: (12.037442021s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (12.04s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.62s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-324087 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.62s)

                                                
                                    
x
+
TestJSONOutput/start/Command (49.63s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-571591 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker
E1107 23:15:34.845926    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:34.886184    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:34.966507    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:35.127671    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:35.447949    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:36.088130    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:37.369051    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:39.929275    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:45.089690    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:15:55.330711    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:16:15.810955    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-571591 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker: (49.633099496s)
--- PASS: TestJSONOutput/start/Command (49.63s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.66s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-571591 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.66s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.6s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-571591 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.60s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (11s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-571591 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-571591 --output=json --user=testUser: (10.999607259s)
--- PASS: TestJSONOutput/stop/Command (11.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.29s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-851187 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-851187 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (104.791696ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"0bbb0265-ab78-474f-b0e5-e8d3cdeacd4a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-851187] minikube v1.32.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"3ea80f66-869e-49fe-86fb-76c7c70a3583","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17585"}}
	{"specversion":"1.0","id":"ccef3631-4acc-4a95-b059-28e29d1e375a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"a32861c3-edb0-42a5-a5dc-e7bb0d5e0438","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig"}}
	{"specversion":"1.0","id":"f1616392-57f2-487f-877a-d44246eae9fe","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube"}}
	{"specversion":"1.0","id":"52c751ec-f228-4502-80fb-d24c4493b779","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"8b254d4d-008f-4cc5-a160-6ece1624ccae","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"edaa9a94-6a68-4e15-bdcb-1e01310df52c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-851187" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-851187
--- PASS: TestErrorJSONOutput (0.29s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (34.62s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-814940 --network=
E1107 23:16:56.771991    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-814940 --network=: (32.388122274s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-814940" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-814940
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-814940: (2.206061506s)
--- PASS: TestKicCustomNetwork/create_custom_network (34.62s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (34.92s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-483475 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-483475 --network=bridge: (32.863392403s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-483475" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-483475
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-483475: (2.022401132s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (34.92s)

                                                
                                    
x
+
TestKicExistingNetwork (38.41s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-021191 --network=existing-network
E1107 23:18:18.692202    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-021191 --network=existing-network: (36.193679471s)
helpers_test.go:175: Cleaning up "existing-network-021191" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-021191
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-021191: (2.054889231s)
--- PASS: TestKicExistingNetwork (38.41s)

                                                
                                    
x
+
TestKicCustomSubnet (36.17s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-691822 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-691822 --subnet=192.168.60.0/24: (33.994682711s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-691822 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-691822" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-691822
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-691822: (2.140836829s)
--- PASS: TestKicCustomSubnet (36.17s)

                                                
                                    
x
+
TestKicStaticIP (35.58s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-115692 --static-ip=192.168.200.200
E1107 23:19:04.511500    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-115692 --static-ip=192.168.200.200: (33.229358674s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-115692 ip
helpers_test.go:175: Cleaning up "static-ip-115692" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-115692
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-115692: (2.132444836s)
--- PASS: TestKicStaticIP (35.58s)

                                                
                                    
x
+
TestMainNoArgs (0.07s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.07s)

                                                
                                    
x
+
TestMinikubeProfile (74.22s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-540219 --driver=docker  --container-runtime=docker
E1107 23:19:39.450652    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:39.455930    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:39.466282    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:39.486469    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:39.526707    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:39.606960    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:39.767284    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:40.087796    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:40.728703    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:42.009680    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:44.570022    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:49.691152    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:19:59.931352    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-540219 --driver=docker  --container-runtime=docker: (33.675393055s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-542959 --driver=docker  --container-runtime=docker
E1107 23:20:20.411989    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:20:34.809539    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-542959 --driver=docker  --container-runtime=docker: (34.840154012s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-540219
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-542959
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-542959" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-542959
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-542959: (2.161025206s)
helpers_test.go:175: Cleaning up "first-540219" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-540219
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-540219: (2.185163491s)
--- PASS: TestMinikubeProfile (74.22s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (12.11s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-671132 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
E1107 23:21:01.379358    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:21:02.532421    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-671132 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (11.111507677s)
--- PASS: TestMountStart/serial/StartWithMountFirst (12.11s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.31s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-671132 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.31s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (11.03s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-673224 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-673224 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (10.029104845s)
--- PASS: TestMountStart/serial/StartWithMountSecond (11.03s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.3s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-673224 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.30s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.56s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-671132 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-671132 --alsologtostderr -v=5: (1.557996005s)
--- PASS: TestMountStart/serial/DeleteFirst (1.56s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.31s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-673224 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.31s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.24s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-673224
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-673224: (1.237674057s)
--- PASS: TestMountStart/serial/Stop (1.24s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (8.99s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-673224
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-673224: (7.985580048s)
--- PASS: TestMountStart/serial/RestartStopped (8.99s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.3s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-673224 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.30s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (81.81s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-184010 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E1107 23:22:23.300183    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p multinode-184010 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m21.040194175s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (81.81s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (48.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-184010 -- rollout status deployment/busybox: (3.778162312s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-6ww6x -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-89g7c -- nslookup kubernetes.io
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-6ww6x -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-89g7c -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-6ww6x -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-89g7c -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (48.10s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.23s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-6ww6x -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-6ww6x -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-89g7c -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-184010 -- exec busybox-5bc68d56bd-89g7c -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.23s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (19.38s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-184010 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-184010 -v 3 --alsologtostderr: (18.098202408s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr
multinode_test.go:116: (dbg) Done: out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr: (1.276915688s)
--- PASS: TestMultiNode/serial/AddNode (19.38s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.44s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.44s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (11.86s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp testdata/cp-test.txt multinode-184010:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2262385331/001/cp-test_multinode-184010.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010:/home/docker/cp-test.txt multinode-184010-m02:/home/docker/cp-test_multinode-184010_multinode-184010-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010 "sudo cat /home/docker/cp-test.txt"
E1107 23:24:04.511505    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m02 "sudo cat /home/docker/cp-test_multinode-184010_multinode-184010-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010:/home/docker/cp-test.txt multinode-184010-m03:/home/docker/cp-test_multinode-184010_multinode-184010-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m03 "sudo cat /home/docker/cp-test_multinode-184010_multinode-184010-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp testdata/cp-test.txt multinode-184010-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2262385331/001/cp-test_multinode-184010-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010-m02:/home/docker/cp-test.txt multinode-184010:/home/docker/cp-test_multinode-184010-m02_multinode-184010.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010 "sudo cat /home/docker/cp-test_multinode-184010-m02_multinode-184010.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010-m02:/home/docker/cp-test.txt multinode-184010-m03:/home/docker/cp-test_multinode-184010-m02_multinode-184010-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m03 "sudo cat /home/docker/cp-test_multinode-184010-m02_multinode-184010-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp testdata/cp-test.txt multinode-184010-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2262385331/001/cp-test_multinode-184010-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010-m03:/home/docker/cp-test.txt multinode-184010:/home/docker/cp-test_multinode-184010-m03_multinode-184010.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010 "sudo cat /home/docker/cp-test_multinode-184010-m03_multinode-184010.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 cp multinode-184010-m03:/home/docker/cp-test.txt multinode-184010-m02:/home/docker/cp-test_multinode-184010-m03_multinode-184010-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 ssh -n multinode-184010-m02 "sudo cat /home/docker/cp-test_multinode-184010-m03_multinode-184010-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (11.86s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.49s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-arm64 -p multinode-184010 node stop m03: (1.26383045s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-184010 status: exit status 7 (646.69966ms)

                                                
                                                
-- stdout --
	multinode-184010
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-184010-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-184010-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr: exit status 7 (581.029267ms)

                                                
                                                
-- stdout --
	multinode-184010
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-184010-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-184010-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1107 23:24:15.430668  115567 out.go:296] Setting OutFile to fd 1 ...
	I1107 23:24:15.430797  115567 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:24:15.430802  115567 out.go:309] Setting ErrFile to fd 2...
	I1107 23:24:15.430807  115567 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:24:15.431093  115567 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
	I1107 23:24:15.431330  115567 out.go:303] Setting JSON to false
	I1107 23:24:15.431421  115567 mustload.go:65] Loading cluster: multinode-184010
	I1107 23:24:15.431859  115567 config.go:182] Loaded profile config "multinode-184010": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1107 23:24:15.431886  115567 status.go:255] checking status of multinode-184010 ...
	I1107 23:24:15.432433  115567 cli_runner.go:164] Run: docker container inspect multinode-184010 --format={{.State.Status}}
	I1107 23:24:15.434071  115567 notify.go:220] Checking for updates...
	I1107 23:24:15.462912  115567 status.go:330] multinode-184010 host status = "Running" (err=<nil>)
	I1107 23:24:15.462937  115567 host.go:66] Checking if "multinode-184010" exists ...
	I1107 23:24:15.463275  115567 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-184010
	I1107 23:24:15.483480  115567 host.go:66] Checking if "multinode-184010" exists ...
	I1107 23:24:15.483911  115567 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1107 23:24:15.484078  115567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-184010
	I1107 23:24:15.503068  115567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32852 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/multinode-184010/id_rsa Username:docker}
	I1107 23:24:15.594946  115567 ssh_runner.go:195] Run: systemctl --version
	I1107 23:24:15.601617  115567 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1107 23:24:15.615359  115567 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1107 23:24:15.691688  115567 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:55 SystemTime:2023-11-07 23:24:15.681786059 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1049-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1107 23:24:15.692371  115567 kubeconfig.go:92] found "multinode-184010" server: "https://192.168.58.2:8443"
	I1107 23:24:15.692397  115567 api_server.go:166] Checking apiserver status ...
	I1107 23:24:15.692449  115567 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1107 23:24:15.705728  115567 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/2141/cgroup
	I1107 23:24:15.717493  115567 api_server.go:182] apiserver freezer: "3:freezer:/docker/dcea0d0ae0525a951b1df14544058af0cb6523d7e891b15d51f4e9d2eda52883/kubepods/burstable/poda44465fb50bae4af85a7b53b93a5b194/07cdc0fabc872e7fdb49337fe79abb5e18f0842cd63d2ba6d764cd503278aa88"
	I1107 23:24:15.717573  115567 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/dcea0d0ae0525a951b1df14544058af0cb6523d7e891b15d51f4e9d2eda52883/kubepods/burstable/poda44465fb50bae4af85a7b53b93a5b194/07cdc0fabc872e7fdb49337fe79abb5e18f0842cd63d2ba6d764cd503278aa88/freezer.state
	I1107 23:24:15.728674  115567 api_server.go:204] freezer state: "THAWED"
	I1107 23:24:15.728702  115567 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I1107 23:24:15.737614  115567 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I1107 23:24:15.737670  115567 status.go:421] multinode-184010 apiserver status = Running (err=<nil>)
	I1107 23:24:15.737689  115567 status.go:257] multinode-184010 status: &{Name:multinode-184010 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1107 23:24:15.737719  115567 status.go:255] checking status of multinode-184010-m02 ...
	I1107 23:24:15.738056  115567 cli_runner.go:164] Run: docker container inspect multinode-184010-m02 --format={{.State.Status}}
	I1107 23:24:15.756675  115567 status.go:330] multinode-184010-m02 host status = "Running" (err=<nil>)
	I1107 23:24:15.756698  115567 host.go:66] Checking if "multinode-184010-m02" exists ...
	I1107 23:24:15.757083  115567 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-184010-m02
	I1107 23:24:15.781809  115567 host.go:66] Checking if "multinode-184010-m02" exists ...
	I1107 23:24:15.782178  115567 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1107 23:24:15.782244  115567 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-184010-m02
	I1107 23:24:15.804569  115567 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32857 SSHKeyPath:/home/jenkins/minikube-integration/17585-2228/.minikube/machines/multinode-184010-m02/id_rsa Username:docker}
	I1107 23:24:15.898283  115567 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1107 23:24:15.912453  115567 status.go:257] multinode-184010-m02 status: &{Name:multinode-184010-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I1107 23:24:15.912487  115567 status.go:255] checking status of multinode-184010-m03 ...
	I1107 23:24:15.912803  115567 cli_runner.go:164] Run: docker container inspect multinode-184010-m03 --format={{.State.Status}}
	I1107 23:24:15.931980  115567 status.go:330] multinode-184010-m03 host status = "Stopped" (err=<nil>)
	I1107 23:24:15.932021  115567 status.go:343] host is not running, skipping remaining checks
	I1107 23:24:15.932049  115567 status.go:257] multinode-184010-m03 status: &{Name:multinode-184010-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.49s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (13.94s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Done: out/minikube-linux-arm64 -p multinode-184010 node start m03 --alsologtostderr: (12.992868257s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (13.94s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (121.92s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-184010
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-184010
E1107 23:24:39.449921    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
multinode_test.go:290: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-184010: (22.909600818s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-184010 --wait=true -v=8 --alsologtostderr
E1107 23:25:07.141106    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:25:27.564006    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:25:34.809437    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-arm64 start -p multinode-184010 --wait=true -v=8 --alsologtostderr: (1m38.837215169s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-184010
--- PASS: TestMultiNode/serial/RestartKeepsNodes (121.92s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.37s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 node delete m03
multinode_test.go:394: (dbg) Done: out/minikube-linux-arm64 -p multinode-184010 node delete m03: (4.539525838s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.37s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (21.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 stop
multinode_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p multinode-184010 stop: (21.571244735s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-184010 status: exit status 7 (108.760215ms)

                                                
                                                
-- stdout --
	multinode-184010
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-184010-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr: exit status 7 (107.045798ms)

                                                
                                                
-- stdout --
	multinode-184010
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-184010-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1107 23:26:58.918623  131571 out.go:296] Setting OutFile to fd 1 ...
	I1107 23:26:58.918852  131571 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:26:58.918880  131571 out.go:309] Setting ErrFile to fd 2...
	I1107 23:26:58.918901  131571 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1107 23:26:58.919184  131571 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17585-2228/.minikube/bin
	I1107 23:26:58.919379  131571 out.go:303] Setting JSON to false
	I1107 23:26:58.919495  131571 mustload.go:65] Loading cluster: multinode-184010
	I1107 23:26:58.919536  131571 notify.go:220] Checking for updates...
	I1107 23:26:58.919963  131571 config.go:182] Loaded profile config "multinode-184010": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1107 23:26:58.919981  131571 status.go:255] checking status of multinode-184010 ...
	I1107 23:26:58.920496  131571 cli_runner.go:164] Run: docker container inspect multinode-184010 --format={{.State.Status}}
	I1107 23:26:58.939833  131571 status.go:330] multinode-184010 host status = "Stopped" (err=<nil>)
	I1107 23:26:58.939855  131571 status.go:343] host is not running, skipping remaining checks
	I1107 23:26:58.939887  131571 status.go:257] multinode-184010 status: &{Name:multinode-184010 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1107 23:26:58.939919  131571 status.go:255] checking status of multinode-184010-m02 ...
	I1107 23:26:58.940256  131571 cli_runner.go:164] Run: docker container inspect multinode-184010-m02 --format={{.State.Status}}
	I1107 23:26:58.959639  131571 status.go:330] multinode-184010-m02 host status = "Stopped" (err=<nil>)
	I1107 23:26:58.959660  131571 status.go:343] host is not running, skipping remaining checks
	I1107 23:26:58.959668  131571 status.go:257] multinode-184010-m02 status: &{Name:multinode-184010-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (21.79s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (82.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-184010 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
multinode_test.go:354: (dbg) Done: out/minikube-linux-arm64 start -p multinode-184010 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m21.25837886s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-arm64 -p multinode-184010 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (82.17s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (38.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-184010
multinode_test.go:452: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-184010-m02 --driver=docker  --container-runtime=docker
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-184010-m02 --driver=docker  --container-runtime=docker: exit status 14 (154.829818ms)

                                                
                                                
-- stdout --
	* [multinode-184010-m02] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-184010-m02' is duplicated with machine name 'multinode-184010-m02' in profile 'multinode-184010'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-184010-m03 --driver=docker  --container-runtime=docker
multinode_test.go:460: (dbg) Done: out/minikube-linux-arm64 start -p multinode-184010-m03 --driver=docker  --container-runtime=docker: (35.316081812s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-184010
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-184010: exit status 80 (392.408825ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-184010
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-184010-m03 already exists in multinode-184010-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-184010-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-184010-m03: (2.139984627s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (38.09s)

                                                
                                    
x
+
TestPreload (140.19s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-199311 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4
E1107 23:29:04.514247    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:29:39.450167    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-199311 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4: (1m9.246183164s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-199311 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-199311 image pull gcr.io/k8s-minikube/busybox: (1.842267513s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-199311
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-199311: (10.922853093s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-199311 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker
E1107 23:30:34.808596    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-199311 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker: (55.751330195s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-199311 image list
helpers_test.go:175: Cleaning up "test-preload-199311" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-199311
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-199311: (2.189346826s)
--- PASS: TestPreload (140.19s)

                                                
                                    
x
+
TestScheduledStopUnix (110.03s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-982931 --memory=2048 --driver=docker  --container-runtime=docker
E1107 23:31:57.893025    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-982931 --memory=2048 --driver=docker  --container-runtime=docker: (36.231904835s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-982931 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-982931 -n scheduled-stop-982931
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-982931 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-982931 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-982931 -n scheduled-stop-982931
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-982931
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-982931 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-982931
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-982931: exit status 7 (94.365671ms)

                                                
                                                
-- stdout --
	scheduled-stop-982931
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-982931 -n scheduled-stop-982931
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-982931 -n scheduled-stop-982931: exit status 7 (85.614622ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-982931" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-982931
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-982931: (1.704370895s)
--- PASS: TestScheduledStopUnix (110.03s)

                                                
                                    
x
+
TestSkaffold (110.96s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /tmp/skaffold.exe1693625268 version
skaffold_test.go:63: skaffold version: v2.8.0
skaffold_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p skaffold-276705 --memory=2600 --driver=docker  --container-runtime=docker
skaffold_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p skaffold-276705 --memory=2600 --driver=docker  --container-runtime=docker: (31.851947639s)
skaffold_test.go:86: copying out/minikube-linux-arm64 to /home/jenkins/workspace/Docker_Linux_docker_arm64/out/minikube
skaffold_test.go:105: (dbg) Run:  /tmp/skaffold.exe1693625268 run --minikube-profile skaffold-276705 --kube-context skaffold-276705 --status-check=true --port-forward=false --interactive=false
E1107 23:34:04.511537    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:34:39.450170    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
skaffold_test.go:105: (dbg) Done: /tmp/skaffold.exe1693625268 run --minikube-profile skaffold-276705 --kube-context skaffold-276705 --status-check=true --port-forward=false --interactive=false: (1m3.153303661s)
skaffold_test.go:111: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-app" in namespace "default" ...
helpers_test.go:344: "leeroy-app-5878c7cb4d-x68hm" [9002db57-ae98-4985-9f43-2c2437e018b7] Running
skaffold_test.go:111: (dbg) TestSkaffold: app=leeroy-app healthy within 5.023831278s
skaffold_test.go:114: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-web" in namespace "default" ...
helpers_test.go:344: "leeroy-web-5fcbf55f74-p5qbq" [afd3581e-7e3f-40f0-9d06-e0a844b8d030] Running
skaffold_test.go:114: (dbg) TestSkaffold: app=leeroy-web healthy within 5.012086802s
helpers_test.go:175: Cleaning up "skaffold-276705" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p skaffold-276705
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p skaffold-276705: (3.08108926s)
--- PASS: TestSkaffold (110.96s)

                                                
                                    
x
+
TestInsufficientStorage (14.61s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-823849 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-823849 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker: exit status 26 (12.16309447s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"2a9e9749-8fd3-4b94-99fb-1fecbc7d6585","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-823849] minikube v1.32.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"19a00056-fcbd-432f-b751-9bf36c75645a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17585"}}
	{"specversion":"1.0","id":"567ab80f-6a9b-40c0-9569-2a24f38888e7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"662a981a-1450-4768-be1f-59927567a1dd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig"}}
	{"specversion":"1.0","id":"1055e380-6125-4111-9a5a-12d3d9c9a30b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube"}}
	{"specversion":"1.0","id":"e705eca4-68b7-4b12-81d6-502933ac0105","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"e57fb20c-5b90-4225-9423-dddace0c5b82","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"654bb615-19e1-4d83-b2ff-224a3b818a2a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"f53ff4d5-b335-48d1-8fef-eac7b4eeb349","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"3e6b5adf-a566-4f0e-9e4f-a4d0d0a127cc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"ec278d15-ee13-4555-97bf-172c9f23fe75","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"663fda5d-13a3-4068-8e18-f399658608ab","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-823849 in cluster insufficient-storage-823849","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"d63653ea-d134-4d67-a719-14fb0bfb83c8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"66794c0b-ebd2-48a3-aa2a-8d36a957eddc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"91200ba2-fb22-4802-a3f5-e393fd0abad1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-823849 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-823849 --output=json --layout=cluster: exit status 7 (317.21694ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-823849","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.32.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-823849","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E1107 23:35:17.394794  167328 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-823849" does not appear in /home/jenkins/minikube-integration/17585-2228/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-823849 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-823849 --output=json --layout=cluster: exit status 7 (317.436527ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-823849","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.32.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-823849","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E1107 23:35:17.712744  167382 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-823849" does not appear in /home/jenkins/minikube-integration/17585-2228/kubeconfig
	E1107 23:35:17.724873  167382 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/insufficient-storage-823849/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-823849" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-823849
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-823849: (1.808210842s)
--- PASS: TestInsufficientStorage (14.61s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (104.08s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:133: (dbg) Run:  /tmp/minikube-v1.17.0.4075282841.exe start -p running-upgrade-818269 --memory=2200 --vm-driver=docker  --container-runtime=docker
E1107 23:44:39.450286    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:44:51.798142    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
version_upgrade_test.go:133: (dbg) Done: /tmp/minikube-v1.17.0.4075282841.exe start -p running-upgrade-818269 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m1.305227431s)
version_upgrade_test.go:143: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-818269 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1107 23:45:19.480219    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:45:34.809330    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
version_upgrade_test.go:143: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-818269 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (38.95947119s)
helpers_test.go:175: Cleaning up "running-upgrade-818269" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-818269
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-818269: (2.34113691s)
--- PASS: TestRunningBinaryUpgrade (104.08s)

                                                
                                    
x
+
TestKubernetesUpgrade (411.75s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:235: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-792678 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1107 23:42:35.639563    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
version_upgrade_test.go:235: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-792678 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m13.70644792s)
version_upgrade_test.go:240: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-792678
version_upgrade_test.go:240: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-792678: (1.39178915s)
version_upgrade_test.go:245: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-792678 status --format={{.Host}}
version_upgrade_test.go:245: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-792678 status --format={{.Host}}: exit status 7 (141.081189ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:247: status error: exit status 7 (may be ok)
version_upgrade_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-792678 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1107 23:44:04.511603    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
version_upgrade_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-792678 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (4m49.823106512s)
version_upgrade_test.go:261: (dbg) Run:  kubectl --context kubernetes-upgrade-792678 version --output=json
version_upgrade_test.go:280: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:282: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-792678 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker
version_upgrade_test.go:282: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-792678 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker: exit status 106 (454.319154ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-792678] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.28.3 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-792678
	    minikube start -p kubernetes-upgrade-792678 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-7926782 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.28.3, by running:
	    
	    minikube start -p kubernetes-upgrade-792678 --kubernetes-version=v1.28.3
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:286: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:288: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-792678 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1107 23:48:37.893194    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
version_upgrade_test.go:288: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-792678 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (43.287095393s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-792678" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-792678
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-792678: (2.71114538s)
--- PASS: TestKubernetesUpgrade (411.75s)

                                                
                                    
x
+
TestMissingContainerUpgrade (159.1s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:322: (dbg) Run:  /tmp/minikube-v1.17.0.580525930.exe start -p missing-upgrade-128473 --memory=2200 --driver=docker  --container-runtime=docker
version_upgrade_test.go:322: (dbg) Done: /tmp/minikube-v1.17.0.580525930.exe start -p missing-upgrade-128473 --memory=2200 --driver=docker  --container-runtime=docker: (1m35.61589971s)
version_upgrade_test.go:331: (dbg) Run:  docker stop missing-upgrade-128473
version_upgrade_test.go:331: (dbg) Done: docker stop missing-upgrade-128473: (1.182577645s)
version_upgrade_test.go:336: (dbg) Run:  docker rm missing-upgrade-128473
version_upgrade_test.go:342: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-128473 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:342: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-128473 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (58.327456903s)
helpers_test.go:175: Cleaning up "missing-upgrade-128473" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-128473
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-128473: (2.457905591s)
--- PASS: TestMissingContainerUpgrade (159.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.13s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-206105 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-206105 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker: exit status 14 (126.908999ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-206105] minikube v1.32.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17585
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17585-2228/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17585-2228/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.13s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (44.1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-206105 --driver=docker  --container-runtime=docker
E1107 23:35:34.809319    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1107 23:36:02.501336    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-206105 --driver=docker  --container-runtime=docker: (43.607191118s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-206105 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (44.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (8.93s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-206105 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-206105 --no-kubernetes --driver=docker  --container-runtime=docker: (6.66668524s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-206105 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-206105 status -o json: exit status 2 (395.8893ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-206105","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-206105
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-206105: (1.869615493s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (8.93s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (11.46s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-206105 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-206105 --no-kubernetes --driver=docker  --container-runtime=docker: (11.455372237s)
--- PASS: TestNoKubernetes/serial/Start (11.46s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.32s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-206105 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-206105 "sudo systemctl is-active --quiet service kubelet": exit status 1 (324.757917ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.32s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.07s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.07s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.27s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-206105
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-206105: (1.266407458s)
--- PASS: TestNoKubernetes/serial/Stop (1.27s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (8.83s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-206105 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-206105 --driver=docker  --container-runtime=docker: (8.833834934s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (8.83s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.34s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-206105 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-206105 "sudo systemctl is-active --quiet service kubelet": exit status 1 (336.884036ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.34s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.44s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.44s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (149.33s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:196: (dbg) Run:  /tmp/minikube-v1.17.0.3449660912.exe start -p stopped-upgrade-281971 --memory=2200 --vm-driver=docker  --container-runtime=docker
E1107 23:39:04.511830    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:39:39.449946    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:39:51.798335    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:51.803500    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:51.813762    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:51.833977    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:51.874217    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:51.954388    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:52.114732    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:52.435742    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:53.076539    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:54.356827    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:39:56.917507    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:40:02.038270    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:40:12.278630    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
version_upgrade_test.go:196: (dbg) Done: /tmp/minikube-v1.17.0.3449660912.exe start -p stopped-upgrade-281971 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m32.165628727s)
version_upgrade_test.go:205: (dbg) Run:  /tmp/minikube-v1.17.0.3449660912.exe -p stopped-upgrade-281971 stop
E1107 23:40:32.758823    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:40:34.809068    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
version_upgrade_test.go:205: (dbg) Done: /tmp/minikube-v1.17.0.3449660912.exe -p stopped-upgrade-281971 stop: (10.847846641s)
version_upgrade_test.go:211: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-281971 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1107 23:41:13.718953    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
version_upgrade_test.go:211: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-281971 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (46.314729677s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (149.33s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.72s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:219: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-281971
version_upgrade_test.go:219: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-281971: (1.724662742s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.72s)

                                                
                                    
x
+
TestPause/serial/Start (92.63s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-067703 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-067703 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker: (1m32.625437517s)
--- PASS: TestPause/serial/Start (92.63s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (34.56s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-067703 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-067703 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (34.531127241s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (34.56s)

                                                
                                    
x
+
TestPause/serial/Pause (1.22s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-067703 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-067703 --alsologtostderr -v=5: (1.221741845s)
--- PASS: TestPause/serial/Pause (1.22s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.78s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-067703 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-067703 --output=json --layout=cluster: exit status 2 (778.571748ms)

                                                
                                                
-- stdout --
	{"Name":"pause-067703","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 12 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.32.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-067703","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.78s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.9s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-067703 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.90s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.11s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-067703 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-067703 --alsologtostderr -v=5: (1.107833096s)
--- PASS: TestPause/serial/PauseAgain (1.11s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.66s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-067703 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-067703 --alsologtostderr -v=5: (2.660543676s)
--- PASS: TestPause/serial/DeletePaused (2.66s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (5.27s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:142: (dbg) Done: out/minikube-linux-arm64 profile list --output json: (5.199800398s)
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-067703
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-067703: exit status 1 (23.211814ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-067703: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (5.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (93.92s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker: (1m33.919539374s)
--- PASS: TestNetworkPlugins/group/auto/Start (93.92s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (67.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker
E1107 23:49:04.513232    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:49:39.450693    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker: (1m7.308355192s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (67.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (11.6s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-wxdl9" [7f691476-c056-4fc7-84c9-a8fecdf3dae0] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-wxdl9" [7f691476-c056-4fc7-84c9-a8fecdf3dae0] Running
E1107 23:49:51.798261    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 11.014292849s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (11.60s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-fkxnf" [dcef6c76-f7e8-48e6-b50c-6c0af11f5b6d] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.035227775s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.63s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.63s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (12.54s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-lb89j" [1da27866-72ee-4321-a2b5-b33d3dc4bff9] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-lb89j" [1da27866-72ee-4321-a2b5-b33d3dc4bff9] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 12.014981169s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (12.54s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (89.05s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker: (1m29.051568971s)
--- PASS: TestNetworkPlugins/group/calico/Start (89.05s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (72.44s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker: (1m12.436271406s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (72.44s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.06s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-wt4kl" [bea818d4-b4e8-49d4-bb57-6d7c2b817c57] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.060980497s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.06s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.49s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.49s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (13.69s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-sc45r" [b67939f1-36c5-4808-9f6b-bcbf4c655cea] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-sc45r" [b67939f1-36c5-4808-9f6b-bcbf4c655cea] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 13.022894232s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (13.69s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (11.51s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-khdhw" [56f3f24b-5bc5-45f5-b23d-4305af6bddef] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-khdhw" [56f3f24b-5bc5-45f5-b23d-4305af6bddef] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 11.018277714s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (11.51s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (58.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p false-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker
E1107 23:52:42.502139    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p false-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker: (58.397576725s)
--- PASS: TestNetworkPlugins/group/false/Start (58.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (60.76s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker: (1m0.760012804s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (60.76s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/KubeletFlags (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p false-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/false/KubeletFlags (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/NetCatPod (10.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context false-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-p79f7" [ca487664-dbaa-4c02-b8db-5994108b72b7] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-p79f7" [ca487664-dbaa-4c02-b8db-5994108b72b7] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: app=netcat healthy within 10.014109221s
--- PASS: TestNetworkPlugins/group/false/NetCatPod (10.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/DNS (0.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/DNS
net_test.go:175: (dbg) Run:  kubectl --context false-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/false/DNS (0.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Localhost (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Localhost
net_test.go:194: (dbg) Run:  kubectl --context false-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/false/Localhost (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/HairPin (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/HairPin
net_test.go:264: (dbg) Run:  kubectl --context false-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/false/HairPin (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (12.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-tgp8b" [576599e3-2ccb-432a-8675-1b8a996e0b10] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-tgp8b" [576599e3-2ccb-432a-8675-1b8a996e0b10] Running
E1107 23:54:04.512162    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 12.016806662s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (12.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (72.54s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker: (1m12.544850309s)
--- PASS: TestNetworkPlugins/group/flannel/Start (72.54s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (93.1s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker
E1107 23:54:39.450528    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:54:45.449716    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:45.455402    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:45.465625    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:45.486033    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:45.526279    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:45.606505    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:45.766717    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:46.087227    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:46.727959    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:48.008310    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:50.568744    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:54:51.798887    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:54:55.689077    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:55:05.929821    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:55:09.611030    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:09.616285    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:09.626536    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:09.646786    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:09.687002    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:09.767434    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:09.927805    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:10.248799    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:10.889705    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:12.170321    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:14.730469    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:19.850906    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1107 23:55:26.410025    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker: (1m33.099903178s)
--- PASS: TestNetworkPlugins/group/bridge/Start (93.10s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.07s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-9psps" [5657a2e5-a1c1-4a62-ac6c-975eb3d5a136] Running
E1107 23:55:30.092054    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.06657394s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.07s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (11.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-x596d" [de17414e-0956-4799-8403-079aee7e9dd8] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1107 23:55:34.809113    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
helpers_test.go:344: "netcat-56589dfd74-x596d" [de17414e-0956-4799-8403-079aee7e9dd8] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 11.01565258s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (11.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.47s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.47s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (15.49s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-ms4mx" [9c2cda2d-8fa1-4c59-a842-76ba427d471f] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-ms4mx" [9c2cda2d-8fa1-4c59-a842-76ba427d471f] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 15.02823632s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (15.49s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (94.09s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kubenet-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker
E1107 23:56:14.841196    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kubenet-221504 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker: (1m34.092568154s)
--- PASS: TestNetworkPlugins/group/kubenet/Start (94.09s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.33s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (133.35s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-086727 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E1107 23:56:53.041128    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1107 23:56:54.321752    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1107 23:56:56.882484    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1107 23:57:02.004024    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1107 23:57:10.424397    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:10.429612    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:10.440087    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:10.461447    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:10.501694    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:10.581933    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:10.742424    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:11.062908    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:11.703663    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:12.244671    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1107 23:57:12.984762    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:15.545567    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:20.665975    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:29.292249    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:57:30.906671    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:57:32.725136    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-086727 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (2m13.354460633s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (133.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/KubeletFlags (0.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kubenet-221504 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kubenet/KubeletFlags (0.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/NetCatPod (12.55s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kubenet-221504 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-dkbw4" [0c417ee6-5b51-4982-94b2-ff2aab7935e1] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1107 23:57:51.387472    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
helpers_test.go:344: "netcat-56589dfd74-dkbw4" [0c417ee6-5b51-4982-94b2-ff2aab7935e1] Running
E1107 23:57:53.453788    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: app=netcat healthy within 12.015915842s
--- PASS: TestNetworkPlugins/group/kubenet/NetCatPod (12.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kubenet-221504 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kubenet/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kubenet-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kubenet/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/HairPin (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kubenet-221504 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kubenet/HairPin (0.19s)
E1108 00:14:34.270607    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:14:39.450539    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1108 00:14:45.452003    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1108 00:14:51.798996    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1108 00:14:55.446464    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:15:03.176356    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1108 00:15:09.610848    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (94.77s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-172039 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1107 23:58:32.348018    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1107 23:58:40.131564    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:40.136895    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:40.147224    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:40.167489    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:40.207780    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:40.288061    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:40.448480    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:40.769296    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:41.410233    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:42.690493    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:45.251555    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:47.565671    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:58:50.372103    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:58:55.168278    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:55.173534    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:55.183801    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:55.204056    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:55.244281    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:55.324513    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:55.485387    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:55.805873    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:56.446754    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:58:57.726955    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:59:00.289564    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:59:00.612988    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1107 23:59:04.512126    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1107 23:59:05.410103    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-172039 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (1m34.772189168s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (94.77s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.55s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-086727 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [e4d5d0ca-5f07-42e4-a549-7c25411578f3] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [e4d5d0ca-5f07-42e4-a549-7c25411578f3] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.061328046s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-086727 exec busybox -- /bin/sh -c "ulimit -n"
E1107 23:59:15.650337    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.55s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-086727 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-086727 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.10s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (11.29s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-086727 --alsologtostderr -v=3
E1107 23:59:21.093457    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-086727 --alsologtostderr -v=3: (11.288602819s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (11.29s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-086727 -n old-k8s-version-086727
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-086727 -n old-k8s-version-086727: exit status 7 (108.578218ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-086727 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.26s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (432.78s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-086727 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E1107 23:59:35.605519    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1107 23:59:36.130479    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1107 23:59:39.450434    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1107 23:59:45.451824    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1107 23:59:51.798388    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1107 23:59:54.268600    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-086727 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (7m12.295754963s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-086727 -n old-k8s-version-086727
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (432.78s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (9.66s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-172039 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [68ac5401-4cf3-48e5-942f-f3567f342b6f] Pending
helpers_test.go:344: "busybox" [68ac5401-4cf3-48e5-942f-f3567f342b6f] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [68ac5401-4cf3-48e5-942f-f3567f342b6f] Running
E1108 00:00:02.054340    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.034483241s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-172039 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.66s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.57s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-172039 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-172039 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.41319864s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-172039 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.57s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (11.46s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-172039 --alsologtostderr -v=3
E1108 00:00:09.610949    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1108 00:00:13.132392    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1108 00:00:17.090781    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-172039 --alsologtostderr -v=3: (11.458808433s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (11.46s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.3s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-172039 -n no-preload-172039
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-172039 -n no-preload-172039: exit status 7 (102.352545ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-172039 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.30s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (333.27s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-172039 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1108 00:00:28.201394    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:28.206714    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:28.216955    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:28.237299    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:28.277572    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:28.357929    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:28.518984    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:28.839712    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:29.480073    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:30.760261    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:33.320501    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:34.808616    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1108 00:00:37.293964    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1108 00:00:38.440659    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:00:48.680825    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:01:09.161758    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:01:09.474143    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:09.479514    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:09.489786    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:09.510149    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:09.550413    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:09.630821    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:09.791243    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:10.111670    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:10.751895    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:12.032042    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:14.592241    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:19.713125    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:23.975441    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1108 00:01:29.953330    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:39.011444    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1108 00:01:50.122538    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:01:50.434212    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:01:51.762434    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1108 00:02:10.424742    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1108 00:02:19.445665    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1108 00:02:31.394526    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:02:38.108849    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1108 00:02:45.417754    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:45.423220    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:45.433798    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:45.454509    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:45.494941    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:45.575388    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:45.735786    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:46.056403    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:46.697340    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:47.977549    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:50.538252    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:02:55.658755    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:03:05.899699    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:03:12.043016    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:03:26.380066    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:03:40.117504    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1108 00:03:53.314774    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:03:55.167853    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1108 00:04:04.511518    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1108 00:04:07.341113    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:04:07.815737    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1108 00:04:22.852209    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1108 00:04:39.450331    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1108 00:04:45.450009    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1108 00:04:51.798351    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1108 00:05:09.610827    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1108 00:05:17.893410    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1108 00:05:28.202345    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:05:29.262193    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:05:34.808620    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-172039 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (5m32.433567696s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-172039 -n no-preload-172039
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (333.27s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (20.04s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-bt927" [b037dcd2-ee92-4b02-b317-04a5c7334562] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
E1108 00:05:55.884046    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-bt927" [b037dcd2-ee92-4b02-b317-04a5c7334562] Running
E1108 00:06:09.474002    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 20.043138011s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (20.04s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-bt927" [b037dcd2-ee92-4b02-b317-04a5c7334562] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.010611672s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-172039 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.42s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p no-preload-172039 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.42s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.46s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-172039 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-172039 -n no-preload-172039
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-172039 -n no-preload-172039: exit status 2 (409.178028ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-172039 -n no-preload-172039
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-172039 -n no-preload-172039: exit status 2 (390.847216ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-172039 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-172039 -n no-preload-172039
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-172039 -n no-preload-172039
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.46s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (93.86s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-789700 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1108 00:06:37.155597    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-789700 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (1m33.861093898s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (93.86s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-4xq7w" [5809d151-3129-4a2d-86d1-e1f732cbaa3b] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.027999713s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.18s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-4xq7w" [5809d151-3129-4a2d-86d1-e1f732cbaa3b] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.011927276s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-086727 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.18s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.61s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p old-k8s-version-086727 "sudo crictl images -o json"
E1108 00:06:51.762440    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.61s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (4.78s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-086727 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p old-k8s-version-086727 --alsologtostderr -v=1: (1.113008604s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-086727 -n old-k8s-version-086727
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-086727 -n old-k8s-version-086727: exit status 2 (550.737862ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-086727 -n old-k8s-version-086727
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-086727 -n old-k8s-version-086727: exit status 2 (563.791841ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-086727 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p old-k8s-version-086727 --alsologtostderr -v=1: (1.078185424s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-086727 -n old-k8s-version-086727
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-086727 -n old-k8s-version-086727
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (4.78s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (53.38s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-358257 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1108 00:07:10.424409    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1108 00:07:45.417085    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-358257 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (53.379012302s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (53.38s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.55s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-358257 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [b8348036-4c28-47c2-93e0-e0480eb65ec6] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [b8348036-4c28-47c2-93e0-e0480eb65ec6] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 9.055933535s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-358257 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.55s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.48s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-789700 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [d2eeba20-a6c7-4d0d-b607-567c9740c9da] Pending
helpers_test.go:344: "busybox" [d2eeba20-a6c7-4d0d-b607-567c9740c9da] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [d2eeba20-a6c7-4d0d-b607-567c9740c9da] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.039060102s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-789700 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.48s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.28s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-358257 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-358257 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.166370662s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-358257 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.28s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (10.87s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-358257 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-358257 --alsologtostderr -v=3: (10.867961803s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (10.87s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.18s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-789700 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-789700 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.066574881s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-789700 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (11.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-789700 --alsologtostderr -v=3
E1108 00:08:13.103160    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-789700 --alsologtostderr -v=3: (11.025547795s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (11.03s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257: exit status 7 (96.937891ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-358257 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (337.96s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-358257 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-358257 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (5m37.091184452s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (337.96s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-789700 -n embed-certs-789700
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-789700 -n embed-certs-789700: exit status 7 (87.314018ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-789700 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (335.69s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-789700 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1108 00:08:40.117315    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
E1108 00:08:55.167599    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1108 00:09:04.512028    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1108 00:09:06.588002    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:06.593542    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:06.603872    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:06.624235    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:06.664544    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:06.744892    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:06.905232    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:07.225829    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:07.866630    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:09.147006    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:11.707813    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:16.828026    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:22.502375    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1108 00:09:27.068257    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:39.450476    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/ingress-addon-legacy-324087/client.crt: no such file or directory
E1108 00:09:45.450370    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1108 00:09:47.548770    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:09:51.798772    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1108 00:09:55.446618    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:55.451968    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:55.462270    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:55.482629    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:55.522962    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:55.603254    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:55.763617    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:56.084551    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:56.725445    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:09:58.006161    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:10:00.566698    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:10:05.687813    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:10:09.611003    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1108 00:10:15.928437    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:10:28.201509    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:10:28.508998    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:10:34.809085    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
E1108 00:10:36.409545    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:11:08.493418    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/auto-221504/client.crt: no such file or directory
E1108 00:11:09.474302    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/bridge-221504/client.crt: no such file or directory
E1108 00:11:17.370610    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:11:32.654777    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kindnet-221504/client.crt: no such file or directory
E1108 00:11:50.429479    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
E1108 00:11:51.762817    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1108 00:12:10.424026    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1108 00:12:39.290865    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
E1108 00:12:45.424524    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/kubenet-221504/client.crt: no such file or directory
E1108 00:12:54.842197    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/skaffold-276705/client.crt: no such file or directory
E1108 00:13:14.806833    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/calico-221504/client.crt: no such file or directory
E1108 00:13:33.469009    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/custom-flannel-221504/client.crt: no such file or directory
E1108 00:13:40.116744    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/false-221504/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-789700 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (5m35.106006388s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-789700 -n embed-certs-789700
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (335.69s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (14.06s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-z56g7" [b42e8c1d-cdd9-4db1-be95-2876528aa47b] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-z56g7" [b42e8c1d-cdd9-4db1-be95-2876528aa47b] Running
E1108 00:14:04.511351    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1108 00:14:06.587909    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/old-k8s-version-086727/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 14.059251227s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (14.06s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (13.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-r7h4l" [85993ffe-91aa-4d09-867d-6ee1ba2b4c0a] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
E1108 00:13:55.167950    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-r7h4l" [85993ffe-91aa-4d09-867d-6ee1ba2b4c0a] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 13.027307226s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (13.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.16s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-r7h4l" [85993ffe-91aa-4d09-867d-6ee1ba2b4c0a] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.015030411s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-789700 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.16s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-z56g7" [b42e8c1d-cdd9-4db1-be95-2876528aa47b] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.01716694s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-358257 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.69s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p embed-certs-789700 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.69s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.72s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p default-k8s-diff-port-358257 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.72s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (5.3s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-789700 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p embed-certs-789700 --alsologtostderr -v=1: (1.167105653s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-789700 -n embed-certs-789700
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-789700 -n embed-certs-789700: exit status 2 (518.036384ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-789700 -n embed-certs-789700
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-789700 -n embed-certs-789700: exit status 2 (522.669388ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-789700 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-789700 -n embed-certs-789700
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-789700 -n embed-certs-789700: (1.129713947s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-789700 -n embed-certs-789700
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-789700 -n embed-certs-789700: (1.001641454s)
--- PASS: TestStartStop/group/embed-certs/serial/Pause (5.30s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (5.17s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-358257 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p default-k8s-diff-port-358257 --alsologtostderr -v=1: (1.120345797s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257: exit status 2 (594.193548ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257: exit status 2 (505.104656ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-358257 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p default-k8s-diff-port-358257 --alsologtostderr -v=1: (1.048041962s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-358257 -n default-k8s-diff-port-358257
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (5.17s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (49.34s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-068038 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-068038 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (49.343535236s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (49.34s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.13s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-068038 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-068038 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.128305773s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.13s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (11.07s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-068038 --alsologtostderr -v=3
E1108 00:15:18.212396    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/enable-default-cni-221504/client.crt: no such file or directory
E1108 00:15:23.131681    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/no-preload-172039/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-068038 --alsologtostderr -v=3: (11.067828623s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (11.07s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-068038 -n newest-cni-068038
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-068038 -n newest-cni-068038: exit status 7 (85.439991ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-068038 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (33.19s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-068038 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1108 00:15:27.565944    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/addons-705389/client.crt: no such file or directory
E1108 00:15:28.201618    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/flannel-221504/client.crt: no such file or directory
E1108 00:15:34.809061    7527 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/functional-729993/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-068038 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (32.803993804s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-068038 -n newest-cni-068038
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (33.19s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p newest-cni-068038 "sudo crictl images -o json"
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.39s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.48s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-068038 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-068038 -n newest-cni-068038
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-068038 -n newest-cni-068038: exit status 2 (369.970741ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-068038 -n newest-cni-068038
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-068038 -n newest-cni-068038: exit status 2 (356.390885ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-068038 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-068038 -n newest-cni-068038
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-068038 -n newest-cni-068038
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.48s)

                                                
                                    

Test skip (24/323)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:155: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/kubectl
aaa_download_only_test.go:155: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.66s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:225: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-949347 --alsologtostderr --driver=docker  --container-runtime=docker
aaa_download_only_test.go:237: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-949347" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-949347
--- SKIP: TestDownloadOnlyKic (0.66s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:443: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:497: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker true linux arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild/serial/validateImageBuildWithBuildEnv (0s)

                                                
                                                
=== RUN   TestImageBuild/serial/validateImageBuildWithBuildEnv
image_test.go:114: skipping due to https://github.com/kubernetes/minikube/issues/12431
--- SKIP: TestImageBuild/serial/validateImageBuildWithBuildEnv (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (5.06s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:523: 
----------------------- debugLogs start: cilium-221504 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-221504" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17585-2228/.minikube/ca.crt
extensions:
- extension:
last-update: Tue, 07 Nov 2023 23:36:17 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.67.2:8443
name: offline-docker-620165
contexts:
- context:
cluster: offline-docker-620165
extensions:
- extension:
last-update: Tue, 07 Nov 2023 23:36:17 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: offline-docker-620165
name: offline-docker-620165
current-context: offline-docker-620165
kind: Config
preferences: {}
users:
- name: offline-docker-620165
user:
client-certificate: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/offline-docker-620165/client.crt
client-key: /home/jenkins/minikube-integration/17585-2228/.minikube/profiles/offline-docker-620165/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-221504

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-221504" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221504"

                                                
                                                
----------------------- debugLogs end: cilium-221504 [took: 4.851925506s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-221504" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-221504
--- SKIP: TestNetworkPlugins/group/cilium (5.06s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-507692" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-507692
--- SKIP: TestStartStop/group/disable-driver-mounts (0.28s)

                                                
                                    
Copied to clipboard