Test Report: Docker_Linux_docker_arm64 17523

                    
                      6736058f069edcc94fe1e3dfa85e3792dac82a1d:2023-10-30:31667
                    
                

Test fail (3/323)

Order failed test Duration
28 TestAddons/parallel/Ingress 37.41
167 TestIngressAddonLegacy/serial/ValidateIngressAddons 58.36
241 TestMissingContainerUpgrade 418.15
x
+
TestAddons/parallel/Ingress (37.41s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:206: (dbg) Run:  kubectl --context addons-305325 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:231: (dbg) Run:  kubectl --context addons-305325 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:244: (dbg) Run:  kubectl --context addons-305325 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:249: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [b6fa714c-de9f-4b51-b865-64a7e1c1ed43] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [b6fa714c-de9f-4b51-b865-64a7e1c1ed43] Running
addons_test.go:249: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.014209636s
addons_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:285: (dbg) Run:  kubectl --context addons-305325 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 ip
addons_test.go:296: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:296: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.053208309s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:298: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:302: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:305: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:310: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 addons disable ingress --alsologtostderr -v=1
addons_test.go:310: (dbg) Done: out/minikube-linux-arm64 -p addons-305325 addons disable ingress --alsologtostderr -v=1: (7.74466862s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-305325
helpers_test.go:235: (dbg) docker inspect addons-305325:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "89f7b65f1b5c036c8ce524c41364da9fa20dc5d8cea7127d73fdb2566197abf8",
	        "Created": "2023-10-30T10:45:08.588272527Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1042074,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-10-30T10:45:08.91217132Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:eaa28633b306b28bfcc42e43d12d56f9c0e18264fba46e5664387f4f16279f20",
	        "ResolvConfPath": "/var/lib/docker/containers/89f7b65f1b5c036c8ce524c41364da9fa20dc5d8cea7127d73fdb2566197abf8/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/89f7b65f1b5c036c8ce524c41364da9fa20dc5d8cea7127d73fdb2566197abf8/hostname",
	        "HostsPath": "/var/lib/docker/containers/89f7b65f1b5c036c8ce524c41364da9fa20dc5d8cea7127d73fdb2566197abf8/hosts",
	        "LogPath": "/var/lib/docker/containers/89f7b65f1b5c036c8ce524c41364da9fa20dc5d8cea7127d73fdb2566197abf8/89f7b65f1b5c036c8ce524c41364da9fa20dc5d8cea7127d73fdb2566197abf8-json.log",
	        "Name": "/addons-305325",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "addons-305325:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-305325",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/5c9e5115cd9b0f11860a079e35351f1767de3e0e669287b97f702969b697ea67-init/diff:/var/lib/docker/overlay2/6920698f3346b3432ee81cea1fd7786c03f9eb8a308b22649a01a181a8116dbb/diff",
	                "MergedDir": "/var/lib/docker/overlay2/5c9e5115cd9b0f11860a079e35351f1767de3e0e669287b97f702969b697ea67/merged",
	                "UpperDir": "/var/lib/docker/overlay2/5c9e5115cd9b0f11860a079e35351f1767de3e0e669287b97f702969b697ea67/diff",
	                "WorkDir": "/var/lib/docker/overlay2/5c9e5115cd9b0f11860a079e35351f1767de3e0e669287b97f702969b697ea67/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "addons-305325",
	                "Source": "/var/lib/docker/volumes/addons-305325/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-305325",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-305325",
	                "name.minikube.sigs.k8s.io": "addons-305325",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "dff4a039a50a505d21c68426561a3988e0a33119d2f2aa62f9bd8642e64198ad",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39405"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39404"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39401"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39403"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39402"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/dff4a039a50a",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-305325": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "89f7b65f1b5c",
	                        "addons-305325"
	                    ],
	                    "NetworkID": "fbc538df73b3fca26df1cacbba5d9baa1551c2ff7070c9f3541eb5096e3644c0",
	                    "EndpointID": "88140fd9f4450ed89e2415c644dc066fa5291e31f705bd9f93fa1b16000bab1b",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-305325 -n addons-305325
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-305325 logs -n 25: (1.166558801s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|---------------------------------------------------------------------------------------------|------------------------|---------|----------------|---------------------|---------------------|
	| Command |                                            Args                                             |        Profile         |  User   |    Version     |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|----------------|---------------------|---------------------|
	| delete  | --all                                                                                       | minikube               | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC | 30 Oct 23 10:44 UTC |
	| delete  | -p download-only-618370                                                                     | download-only-618370   | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC | 30 Oct 23 10:44 UTC |
	| delete  | -p download-only-618370                                                                     | download-only-618370   | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC | 30 Oct 23 10:44 UTC |
	| start   | --download-only -p                                                                          | download-docker-943117 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC |                     |
	|         | download-docker-943117                                                                      |                        |         |                |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |                |                     |                     |
	|         | --driver=docker                                                                             |                        |         |                |                     |                     |
	|         | --container-runtime=docker                                                                  |                        |         |                |                     |                     |
	| delete  | -p download-docker-943117                                                                   | download-docker-943117 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC | 30 Oct 23 10:44 UTC |
	| start   | --download-only -p                                                                          | binary-mirror-292513   | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC |                     |
	|         | binary-mirror-292513                                                                        |                        |         |                |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |                |                     |                     |
	|         | --binary-mirror                                                                             |                        |         |                |                     |                     |
	|         | http://127.0.0.1:40851                                                                      |                        |         |                |                     |                     |
	|         | --driver=docker                                                                             |                        |         |                |                     |                     |
	|         | --container-runtime=docker                                                                  |                        |         |                |                     |                     |
	| delete  | -p binary-mirror-292513                                                                     | binary-mirror-292513   | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC | 30 Oct 23 10:44 UTC |
	| addons  | enable dashboard -p                                                                         | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC |                     |
	|         | addons-305325                                                                               |                        |         |                |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC |                     |
	|         | addons-305325                                                                               |                        |         |                |                     |                     |
	| start   | -p addons-305325 --wait=true                                                                | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC | 30 Oct 23 10:47 UTC |
	|         | --memory=4000 --alsologtostderr                                                             |                        |         |                |                     |                     |
	|         | --addons=registry                                                                           |                        |         |                |                     |                     |
	|         | --addons=metrics-server                                                                     |                        |         |                |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                        |         |                |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                        |         |                |                     |                     |
	|         | --addons=gcp-auth                                                                           |                        |         |                |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                        |         |                |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                        |         |                |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                        |         |                |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                        |         |                |                     |                     |
	|         | --driver=docker                                                                             |                        |         |                |                     |                     |
	|         | --container-runtime=docker                                                                  |                        |         |                |                     |                     |
	|         | --addons=ingress                                                                            |                        |         |                |                     |                     |
	|         | --addons=ingress-dns                                                                        |                        |         |                |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:47 UTC | 30 Oct 23 10:47 UTC |
	|         | -p addons-305325                                                                            |                        |         |                |                     |                     |
	| ip      | addons-305325 ip                                                                            | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:47 UTC | 30 Oct 23 10:47 UTC |
	| addons  | addons-305325 addons disable                                                                | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:47 UTC | 30 Oct 23 10:47 UTC |
	|         | registry --alsologtostderr                                                                  |                        |         |                |                     |                     |
	|         | -v=1                                                                                        |                        |         |                |                     |                     |
	| ssh     | addons-305325 ssh cat                                                                       | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:47 UTC | 30 Oct 23 10:47 UTC |
	|         | /opt/local-path-provisioner/pvc-bf7b679e-dc51-492c-8284-1be02d31f2c1_default_test-pvc/file1 |                        |         |                |                     |                     |
	| addons  | addons-305325 addons disable                                                                | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:47 UTC | 30 Oct 23 10:48 UTC |
	|         | storage-provisioner-rancher                                                                 |                        |         |                |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |                |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:47 UTC | 30 Oct 23 10:47 UTC |
	|         | addons-305325                                                                               |                        |         |                |                     |                     |
	| addons  | enable headlamp                                                                             | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:47 UTC | 30 Oct 23 10:47 UTC |
	|         | -p addons-305325                                                                            |                        |         |                |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |                |                     |                     |
	| addons  | addons-305325 addons                                                                        | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:48 UTC | 30 Oct 23 10:48 UTC |
	|         | disable metrics-server                                                                      |                        |         |                |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |                |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:48 UTC | 30 Oct 23 10:48 UTC |
	|         | addons-305325                                                                               |                        |         |                |                     |                     |
	| addons  | addons-305325 addons                                                                        | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:48 UTC | 30 Oct 23 10:48 UTC |
	|         | disable csi-hostpath-driver                                                                 |                        |         |                |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |                |                     |                     |
	| ssh     | addons-305325 ssh curl -s                                                                   | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:48 UTC | 30 Oct 23 10:48 UTC |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                        |         |                |                     |                     |
	|         | nginx.example.com'                                                                          |                        |         |                |                     |                     |
	| addons  | addons-305325 addons                                                                        | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:48 UTC | 30 Oct 23 10:48 UTC |
	|         | disable volumesnapshots                                                                     |                        |         |                |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |                |                     |                     |
	| ip      | addons-305325 ip                                                                            | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:48 UTC | 30 Oct 23 10:48 UTC |
	| addons  | addons-305325 addons disable                                                                | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:48 UTC | 30 Oct 23 10:48 UTC |
	|         | ingress-dns --alsologtostderr                                                               |                        |         |                |                     |                     |
	|         | -v=1                                                                                        |                        |         |                |                     |                     |
	| addons  | addons-305325 addons disable                                                                | addons-305325          | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:48 UTC | 30 Oct 23 10:49 UTC |
	|         | ingress --alsologtostderr -v=1                                                              |                        |         |                |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|----------------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/10/30 10:44:46
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.21.3 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1030 10:44:46.038872 1041618 out.go:296] Setting OutFile to fd 1 ...
	I1030 10:44:46.038993 1041618 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:44:46.039001 1041618 out.go:309] Setting ErrFile to fd 2...
	I1030 10:44:46.039007 1041618 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:44:46.039528 1041618 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
	I1030 10:44:46.040012 1041618 out.go:303] Setting JSON to false
	I1030 10:44:46.040837 1041618 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":156430,"bootTime":1698506256,"procs":157,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1048-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I1030 10:44:46.040908 1041618 start.go:138] virtualization:  
	I1030 10:44:46.043368 1041618 out.go:177] * [addons-305325] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	I1030 10:44:46.045747 1041618 out.go:177]   - MINIKUBE_LOCATION=17523
	I1030 10:44:46.047593 1041618 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 10:44:46.045833 1041618 notify.go:220] Checking for updates...
	I1030 10:44:46.049583 1041618 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	I1030 10:44:46.051508 1041618 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	I1030 10:44:46.053286 1041618 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1030 10:44:46.055448 1041618 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 10:44:46.057425 1041618 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 10:44:46.084921 1041618 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1030 10:44:46.085029 1041618 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:44:46.166390 1041618 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-10-30 10:44:46.156738165 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:44:46.166494 1041618 docker.go:295] overlay module found
	I1030 10:44:46.170324 1041618 out.go:177] * Using the docker driver based on user configuration
	I1030 10:44:46.172288 1041618 start.go:298] selected driver: docker
	I1030 10:44:46.172306 1041618 start.go:902] validating driver "docker" against <nil>
	I1030 10:44:46.172325 1041618 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 10:44:46.172934 1041618 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:44:46.239808 1041618 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-10-30 10:44:46.23078338 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:44:46.240002 1041618 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 10:44:46.240223 1041618 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 10:44:46.242484 1041618 out.go:177] * Using Docker driver with root privileges
	I1030 10:44:46.244730 1041618 cni.go:84] Creating CNI manager for ""
	I1030 10:44:46.244757 1041618 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 10:44:46.244769 1041618 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 10:44:46.244786 1041618 start_flags.go:323] config:
	{Name:addons-305325 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:addons-305325 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:
cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:44:46.246870 1041618 out.go:177] * Starting control plane node addons-305325 in cluster addons-305325
	I1030 10:44:46.248616 1041618 cache.go:121] Beginning downloading kic base image for docker with docker
	I1030 10:44:46.250363 1041618 out.go:177] * Pulling base image ...
	I1030 10:44:46.252342 1041618 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 10:44:46.252390 1041618 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4
	I1030 10:44:46.252403 1041618 cache.go:56] Caching tarball of preloaded images
	I1030 10:44:46.252483 1041618 preload.go:174] Found /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1030 10:44:46.252495 1041618 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 10:44:46.252867 1041618 profile.go:148] Saving config to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/config.json ...
	I1030 10:44:46.252894 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/config.json: {Name:mk811a6401774b06b29313d6569ddee0038fb770 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:44:46.253063 1041618 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local docker daemon
	I1030 10:44:46.270301 1041618 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 to local cache
	I1030 10:44:46.270427 1041618 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local cache directory
	I1030 10:44:46.270447 1041618 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local cache directory, skipping pull
	I1030 10:44:46.270452 1041618 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 exists in cache, skipping pull
	I1030 10:44:46.270462 1041618 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 as a tarball
	I1030 10:44:46.270469 1041618 cache.go:162] Loading gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 from local cache
	I1030 10:45:01.757811 1041618 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 from cached tarball
	I1030 10:45:01.757848 1041618 cache.go:194] Successfully downloaded all kic artifacts
	I1030 10:45:01.757889 1041618 start.go:365] acquiring machines lock for addons-305325: {Name:mk6b83bb9fec92eaaf0eab0bbc665a3ce4b8c467 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 10:45:01.758459 1041618 start.go:369] acquired machines lock for "addons-305325" in 543.594µs
	I1030 10:45:01.758497 1041618 start.go:93] Provisioning new machine with config: &{Name:addons-305325 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:addons-305325 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServ
erIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custo
mQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 10:45:01.758583 1041618 start.go:125] createHost starting for "" (driver="docker")
	I1030 10:45:01.761303 1041618 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I1030 10:45:01.761574 1041618 start.go:159] libmachine.API.Create for "addons-305325" (driver="docker")
	I1030 10:45:01.761611 1041618 client.go:168] LocalClient.Create starting
	I1030 10:45:01.761744 1041618 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem
	I1030 10:45:01.952785 1041618 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem
	I1030 10:45:02.248982 1041618 cli_runner.go:164] Run: docker network inspect addons-305325 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W1030 10:45:02.265433 1041618 cli_runner.go:211] docker network inspect addons-305325 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I1030 10:45:02.265511 1041618 network_create.go:281] running [docker network inspect addons-305325] to gather additional debugging logs...
	I1030 10:45:02.265531 1041618 cli_runner.go:164] Run: docker network inspect addons-305325
	W1030 10:45:02.282689 1041618 cli_runner.go:211] docker network inspect addons-305325 returned with exit code 1
	I1030 10:45:02.282719 1041618 network_create.go:284] error running [docker network inspect addons-305325]: docker network inspect addons-305325: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-305325 not found
	I1030 10:45:02.282735 1041618 network_create.go:286] output of [docker network inspect addons-305325]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-305325 not found
	
	** /stderr **
	I1030 10:45:02.282859 1041618 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1030 10:45:02.304497 1041618 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40026adf30}
	I1030 10:45:02.304531 1041618 network_create.go:124] attempt to create docker network addons-305325 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I1030 10:45:02.304594 1041618 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-305325 addons-305325
	I1030 10:45:02.377610 1041618 network_create.go:108] docker network addons-305325 192.168.49.0/24 created
	I1030 10:45:02.377642 1041618 kic.go:121] calculated static IP "192.168.49.2" for the "addons-305325" container
	I1030 10:45:02.377745 1041618 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I1030 10:45:02.394392 1041618 cli_runner.go:164] Run: docker volume create addons-305325 --label name.minikube.sigs.k8s.io=addons-305325 --label created_by.minikube.sigs.k8s.io=true
	I1030 10:45:02.413260 1041618 oci.go:103] Successfully created a docker volume addons-305325
	I1030 10:45:02.413358 1041618 cli_runner.go:164] Run: docker run --rm --name addons-305325-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-305325 --entrypoint /usr/bin/test -v addons-305325:/var gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 -d /var/lib
	I1030 10:45:04.513057 1041618 cli_runner.go:217] Completed: docker run --rm --name addons-305325-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-305325 --entrypoint /usr/bin/test -v addons-305325:/var gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 -d /var/lib: (2.099658001s)
	I1030 10:45:04.513090 1041618 oci.go:107] Successfully prepared a docker volume addons-305325
	I1030 10:45:04.513112 1041618 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 10:45:04.513131 1041618 kic.go:194] Starting extracting preloaded images to volume ...
	I1030 10:45:04.513228 1041618 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-305325:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 -I lz4 -xf /preloaded.tar -C /extractDir
	I1030 10:45:08.503705 1041618 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-305325:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 -I lz4 -xf /preloaded.tar -C /extractDir: (3.990435398s)
	I1030 10:45:08.503750 1041618 kic.go:203] duration metric: took 3.990616 seconds to extract preloaded images to volume
	W1030 10:45:08.503886 1041618 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I1030 10:45:08.504002 1041618 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I1030 10:45:08.572445 1041618 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-305325 --name addons-305325 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-305325 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-305325 --network addons-305325 --ip 192.168.49.2 --volume addons-305325:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612
	I1030 10:45:08.922176 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Running}}
	I1030 10:45:08.945874 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:08.972273 1041618 cli_runner.go:164] Run: docker exec addons-305325 stat /var/lib/dpkg/alternatives/iptables
	I1030 10:45:09.042810 1041618 oci.go:144] the created container "addons-305325" has a running status.
	I1030 10:45:09.042836 1041618 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa...
	I1030 10:45:09.917707 1041618 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I1030 10:45:09.955628 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:09.978084 1041618 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I1030 10:45:09.978107 1041618 kic_runner.go:114] Args: [docker exec --privileged addons-305325 chown docker:docker /home/docker/.ssh/authorized_keys]
	I1030 10:45:10.084053 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:10.109485 1041618 machine.go:88] provisioning docker machine ...
	I1030 10:45:10.109515 1041618 ubuntu.go:169] provisioning hostname "addons-305325"
	I1030 10:45:10.109613 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:10.129508 1041618 main.go:141] libmachine: Using SSH client type: native
	I1030 10:45:10.130058 1041618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39405 <nil> <nil>}
	I1030 10:45:10.130080 1041618 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-305325 && echo "addons-305325" | sudo tee /etc/hostname
	I1030 10:45:10.280731 1041618 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-305325
	
	I1030 10:45:10.280837 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:10.300310 1041618 main.go:141] libmachine: Using SSH client type: native
	I1030 10:45:10.300732 1041618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39405 <nil> <nil>}
	I1030 10:45:10.300772 1041618 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-305325' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-305325/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-305325' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1030 10:45:10.434842 1041618 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1030 10:45:10.434934 1041618 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17523-1035706/.minikube CaCertPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17523-1035706/.minikube}
	I1030 10:45:10.434971 1041618 ubuntu.go:177] setting up certificates
	I1030 10:45:10.435021 1041618 provision.go:83] configureAuth start
	I1030 10:45:10.435116 1041618 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-305325
	I1030 10:45:10.453315 1041618 provision.go:138] copyHostCerts
	I1030 10:45:10.453389 1041618 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.pem (1082 bytes)
	I1030 10:45:10.453517 1041618 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17523-1035706/.minikube/cert.pem (1123 bytes)
	I1030 10:45:10.453584 1041618 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17523-1035706/.minikube/key.pem (1679 bytes)
	I1030 10:45:10.453638 1041618 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca-key.pem org=jenkins.addons-305325 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-305325]
	I1030 10:45:11.131762 1041618 provision.go:172] copyRemoteCerts
	I1030 10:45:11.131830 1041618 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1030 10:45:11.131906 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:11.149944 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:11.244192 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I1030 10:45:11.272379 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I1030 10:45:11.300814 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I1030 10:45:11.329166 1041618 provision.go:86] duration metric: configureAuth took 894.114132ms
	I1030 10:45:11.329190 1041618 ubuntu.go:193] setting minikube options for container-runtime
	I1030 10:45:11.329383 1041618 config.go:182] Loaded profile config "addons-305325": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 10:45:11.329437 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:11.347023 1041618 main.go:141] libmachine: Using SSH client type: native
	I1030 10:45:11.347470 1041618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39405 <nil> <nil>}
	I1030 10:45:11.347488 1041618 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I1030 10:45:11.479463 1041618 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I1030 10:45:11.479488 1041618 ubuntu.go:71] root file system type: overlay
	I1030 10:45:11.479599 1041618 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I1030 10:45:11.479671 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:11.499008 1041618 main.go:141] libmachine: Using SSH client type: native
	I1030 10:45:11.499454 1041618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39405 <nil> <nil>}
	I1030 10:45:11.499540 1041618 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I1030 10:45:11.645011 1041618 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I1030 10:45:11.645103 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:11.663962 1041618 main.go:141] libmachine: Using SSH client type: native
	I1030 10:45:11.664389 1041618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39405 <nil> <nil>}
	I1030 10:45:11.664418 1041618 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I1030 10:45:12.485611 1041618 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-10-26 09:06:20.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-10-30 10:45:11.639646515 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I1030 10:45:12.485641 1041618 machine.go:91] provisioned docker machine in 2.376136156s
	I1030 10:45:12.485652 1041618 client.go:171] LocalClient.Create took 10.724032149s
	I1030 10:45:12.485690 1041618 start.go:167] duration metric: libmachine.API.Create for "addons-305325" took 10.724102237s
	I1030 10:45:12.485700 1041618 start.go:300] post-start starting for "addons-305325" (driver="docker")
	I1030 10:45:12.485710 1041618 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1030 10:45:12.485812 1041618 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1030 10:45:12.485851 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:12.505985 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:12.604502 1041618 ssh_runner.go:195] Run: cat /etc/os-release
	I1030 10:45:12.608799 1041618 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I1030 10:45:12.608841 1041618 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I1030 10:45:12.608878 1041618 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I1030 10:45:12.608890 1041618 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I1030 10:45:12.608909 1041618 filesync.go:126] Scanning /home/jenkins/minikube-integration/17523-1035706/.minikube/addons for local assets ...
	I1030 10:45:12.608995 1041618 filesync.go:126] Scanning /home/jenkins/minikube-integration/17523-1035706/.minikube/files for local assets ...
	I1030 10:45:12.609021 1041618 start.go:303] post-start completed in 123.315342ms
	I1030 10:45:12.609328 1041618 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-305325
	I1030 10:45:12.627720 1041618 profile.go:148] Saving config to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/config.json ...
	I1030 10:45:12.627990 1041618 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1030 10:45:12.628046 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:12.645835 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:12.735530 1041618 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I1030 10:45:12.741111 1041618 start.go:128] duration metric: createHost completed in 10.98251286s
	I1030 10:45:12.741137 1041618 start.go:83] releasing machines lock for "addons-305325", held for 10.982657523s
	I1030 10:45:12.741210 1041618 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-305325
	I1030 10:45:12.758391 1041618 ssh_runner.go:195] Run: cat /version.json
	I1030 10:45:12.758450 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:12.758532 1041618 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1030 10:45:12.758597 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:12.778890 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:12.787042 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:12.870183 1041618 ssh_runner.go:195] Run: systemctl --version
	I1030 10:45:13.011414 1041618 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I1030 10:45:13.017175 1041618 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I1030 10:45:13.046361 1041618 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I1030 10:45:13.046503 1041618 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I1030 10:45:13.079933 1041618 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I1030 10:45:13.079957 1041618 start.go:472] detecting cgroup driver to use...
	I1030 10:45:13.079988 1041618 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I1030 10:45:13.080090 1041618 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1030 10:45:13.099786 1041618 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I1030 10:45:13.111516 1041618 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1030 10:45:13.123674 1041618 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I1030 10:45:13.123748 1041618 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1030 10:45:13.135390 1041618 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1030 10:45:13.146878 1041618 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1030 10:45:13.158563 1041618 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1030 10:45:13.170447 1041618 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1030 10:45:13.181363 1041618 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1030 10:45:13.192833 1041618 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1030 10:45:13.203266 1041618 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1030 10:45:13.213416 1041618 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1030 10:45:13.312849 1041618 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1030 10:45:13.429109 1041618 start.go:472] detecting cgroup driver to use...
	I1030 10:45:13.429194 1041618 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I1030 10:45:13.429275 1041618 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I1030 10:45:13.445820 1041618 cruntime.go:279] skipping containerd shutdown because we are bound to it
	I1030 10:45:13.445935 1041618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1030 10:45:13.461004 1041618 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1030 10:45:13.481822 1041618 ssh_runner.go:195] Run: which cri-dockerd
	I1030 10:45:13.486706 1041618 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I1030 10:45:13.496950 1041618 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I1030 10:45:13.522911 1041618 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I1030 10:45:13.631618 1041618 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I1030 10:45:13.735474 1041618 docker.go:555] configuring docker to use "cgroupfs" as cgroup driver...
	I1030 10:45:13.735613 1041618 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I1030 10:45:13.758628 1041618 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1030 10:45:13.850424 1041618 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1030 10:45:14.118703 1041618 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1030 10:45:14.222588 1041618 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I1030 10:45:14.324035 1041618 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1030 10:45:14.422887 1041618 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1030 10:45:14.511945 1041618 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I1030 10:45:14.528753 1041618 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1030 10:45:14.620516 1041618 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
	I1030 10:45:14.704853 1041618 start.go:519] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I1030 10:45:14.704942 1041618 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I1030 10:45:14.709540 1041618 start.go:540] Will wait 60s for crictl version
	I1030 10:45:14.709610 1041618 ssh_runner.go:195] Run: which crictl
	I1030 10:45:14.715433 1041618 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I1030 10:45:14.770905 1041618 start.go:556] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  24.0.7
	RuntimeApiVersion:  v1
	I1030 10:45:14.770971 1041618 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1030 10:45:14.797855 1041618 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1030 10:45:14.828922 1041618 out.go:204] * Preparing Kubernetes v1.28.3 on Docker 24.0.7 ...
	I1030 10:45:14.829025 1041618 cli_runner.go:164] Run: docker network inspect addons-305325 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1030 10:45:14.845935 1041618 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I1030 10:45:14.850379 1041618 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1030 10:45:14.863526 1041618 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 10:45:14.863587 1041618 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1030 10:45:14.884630 1041618 docker.go:693] Got preloaded images: -- stdout --
	registry.k8s.io/kube-scheduler:v1.28.3
	registry.k8s.io/kube-apiserver:v1.28.3
	registry.k8s.io/kube-controller-manager:v1.28.3
	registry.k8s.io/kube-proxy:v1.28.3
	registry.k8s.io/etcd:3.5.9-0
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1030 10:45:14.884655 1041618 docker.go:623] Images already preloaded, skipping extraction
	I1030 10:45:14.884722 1041618 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1030 10:45:14.905703 1041618 docker.go:693] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.28.3
	registry.k8s.io/kube-controller-manager:v1.28.3
	registry.k8s.io/kube-scheduler:v1.28.3
	registry.k8s.io/kube-proxy:v1.28.3
	registry.k8s.io/etcd:3.5.9-0
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1030 10:45:14.905730 1041618 cache_images.go:84] Images are preloaded, skipping loading
	I1030 10:45:14.905802 1041618 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I1030 10:45:14.974808 1041618 cni.go:84] Creating CNI manager for ""
	I1030 10:45:14.974832 1041618 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 10:45:14.974863 1041618 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I1030 10:45:14.974887 1041618 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.28.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-305325 NodeName:addons-305325 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I1030 10:45:14.975046 1041618 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "addons-305325"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1030 10:45:14.975103 1041618 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-305325 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.3 ClusterName:addons-305325 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I1030 10:45:14.975162 1041618 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.3
	I1030 10:45:14.985563 1041618 binaries.go:44] Found k8s binaries, skipping transfer
	I1030 10:45:14.985699 1041618 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1030 10:45:14.996004 1041618 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
	I1030 10:45:15.026355 1041618 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I1030 10:45:15.048396 1041618 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I1030 10:45:15.070678 1041618 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I1030 10:45:15.075532 1041618 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1030 10:45:15.091443 1041618 certs.go:56] Setting up /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325 for IP: 192.168.49.2
	I1030 10:45:15.091479 1041618 certs.go:190] acquiring lock for shared ca certs: {Name:mk35ac8fef6dbcf5959ebe65369e3fe30a1c5574 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:15.092447 1041618 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.key
	I1030 10:45:16.259199 1041618 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt ...
	I1030 10:45:16.259231 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt: {Name:mkc392d9fe2d0312b0e320fb2dcb09686c0a2960 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:16.259438 1041618 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.key ...
	I1030 10:45:16.259453 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.key: {Name:mk3b8caf0b626c1304f44b07bb7201dc8a3f644b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:16.260279 1041618 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.key
	I1030 10:45:16.906113 1041618 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.crt ...
	I1030 10:45:16.906145 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.crt: {Name:mkf2cf8d11d1054fb71cac010a131bdc546103ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:16.906335 1041618 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.key ...
	I1030 10:45:16.906348 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.key: {Name:mk1046b7a394b5527df8a2538ad06e31f2959faf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:16.906472 1041618 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.key
	I1030 10:45:16.906489 1041618 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt with IP's: []
	I1030 10:45:17.364493 1041618 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt ...
	I1030 10:45:17.364525 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: {Name:mk20d14c01a66e7c946f46cfe4ff8ba1006fbdae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:17.364714 1041618 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.key ...
	I1030 10:45:17.364727 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.key: {Name:mk7b5ea37cf5cba574db449e2ddd70bf9390fd79 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:17.365246 1041618 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.key.dd3b5fb2
	I1030 10:45:17.365269 1041618 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I1030 10:45:17.769318 1041618 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.crt.dd3b5fb2 ...
	I1030 10:45:17.769347 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.crt.dd3b5fb2: {Name:mk995bc0b446ab376bc9b529435dfd7359f1446c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:17.769985 1041618 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.key.dd3b5fb2 ...
	I1030 10:45:17.770002 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.key.dd3b5fb2: {Name:mk3c2dd2a377b7065b2ab862ca1ad87e9d541af7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:17.770095 1041618 certs.go:337] copying /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.crt
	I1030 10:45:17.770175 1041618 certs.go:341] copying /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.key
	I1030 10:45:17.770231 1041618 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/proxy-client.key
	I1030 10:45:17.770252 1041618 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/proxy-client.crt with IP's: []
	I1030 10:45:18.324829 1041618 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/proxy-client.crt ...
	I1030 10:45:18.324863 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/proxy-client.crt: {Name:mk6c08be920a3a61212fa1aa922c9109df45618a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:18.325065 1041618 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/proxy-client.key ...
	I1030 10:45:18.325078 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/proxy-client.key: {Name:mkb57f808b861d9bf60a28098ef50806d2748075 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:18.325273 1041618 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca-key.pem (1679 bytes)
	I1030 10:45:18.325322 1041618 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem (1082 bytes)
	I1030 10:45:18.325353 1041618 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem (1123 bytes)
	I1030 10:45:18.325382 1041618 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/key.pem (1679 bytes)
	I1030 10:45:18.326090 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I1030 10:45:18.354194 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I1030 10:45:18.381878 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1030 10:45:18.410640 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I1030 10:45:18.438953 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1030 10:45:18.467453 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I1030 10:45:18.497083 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1030 10:45:18.525938 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I1030 10:45:18.554785 1041618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1030 10:45:18.583540 1041618 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
	I1030 10:45:18.604627 1041618 ssh_runner.go:195] Run: openssl version
	I1030 10:45:18.611781 1041618 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1030 10:45:18.623251 1041618 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1030 10:45:18.627953 1041618 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct 30 10:45 /usr/share/ca-certificates/minikubeCA.pem
	I1030 10:45:18.628010 1041618 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1030 10:45:18.636235 1041618 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1030 10:45:18.647890 1041618 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I1030 10:45:18.652161 1041618 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I1030 10:45:18.652210 1041618 kubeadm.go:404] StartCluster: {Name:addons-305325 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:addons-305325 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clu
ster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:45:18.652345 1041618 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1030 10:45:18.671745 1041618 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1030 10:45:18.682718 1041618 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1030 10:45:18.693180 1041618 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I1030 10:45:18.693244 1041618 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1030 10:45:18.703991 1041618 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1030 10:45:18.704037 1041618 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I1030 10:45:18.757257 1041618 kubeadm.go:322] [init] Using Kubernetes version: v1.28.3
	I1030 10:45:18.757592 1041618 kubeadm.go:322] [preflight] Running pre-flight checks
	I1030 10:45:18.819492 1041618 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I1030 10:45:18.819560 1041618 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1048-aws
	I1030 10:45:18.819604 1041618 kubeadm.go:322] OS: Linux
	I1030 10:45:18.819651 1041618 kubeadm.go:322] CGROUPS_CPU: enabled
	I1030 10:45:18.819700 1041618 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I1030 10:45:18.819749 1041618 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I1030 10:45:18.819797 1041618 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I1030 10:45:18.819845 1041618 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I1030 10:45:18.819900 1041618 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I1030 10:45:18.819946 1041618 kubeadm.go:322] CGROUPS_PIDS: enabled
	I1030 10:45:18.819999 1041618 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I1030 10:45:18.820047 1041618 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I1030 10:45:18.900924 1041618 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1030 10:45:18.901040 1041618 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1030 10:45:18.901134 1041618 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1030 10:45:19.237802 1041618 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1030 10:45:19.241635 1041618 out.go:204]   - Generating certificates and keys ...
	I1030 10:45:19.241915 1041618 kubeadm.go:322] [certs] Using existing ca certificate authority
	I1030 10:45:19.242010 1041618 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I1030 10:45:19.706849 1041618 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I1030 10:45:20.370368 1041618 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I1030 10:45:20.729486 1041618 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I1030 10:45:21.053362 1041618 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I1030 10:45:21.742120 1041618 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I1030 10:45:21.742516 1041618 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-305325 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I1030 10:45:22.424038 1041618 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I1030 10:45:22.424206 1041618 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-305325 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I1030 10:45:22.684009 1041618 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I1030 10:45:23.003489 1041618 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I1030 10:45:23.679746 1041618 kubeadm.go:322] [certs] Generating "sa" key and public key
	I1030 10:45:23.680054 1041618 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1030 10:45:24.357107 1041618 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1030 10:45:24.658197 1041618 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1030 10:45:24.899213 1041618 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1030 10:45:25.293960 1041618 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1030 10:45:25.294567 1041618 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1030 10:45:25.297240 1041618 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1030 10:45:25.299726 1041618 out.go:204]   - Booting up control plane ...
	I1030 10:45:25.299852 1041618 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1030 10:45:25.299925 1041618 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1030 10:45:25.302627 1041618 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1030 10:45:25.317085 1041618 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1030 10:45:25.318192 1041618 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1030 10:45:25.318268 1041618 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I1030 10:45:25.424948 1041618 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1030 10:45:32.928696 1041618 kubeadm.go:322] [apiclient] All control plane components are healthy after 7.503480 seconds
	I1030 10:45:32.928840 1041618 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1030 10:45:32.948803 1041618 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I1030 10:45:33.480550 1041618 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I1030 10:45:33.480746 1041618 kubeadm.go:322] [mark-control-plane] Marking the node addons-305325 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I1030 10:45:33.992012 1041618 kubeadm.go:322] [bootstrap-token] Using token: jj7j9j.wmn6gulhejhjnr6q
	I1030 10:45:33.995591 1041618 out.go:204]   - Configuring RBAC rules ...
	I1030 10:45:33.995713 1041618 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1030 10:45:34.010597 1041618 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1030 10:45:34.018710 1041618 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1030 10:45:34.022514 1041618 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1030 10:45:34.026498 1041618 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1030 10:45:34.030310 1041618 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1030 10:45:34.044786 1041618 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1030 10:45:34.275170 1041618 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I1030 10:45:34.415159 1041618 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I1030 10:45:34.416616 1041618 kubeadm.go:322] 
	I1030 10:45:34.416689 1041618 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I1030 10:45:34.416699 1041618 kubeadm.go:322] 
	I1030 10:45:34.416773 1041618 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I1030 10:45:34.416782 1041618 kubeadm.go:322] 
	I1030 10:45:34.416807 1041618 kubeadm.go:322]   mkdir -p $HOME/.kube
	I1030 10:45:34.416875 1041618 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1030 10:45:34.416960 1041618 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1030 10:45:34.416970 1041618 kubeadm.go:322] 
	I1030 10:45:34.417021 1041618 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I1030 10:45:34.417030 1041618 kubeadm.go:322] 
	I1030 10:45:34.417075 1041618 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I1030 10:45:34.417084 1041618 kubeadm.go:322] 
	I1030 10:45:34.417133 1041618 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I1030 10:45:34.417207 1041618 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1030 10:45:34.417274 1041618 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1030 10:45:34.417283 1041618 kubeadm.go:322] 
	I1030 10:45:34.417362 1041618 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I1030 10:45:34.417457 1041618 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I1030 10:45:34.417465 1041618 kubeadm.go:322] 
	I1030 10:45:34.417544 1041618 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token jj7j9j.wmn6gulhejhjnr6q \
	I1030 10:45:34.417644 1041618 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:ce9a292b1ae26f9fbe2c4b69b1075579d7565513efa42432b5fb2190effcab02 \
	I1030 10:45:34.417668 1041618 kubeadm.go:322] 	--control-plane 
	I1030 10:45:34.417696 1041618 kubeadm.go:322] 
	I1030 10:45:34.417778 1041618 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I1030 10:45:34.417789 1041618 kubeadm.go:322] 
	I1030 10:45:34.417866 1041618 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token jj7j9j.wmn6gulhejhjnr6q \
	I1030 10:45:34.417965 1041618 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:ce9a292b1ae26f9fbe2c4b69b1075579d7565513efa42432b5fb2190effcab02 
	I1030 10:45:34.420938 1041618 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1048-aws\n", err: exit status 1
	I1030 10:45:34.421060 1041618 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1030 10:45:34.421098 1041618 cni.go:84] Creating CNI manager for ""
	I1030 10:45:34.421147 1041618 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 10:45:34.424737 1041618 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I1030 10:45:34.427052 1041618 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I1030 10:45:34.441517 1041618 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
	I1030 10:45:34.475412 1041618 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1030 10:45:34.475556 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:34.475634 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl label nodes minikube.k8s.io/version=v1.32.0-beta.0 minikube.k8s.io/commit=99c50ab9af570595672bd37bf6c89e1874e94ce6 minikube.k8s.io/name=addons-305325 minikube.k8s.io/updated_at=2023_10_30T10_45_34_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:34.835109 1041618 ops.go:34] apiserver oom_adj: -16
	I1030 10:45:34.835229 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:34.929273 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:35.528203 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:36.027956 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:36.528246 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:37.027625 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:37.528155 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:38.028314 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:38.527663 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:39.028214 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:39.528225 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:40.028333 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:40.528462 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:41.027804 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:41.527835 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:42.027673 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:42.528065 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:43.027754 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:43.528301 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:44.027659 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:44.528405 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:45.027831 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:45.527753 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:46.028466 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:46.528294 1041618 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:45:46.629430 1041618 kubeadm.go:1081] duration metric: took 12.153905344s to wait for elevateKubeSystemPrivileges.
	I1030 10:45:46.629459 1041618 kubeadm.go:406] StartCluster complete in 27.977253448s
	I1030 10:45:46.629477 1041618 settings.go:142] acquiring lock: {Name:mk9300d27314fbb0c685d690de8daf59e1e7eaad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:46.629605 1041618 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17523-1035706/kubeconfig
	I1030 10:45:46.630054 1041618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/kubeconfig: {Name:mk499c0a7679b260b6d0f05a73cda6c48a73e416 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:45:46.632209 1041618 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I1030 10:45:46.632444 1041618 config.go:182] Loaded profile config "addons-305325": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 10:45:46.632479 1041618 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true]
	I1030 10:45:46.632547 1041618 addons.go:69] Setting volumesnapshots=true in profile "addons-305325"
	I1030 10:45:46.632566 1041618 addons.go:231] Setting addon volumesnapshots=true in "addons-305325"
	I1030 10:45:46.632603 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.633049 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.633640 1041618 addons.go:69] Setting ingress-dns=true in profile "addons-305325"
	I1030 10:45:46.633660 1041618 addons.go:231] Setting addon ingress-dns=true in "addons-305325"
	I1030 10:45:46.633710 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.634098 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.634206 1041618 addons.go:69] Setting inspektor-gadget=true in profile "addons-305325"
	I1030 10:45:46.634222 1041618 addons.go:231] Setting addon inspektor-gadget=true in "addons-305325"
	I1030 10:45:46.634251 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.634609 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.634952 1041618 addons.go:69] Setting cloud-spanner=true in profile "addons-305325"
	I1030 10:45:46.634973 1041618 addons.go:231] Setting addon cloud-spanner=true in "addons-305325"
	I1030 10:45:46.635004 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.635378 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.637054 1041618 addons.go:69] Setting metrics-server=true in profile "addons-305325"
	I1030 10:45:46.637078 1041618 addons.go:231] Setting addon metrics-server=true in "addons-305325"
	I1030 10:45:46.637119 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.637512 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.638769 1041618 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-305325"
	I1030 10:45:46.638816 1041618 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-305325"
	I1030 10:45:46.638857 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.639251 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.642047 1041618 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-305325"
	I1030 10:45:46.642066 1041618 addons.go:231] Setting addon nvidia-device-plugin=true in "addons-305325"
	I1030 10:45:46.642108 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.642503 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.653969 1041618 addons.go:69] Setting default-storageclass=true in profile "addons-305325"
	I1030 10:45:46.653998 1041618 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-305325"
	I1030 10:45:46.654401 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.654737 1041618 addons.go:69] Setting registry=true in profile "addons-305325"
	I1030 10:45:46.654755 1041618 addons.go:231] Setting addon registry=true in "addons-305325"
	I1030 10:45:46.654795 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.655167 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.664473 1041618 addons.go:69] Setting gcp-auth=true in profile "addons-305325"
	I1030 10:45:46.664508 1041618 mustload.go:65] Loading cluster: addons-305325
	I1030 10:45:46.664793 1041618 config.go:182] Loaded profile config "addons-305325": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 10:45:46.665056 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.669733 1041618 addons.go:69] Setting storage-provisioner=true in profile "addons-305325"
	I1030 10:45:46.669764 1041618 addons.go:231] Setting addon storage-provisioner=true in "addons-305325"
	I1030 10:45:46.669813 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.670364 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.682560 1041618 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-305325"
	I1030 10:45:46.682591 1041618 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-305325"
	I1030 10:45:46.682914 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.705438 1041618 addons.go:69] Setting ingress=true in profile "addons-305325"
	I1030 10:45:46.705520 1041618 addons.go:231] Setting addon ingress=true in "addons-305325"
	I1030 10:45:46.705896 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.708028 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.784128 1041618 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4
	I1030 10:45:46.786206 1041618 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I1030 10:45:46.786225 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I1030 10:45:46.786290 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:46.805245 1041618 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I1030 10:45:46.811053 1041618 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I1030 10:45:46.811074 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I1030 10:45:46.811135 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:46.815945 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I1030 10:45:46.805228 1041618 addons.go:231] Setting addon default-storageclass=true in "addons-305325"
	I1030 10:45:46.823712 1041618 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I1030 10:45:46.824431 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.825221 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.833802 1041618 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.21.0
	I1030 10:45:46.836410 1041618 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
	I1030 10:45:46.836429 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I1030 10:45:46.836486 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:46.833866 1041618 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.11
	I1030 10:45:46.833871 1041618 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.2
	I1030 10:45:46.833880 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I1030 10:45:46.833892 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I1030 10:45:46.834364 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.856412 1041618 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
	I1030 10:45:46.856431 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I1030 10:45:46.856496 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:46.877203 1041618 addons.go:423] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I1030 10:45:46.877229 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I1030 10:45:46.877303 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:46.885211 1041618 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-305325" context rescaled to 1 replicas
	I1030 10:45:46.885247 1041618 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 10:45:46.894180 1041618 out.go:177] * Verifying Kubernetes components...
	I1030 10:45:46.896145 1041618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1030 10:45:46.889667 1041618 addons.go:231] Setting addon storage-provisioner-rancher=true in "addons-305325"
	I1030 10:45:46.897792 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:46.898318 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:46.900551 1041618 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 10:45:46.894468 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:46.936662 1041618 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1030 10:45:46.936682 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1030 10:45:46.936761 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:46.956070 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I1030 10:45:46.958982 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I1030 10:45:46.960794 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I1030 10:45:46.963951 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I1030 10:45:46.965766 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I1030 10:45:46.969494 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I1030 10:45:46.974931 1041618 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.9.3
	I1030 10:45:46.996368 1041618 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1030 10:45:47.019935 1041618 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I1030 10:45:46.996775 1041618 out.go:177]   - Using image docker.io/registry:2.8.3
	I1030 10:45:47.026313 1041618 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I1030 10:45:47.023316 1041618 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I1030 10:45:47.028254 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I1030 10:45:47.028333 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:47.037500 1041618 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1030 10:45:47.028824 1041618 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
	I1030 10:45:47.037914 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.037943 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.039708 1041618 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I1030 10:45:47.042370 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16103 bytes)
	I1030 10:45:47.042487 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:47.043660 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.049890 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I1030 10:45:47.049963 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:47.121073 1041618 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I1030 10:45:47.121093 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1030 10:45:47.121267 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:47.121557 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.139009 1041618 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I1030 10:45:47.141226 1041618 out.go:177]   - Using image docker.io/busybox:stable
	I1030 10:45:47.143339 1041618 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I1030 10:45:47.143360 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I1030 10:45:47.143425 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:47.186948 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.190594 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.192797 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.257972 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.259379 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.274059 1041618 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I1030 10:45:47.274930 1041618 node_ready.go:35] waiting up to 6m0s for node "addons-305325" to be "Ready" ...
	I1030 10:45:47.276926 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.291559 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.292280 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:47.296817 1041618 node_ready.go:49] node "addons-305325" has status "Ready":"True"
	I1030 10:45:47.296838 1041618 node_ready.go:38] duration metric: took 21.886192ms waiting for node "addons-305325" to be "Ready" ...
	I1030 10:45:47.296849 1041618 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1030 10:45:47.316529 1041618 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace to be "Ready" ...
	I1030 10:45:47.668693 1041618 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I1030 10:45:47.668761 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I1030 10:45:47.677342 1041618 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I1030 10:45:47.677410 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I1030 10:45:47.701741 1041618 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I1030 10:45:47.701810 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I1030 10:45:47.732369 1041618 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I1030 10:45:47.732443 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I1030 10:45:47.815031 1041618 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
	I1030 10:45:47.815103 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I1030 10:45:47.925762 1041618 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
	I1030 10:45:47.925831 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I1030 10:45:47.942236 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I1030 10:45:47.988713 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I1030 10:45:47.989021 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1030 10:45:47.991711 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I1030 10:45:48.098087 1041618 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I1030 10:45:48.098157 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I1030 10:45:48.118513 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1030 10:45:48.184670 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I1030 10:45:48.194144 1041618 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I1030 10:45:48.194167 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I1030 10:45:48.250896 1041618 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I1030 10:45:48.250921 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I1030 10:45:48.290821 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I1030 10:45:48.343528 1041618 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I1030 10:45:48.343553 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I1030 10:45:48.396726 1041618 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
	I1030 10:45:48.396746 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I1030 10:45:48.458839 1041618 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I1030 10:45:48.458863 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I1030 10:45:48.611988 1041618 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I1030 10:45:48.612014 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I1030 10:45:48.622513 1041618 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I1030 10:45:48.622547 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I1030 10:45:48.625351 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I1030 10:45:48.678860 1041618 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I1030 10:45:48.678886 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I1030 10:45:48.892040 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I1030 10:45:49.059543 1041618 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I1030 10:45:49.059614 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I1030 10:45:49.060260 1041618 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I1030 10:45:49.060312 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I1030 10:45:49.108018 1041618 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I1030 10:45:49.108045 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I1030 10:45:49.355196 1041618 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I1030 10:45:49.355222 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I1030 10:45:49.365488 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:45:49.437233 1041618 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I1030 10:45:49.437257 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I1030 10:45:49.525243 1041618 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
	I1030 10:45:49.525268 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I1030 10:45:49.543158 1041618 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I1030 10:45:49.543181 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I1030 10:45:49.754217 1041618 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1030 10:45:49.754240 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I1030 10:45:49.803193 1041618 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I1030 10:45:49.803218 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I1030 10:45:49.877653 1041618 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I1030 10:45:49.877719 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I1030 10:45:49.958029 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1030 10:45:50.098895 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I1030 10:45:50.206369 1041618 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I1030 10:45:50.206389 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I1030 10:45:50.512250 1041618 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I1030 10:45:50.512332 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I1030 10:45:50.908189 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I1030 10:45:51.181214 1041618 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.90711749s)
	I1030 10:45:51.181292 1041618 start.go:926] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I1030 10:45:51.181381 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.239076973s)
	I1030 10:45:51.181453 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.192671016s)
	I1030 10:45:51.181496 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.192429253s)
	I1030 10:45:51.366815 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:45:52.043005 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.05122044s)
	I1030 10:45:53.367321 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:45:53.441304 1041618 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I1030 10:45:53.441379 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:53.473930 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (5.3553665s)
	I1030 10:45:53.475451 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:54.413071 1041618 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I1030 10:45:54.730321 1041618 addons.go:231] Setting addon gcp-auth=true in "addons-305325"
	I1030 10:45:54.730367 1041618 host.go:66] Checking if "addons-305325" exists ...
	I1030 10:45:54.730848 1041618 cli_runner.go:164] Run: docker container inspect addons-305325 --format={{.State.Status}}
	I1030 10:45:54.761137 1041618 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I1030 10:45:54.761187 1041618 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-305325
	I1030 10:45:54.798340 1041618 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39405 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/addons-305325/id_rsa Username:docker}
	I1030 10:45:55.867127 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:45:56.360847 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.176138882s)
	I1030 10:45:56.360941 1041618 addons.go:467] Verifying addon ingress=true in "addons-305325"
	I1030 10:45:56.363394 1041618 out.go:177] * Verifying ingress addon...
	I1030 10:45:56.361187 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.070336402s)
	I1030 10:45:56.361226 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.735847844s)
	I1030 10:45:56.361405 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.469337335s)
	I1030 10:45:56.361552 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.262625215s)
	I1030 10:45:56.361564 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.403435855s)
	I1030 10:45:56.363692 1041618 addons.go:467] Verifying addon registry=true in "addons-305325"
	I1030 10:45:56.363705 1041618 addons.go:467] Verifying addon metrics-server=true in "addons-305325"
	W1030 10:45:56.363862 1041618 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I1030 10:45:56.367252 1041618 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I1030 10:45:56.368236 1041618 out.go:177] * Verifying registry addon...
	I1030 10:45:56.371186 1041618 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I1030 10:45:56.368357 1041618 retry.go:31] will retry after 244.740281ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I1030 10:45:56.379980 1041618 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I1030 10:45:56.380041 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:56.407217 1041618 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I1030 10:45:56.407290 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:45:56.416839 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:56.424838 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:45:56.617229 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1030 10:45:56.925198 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:56.940431 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:45:57.433096 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:57.445058 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:45:57.880596 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:45:57.921711 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:57.931243 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:45:58.122144 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.213856179s)
	I1030 10:45:58.122224 1041618 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-305325"
	I1030 10:45:58.122547 1041618 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.36138826s)
	I1030 10:45:58.126513 1041618 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1030 10:45:58.124428 1041618 out.go:177] * Verifying csi-hostpath-driver addon...
	I1030 10:45:58.131332 1041618 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I1030 10:45:58.133365 1041618 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I1030 10:45:58.135290 1041618 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I1030 10:45:58.135307 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I1030 10:45:58.137245 1041618 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I1030 10:45:58.137316 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:45:58.142713 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:45:58.201066 1041618 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I1030 10:45:58.201135 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I1030 10:45:58.235794 1041618 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I1030 10:45:58.235852 1041618 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5432 bytes)
	I1030 10:45:58.271038 1041618 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I1030 10:45:58.421998 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:58.429432 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:45:58.649300 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:45:58.921912 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:58.930957 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:45:59.089137 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.471803981s)
	I1030 10:45:59.149217 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:45:59.420816 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:59.431610 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:45:59.673311 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:45:59.752955 1041618 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.481844416s)
	I1030 10:45:59.754738 1041618 addons.go:467] Verifying addon gcp-auth=true in "addons-305325"
	I1030 10:45:59.760094 1041618 out.go:177] * Verifying gcp-auth addon...
	I1030 10:45:59.763662 1041618 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I1030 10:45:59.768009 1041618 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I1030 10:45:59.768028 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:45:59.775452 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:45:59.921310 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:45:59.929645 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:00.149335 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:00.279977 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:00.366277 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:00.422314 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:00.430290 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:00.648746 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:00.778975 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:00.922049 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:00.930047 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:01.148778 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:01.279225 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:01.422222 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:01.431241 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:01.648284 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:01.779842 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:01.921592 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:01.930404 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:02.150216 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:02.280083 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:02.421833 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:02.430592 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:02.648176 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:02.779964 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:02.866237 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:02.921633 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:02.930653 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:03.148239 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:03.279953 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:03.421624 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:03.430100 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:03.650263 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:03.780164 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:03.921571 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:03.930036 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:04.150145 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:04.279956 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:04.421873 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:04.434770 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:04.649965 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:04.779806 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:04.873953 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:04.932580 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:04.933259 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:05.148483 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:05.281896 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:05.422150 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:05.430458 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:05.654453 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:05.780648 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:05.921765 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:05.930238 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:06.148656 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:06.279477 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:06.422013 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:06.430172 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:06.649492 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:06.779444 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:06.922268 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:06.930130 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:07.148323 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:07.279623 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:07.365769 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:07.422292 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:07.431597 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:07.653160 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:07.781107 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:07.921543 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:07.930466 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:08.149300 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:08.278884 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:08.421544 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:08.430358 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:08.649336 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:08.783913 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:08.921343 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:08.930485 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:09.148387 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:09.279985 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:09.365983 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:09.421387 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:09.430821 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:09.653885 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:09.779624 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:09.923363 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:09.930055 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:10.150393 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:10.280147 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:10.421840 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:10.430801 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:10.649444 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:10.779830 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:10.921043 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:10.929872 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:11.149325 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:11.280093 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:11.366976 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:11.421353 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:11.430677 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:11.648453 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:11.779027 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:11.921491 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:11.930761 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:12.150214 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:12.279492 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:12.421654 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:12.430744 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:12.648135 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:12.779899 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:12.922375 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:12.930610 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:13.148847 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:13.279067 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:13.377141 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:13.421988 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:13.430435 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:13.653041 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:13.779245 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:13.928012 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:13.935018 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:14.152710 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:14.279454 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:14.421340 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:14.429778 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:14.648529 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:14.779185 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:14.921541 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:14.929841 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:15.148928 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:15.279508 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:15.421124 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:15.429527 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:15.648191 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:15.780275 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:15.866254 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:15.922245 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:15.930048 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:16.149011 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:16.281599 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:16.421613 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:16.431042 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:16.649774 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:16.782559 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:16.923086 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:16.931067 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:17.150156 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:17.280100 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:17.422724 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:17.431970 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:17.649073 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:17.780173 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:17.867726 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:17.922672 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:17.931455 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:18.150052 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:18.280016 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:18.422335 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:18.431569 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:18.650645 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:18.779473 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:18.922274 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:18.930647 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:19.151788 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:19.279383 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:19.422369 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:19.430913 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:19.650889 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:19.779733 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:19.923252 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:19.930881 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:20.150266 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:20.282730 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:20.385976 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:20.428932 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:20.432216 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:20.650479 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:20.779328 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:20.921558 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:20.930190 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:21.149468 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:21.279850 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:21.424224 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:21.431792 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:21.648146 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:21.779216 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:21.925557 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:21.937601 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1030 10:46:22.150497 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:22.280291 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:22.422684 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:22.429927 1041618 kapi.go:107] duration metric: took 26.058728507s to wait for kubernetes.io/minikube-addons=registry ...
	I1030 10:46:22.651279 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:22.780686 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:22.865796 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:22.921711 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:23.150390 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:23.279354 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:23.421579 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:23.648725 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:23.779633 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:23.925219 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:24.148955 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:24.279625 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:24.421906 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:24.648441 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:24.780074 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:24.866196 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:24.922090 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:25.148965 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:25.279999 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:25.421607 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:25.648927 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:25.779436 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:25.922756 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:26.149363 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:26.279455 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:26.424417 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:26.650854 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:26.779378 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:26.931847 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:27.153523 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:27.287288 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:27.365651 1041618 pod_ready.go:102] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"False"
	I1030 10:46:27.422351 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:27.656052 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:27.779722 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:27.864932 1041618 pod_ready.go:92] pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace has status "Ready":"True"
	I1030 10:46:27.864958 1041618 pod_ready.go:81] duration metric: took 40.548330657s waiting for pod "coredns-5dd5756b68-t4n9l" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.864971 1041618 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-zfdgz" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.867256 1041618 pod_ready.go:97] error getting pod "coredns-5dd5756b68-zfdgz" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-zfdgz" not found
	I1030 10:46:27.867284 1041618 pod_ready.go:81] duration metric: took 2.30437ms waiting for pod "coredns-5dd5756b68-zfdgz" in "kube-system" namespace to be "Ready" ...
	E1030 10:46:27.867294 1041618 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5dd5756b68-zfdgz" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-zfdgz" not found
	I1030 10:46:27.867301 1041618 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-305325" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.878402 1041618 pod_ready.go:92] pod "etcd-addons-305325" in "kube-system" namespace has status "Ready":"True"
	I1030 10:46:27.878434 1041618 pod_ready.go:81] duration metric: took 11.125536ms waiting for pod "etcd-addons-305325" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.878445 1041618 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-305325" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.884901 1041618 pod_ready.go:92] pod "kube-apiserver-addons-305325" in "kube-system" namespace has status "Ready":"True"
	I1030 10:46:27.884926 1041618 pod_ready.go:81] duration metric: took 6.473851ms waiting for pod "kube-apiserver-addons-305325" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.884938 1041618 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-305325" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.892243 1041618 pod_ready.go:92] pod "kube-controller-manager-addons-305325" in "kube-system" namespace has status "Ready":"True"
	I1030 10:46:27.892267 1041618 pod_ready.go:81] duration metric: took 7.32091ms waiting for pod "kube-controller-manager-addons-305325" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.892280 1041618 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-mp7j9" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:27.922036 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:28.062557 1041618 pod_ready.go:92] pod "kube-proxy-mp7j9" in "kube-system" namespace has status "Ready":"True"
	I1030 10:46:28.062582 1041618 pod_ready.go:81] duration metric: took 170.29565ms waiting for pod "kube-proxy-mp7j9" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:28.062597 1041618 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-305325" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:28.149475 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:28.279734 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:28.421320 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:28.463093 1041618 pod_ready.go:92] pod "kube-scheduler-addons-305325" in "kube-system" namespace has status "Ready":"True"
	I1030 10:46:28.463120 1041618 pod_ready.go:81] duration metric: took 400.515366ms waiting for pod "kube-scheduler-addons-305325" in "kube-system" namespace to be "Ready" ...
	I1030 10:46:28.463130 1041618 pod_ready.go:38] duration metric: took 41.166270595s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1030 10:46:28.463149 1041618 api_server.go:52] waiting for apiserver process to appear ...
	I1030 10:46:28.463204 1041618 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1030 10:46:28.496246 1041618 api_server.go:72] duration metric: took 41.610970752s to wait for apiserver process to appear ...
	I1030 10:46:28.496272 1041618 api_server.go:88] waiting for apiserver healthz status ...
	I1030 10:46:28.496290 1041618 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I1030 10:46:28.506607 1041618 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I1030 10:46:28.508007 1041618 api_server.go:141] control plane version: v1.28.3
	I1030 10:46:28.508041 1041618 api_server.go:131] duration metric: took 11.761339ms to wait for apiserver health ...
	I1030 10:46:28.508049 1041618 system_pods.go:43] waiting for kube-system pods to appear ...
	I1030 10:46:28.649200 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:28.675226 1041618 system_pods.go:59] 17 kube-system pods found
	I1030 10:46:28.675314 1041618 system_pods.go:61] "coredns-5dd5756b68-t4n9l" [d79fca05-cf59-4675-a955-8bfc75fb7df2] Running
	I1030 10:46:28.675338 1041618 system_pods.go:61] "csi-hostpath-attacher-0" [b167fafa-8d79-4929-962c-b96a6801ab3c] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I1030 10:46:28.675372 1041618 system_pods.go:61] "csi-hostpath-resizer-0" [f2d36a07-8567-42bc-9bdb-cbe0146db0bd] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I1030 10:46:28.675398 1041618 system_pods.go:61] "csi-hostpathplugin-bcxg5" [b4bb34de-7b9c-4148-8221-eaa99791c25f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I1030 10:46:28.675418 1041618 system_pods.go:61] "etcd-addons-305325" [0527fb8f-9848-4d05-ae9e-09a95227a5d4] Running
	I1030 10:46:28.675437 1041618 system_pods.go:61] "kube-apiserver-addons-305325" [1a80c0e1-6a7a-4af9-95e2-41bb9dea51d7] Running
	I1030 10:46:28.675454 1041618 system_pods.go:61] "kube-controller-manager-addons-305325" [39379d26-cef9-4ffb-94ab-ff26e1606759] Running
	I1030 10:46:28.675486 1041618 system_pods.go:61] "kube-ingress-dns-minikube" [38b179ab-5fe1-419c-ac69-f4f1fc6dc36b] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I1030 10:46:28.675511 1041618 system_pods.go:61] "kube-proxy-mp7j9" [b0e068cb-f269-42b9-841e-ab9c84dc3284] Running
	I1030 10:46:28.675530 1041618 system_pods.go:61] "kube-scheduler-addons-305325" [46dfb949-9912-4d00-afe3-c3933a5e5807] Running
	I1030 10:46:28.675546 1041618 system_pods.go:61] "metrics-server-7c66d45ddc-d2w4f" [fc039028-9cb2-4802-ae10-6ef0f91d7dfe] Running
	I1030 10:46:28.675565 1041618 system_pods.go:61] "nvidia-device-plugin-daemonset-h6j8k" [cc17c9f5-b28c-473f-9c3e-43445b999d84] Running
	I1030 10:46:28.675596 1041618 system_pods.go:61] "registry-jjmtf" [9a268006-336c-4f6a-b0d0-e8c426d3d808] Running
	I1030 10:46:28.675622 1041618 system_pods.go:61] "registry-proxy-4lzlk" [483bc59a-e469-4644-9780-a1670a5ea617] Running
	I1030 10:46:28.675646 1041618 system_pods.go:61] "snapshot-controller-58dbcc7b99-2kf2n" [f965f6b2-ec72-4450-bbb5-3c5b998b5486] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1030 10:46:28.675665 1041618 system_pods.go:61] "snapshot-controller-58dbcc7b99-4p8bx" [3333f587-1245-462d-b628-8755b7dda017] Running
	I1030 10:46:28.675683 1041618 system_pods.go:61] "storage-provisioner" [68b0de2f-2ca3-47e8-a301-807424bf8561] Running
	I1030 10:46:28.675717 1041618 system_pods.go:74] duration metric: took 167.660525ms to wait for pod list to return data ...
	I1030 10:46:28.675739 1041618 default_sa.go:34] waiting for default service account to be created ...
	I1030 10:46:28.780051 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:28.861994 1041618 default_sa.go:45] found service account: "default"
	I1030 10:46:28.862021 1041618 default_sa.go:55] duration metric: took 186.265328ms for default service account to be created ...
	I1030 10:46:28.862031 1041618 system_pods.go:116] waiting for k8s-apps to be running ...
	I1030 10:46:28.921483 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:29.069145 1041618 system_pods.go:86] 17 kube-system pods found
	I1030 10:46:29.069177 1041618 system_pods.go:89] "coredns-5dd5756b68-t4n9l" [d79fca05-cf59-4675-a955-8bfc75fb7df2] Running
	I1030 10:46:29.069187 1041618 system_pods.go:89] "csi-hostpath-attacher-0" [b167fafa-8d79-4929-962c-b96a6801ab3c] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I1030 10:46:29.069196 1041618 system_pods.go:89] "csi-hostpath-resizer-0" [f2d36a07-8567-42bc-9bdb-cbe0146db0bd] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I1030 10:46:29.069205 1041618 system_pods.go:89] "csi-hostpathplugin-bcxg5" [b4bb34de-7b9c-4148-8221-eaa99791c25f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I1030 10:46:29.069218 1041618 system_pods.go:89] "etcd-addons-305325" [0527fb8f-9848-4d05-ae9e-09a95227a5d4] Running
	I1030 10:46:29.069224 1041618 system_pods.go:89] "kube-apiserver-addons-305325" [1a80c0e1-6a7a-4af9-95e2-41bb9dea51d7] Running
	I1030 10:46:29.069234 1041618 system_pods.go:89] "kube-controller-manager-addons-305325" [39379d26-cef9-4ffb-94ab-ff26e1606759] Running
	I1030 10:46:29.069242 1041618 system_pods.go:89] "kube-ingress-dns-minikube" [38b179ab-5fe1-419c-ac69-f4f1fc6dc36b] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I1030 10:46:29.069250 1041618 system_pods.go:89] "kube-proxy-mp7j9" [b0e068cb-f269-42b9-841e-ab9c84dc3284] Running
	I1030 10:46:29.069256 1041618 system_pods.go:89] "kube-scheduler-addons-305325" [46dfb949-9912-4d00-afe3-c3933a5e5807] Running
	I1030 10:46:29.069261 1041618 system_pods.go:89] "metrics-server-7c66d45ddc-d2w4f" [fc039028-9cb2-4802-ae10-6ef0f91d7dfe] Running
	I1030 10:46:29.069269 1041618 system_pods.go:89] "nvidia-device-plugin-daemonset-h6j8k" [cc17c9f5-b28c-473f-9c3e-43445b999d84] Running
	I1030 10:46:29.069273 1041618 system_pods.go:89] "registry-jjmtf" [9a268006-336c-4f6a-b0d0-e8c426d3d808] Running
	I1030 10:46:29.069278 1041618 system_pods.go:89] "registry-proxy-4lzlk" [483bc59a-e469-4644-9780-a1670a5ea617] Running
	I1030 10:46:29.069289 1041618 system_pods.go:89] "snapshot-controller-58dbcc7b99-2kf2n" [f965f6b2-ec72-4450-bbb5-3c5b998b5486] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1030 10:46:29.069294 1041618 system_pods.go:89] "snapshot-controller-58dbcc7b99-4p8bx" [3333f587-1245-462d-b628-8755b7dda017] Running
	I1030 10:46:29.069302 1041618 system_pods.go:89] "storage-provisioner" [68b0de2f-2ca3-47e8-a301-807424bf8561] Running
	I1030 10:46:29.069309 1041618 system_pods.go:126] duration metric: took 207.272576ms to wait for k8s-apps to be running ...
	I1030 10:46:29.069321 1041618 system_svc.go:44] waiting for kubelet service to be running ....
	I1030 10:46:29.069376 1041618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1030 10:46:29.089003 1041618 system_svc.go:56] duration metric: took 19.672341ms WaitForService to wait for kubelet.
	I1030 10:46:29.089029 1041618 kubeadm.go:581] duration metric: took 42.203760028s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I1030 10:46:29.089049 1041618 node_conditions.go:102] verifying NodePressure condition ...
	I1030 10:46:29.149269 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:29.262987 1041618 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I1030 10:46:29.263018 1041618 node_conditions.go:123] node cpu capacity is 2
	I1030 10:46:29.263031 1041618 node_conditions.go:105] duration metric: took 173.976494ms to run NodePressure ...
	I1030 10:46:29.263044 1041618 start.go:228] waiting for startup goroutines ...
	I1030 10:46:29.280046 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:29.422015 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:29.654623 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:29.779296 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:29.921662 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:30.155446 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:30.280262 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:30.421439 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:30.649162 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:30.779913 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:30.922659 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:31.148807 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:31.279044 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:31.421936 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:31.648336 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:31.779261 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:31.922644 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:32.148729 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:32.279519 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:32.421981 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:32.648682 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:32.780416 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:32.922345 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:33.149123 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:33.282894 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:33.421344 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:33.648896 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:33.780005 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:33.921626 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:34.149951 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:34.279912 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:34.421247 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:34.649035 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:34.779691 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:34.926602 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:35.149029 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:35.279837 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:35.421232 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:35.648711 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:35.780240 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:35.927106 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:36.150726 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:36.279432 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:36.422098 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:36.649882 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:36.780194 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:36.921887 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:37.149170 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:37.288248 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:37.421893 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:37.648509 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:37.779806 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:37.921902 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:38.149204 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:38.280096 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:38.422217 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:38.652954 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:38.780008 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:38.922446 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:39.149637 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:39.279790 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:39.422056 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:39.649218 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:39.780446 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:39.922297 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:40.149053 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:40.280038 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:40.422993 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:40.650215 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:40.779827 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:40.921781 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:41.148556 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:41.279231 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:41.421349 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:41.648249 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:41.779946 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:41.922040 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:42.148930 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:42.280121 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:42.421870 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:42.648507 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:42.779105 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:42.922237 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:43.152882 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:43.279126 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:43.421510 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:43.650530 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:43.780284 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:43.921936 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:44.149277 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1030 10:46:44.279662 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:44.422566 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:44.648226 1041618 kapi.go:107] duration metric: took 46.516891323s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I1030 10:46:44.779592 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:44.922141 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:45.279267 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:45.421938 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:45.779799 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:45.921093 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:46.279440 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:46.421824 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:46.779929 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:46.921529 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:47.279499 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:47.421984 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:47.779987 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:47.921841 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:48.279823 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:48.421342 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:48.779116 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:48.922226 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:49.279099 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:49.422059 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:49.779779 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:49.921445 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:50.279513 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:50.421447 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:50.779266 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:50.921624 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:51.279373 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:51.421259 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:51.779101 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:51.922319 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:52.278893 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:52.421358 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:52.778944 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:52.922050 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:53.278974 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:53.421997 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:53.779765 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:53.921432 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:54.279180 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:54.422133 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:54.779658 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:54.921781 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:55.279784 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:55.421841 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:55.779783 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:55.922052 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:56.279440 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:56.422210 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:56.779609 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:56.922914 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:57.279177 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:57.421822 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:57.779517 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:57.921802 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:58.279613 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:58.421849 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:58.780374 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:58.921907 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:59.279710 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:59.421540 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:46:59.779413 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:46:59.921391 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:00.281568 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:00.421586 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:00.779543 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:00.921580 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:01.279730 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:01.421095 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:01.779150 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:01.922121 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:02.279343 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:02.422267 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:02.779939 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:02.925555 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:03.279597 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:03.422470 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:03.779216 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:03.922073 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:04.281317 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:04.422489 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:04.780245 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:04.921956 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:05.279761 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:05.421317 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:05.778959 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:05.922020 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:06.278859 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:06.421326 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:06.779494 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:06.921928 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:07.280363 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:07.422621 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:07.779275 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:07.922231 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:08.278863 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:08.421744 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:08.779751 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:08.921381 1041618 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1030 10:47:09.279132 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:09.422856 1041618 kapi.go:107] duration metric: took 1m13.055599121s to wait for app.kubernetes.io/name=ingress-nginx ...
	I1030 10:47:09.779661 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:10.281140 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:10.778904 1041618 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1030 10:47:11.280980 1041618 kapi.go:107] duration metric: took 1m11.51731589s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I1030 10:47:11.283278 1041618 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-305325 cluster.
	I1030 10:47:11.285061 1041618 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I1030 10:47:11.287170 1041618 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I1030 10:47:11.289265 1041618 out.go:177] * Enabled addons: ingress-dns, nvidia-device-plugin, default-storageclass, cloud-spanner, storage-provisioner, inspektor-gadget, metrics-server, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I1030 10:47:11.291276 1041618 addons.go:502] enable addons completed in 1m24.6587881s: enabled=[ingress-dns nvidia-device-plugin default-storageclass cloud-spanner storage-provisioner inspektor-gadget metrics-server storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I1030 10:47:11.291325 1041618 start.go:233] waiting for cluster config update ...
	I1030 10:47:11.291344 1041618 start.go:242] writing updated cluster config ...
	I1030 10:47:11.291647 1041618 ssh_runner.go:195] Run: rm -f paused
	I1030 10:47:11.414563 1041618 start.go:600] kubectl: 1.28.3, cluster: 1.28.3 (minor skew: 0)
	I1030 10:47:11.417323 1041618 out.go:177] * Done! kubectl is now configured to use "addons-305325" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Oct 30 10:48:32 addons-305325 cri-dockerd[1307]: time="2023-10-30T10:48:32Z" level=info msg="Stop pulling image docker.io/nginx:alpine: Status: Downloaded newer image for nginx:alpine"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.169887406Z" level=info msg="ignoring event" container=8055995dd6b9b5a70264e000a624f1515944ee8e3ddb4f61e0ece937cf1e7a6c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.175621209Z" level=info msg="ignoring event" container=9b187fa430cc1aa1260ba705329c2b744fd65161d8de9348c1b85e36a38866e1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.217661578Z" level=info msg="ignoring event" container=a31ae193008fdc9834bef208657d0f7e5eda9ad37517b49a6e217ed23e4705d1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.237459506Z" level=info msg="ignoring event" container=5806edb92c77c71a7b5a0a780d7a58fa9fb212fbaab7a2142462f844d00578e1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.243823507Z" level=info msg="ignoring event" container=6e7d9c1b420402da5e3b49dff900841a23061b667920349aabbe392b6055c832 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.243875043Z" level=info msg="ignoring event" container=61ecff60f7e2d602834d461b157857df0c27d2b9b08d80b21a978660230821e9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.253171119Z" level=info msg="ignoring event" container=b11a7de1974da3beb7ee00610400ba5e3e4cdc139cc6b02aead981a82a88499a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.258437331Z" level=info msg="ignoring event" container=f6dffa5f7a696183028d27c585bb20d939242bccfa3d7be686b342027f8aa75c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.372361844Z" level=info msg="ignoring event" container=57eae1516fb9ad842192e2e156961eed4f24a2913091d25a5f274890463dea30 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.406546931Z" level=info msg="ignoring event" container=f8a0595b3c5d965617254af2abe93367b4056bedcc969c565f3cd0e441d34cbc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:33 addons-305325 dockerd[1096]: time="2023-10-30T10:48:33.459212064Z" level=info msg="ignoring event" container=b93a53590d20ce03c09e7935e97b2153fb4a16f0e2dbdbc9fe51305525f5d533 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:40 addons-305325 dockerd[1096]: time="2023-10-30T10:48:40.211242981Z" level=info msg="ignoring event" container=3f38d136395571219aafbb62fc81a6ca5f6050fbdc626e273100580ee81d20df module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:40 addons-305325 dockerd[1096]: time="2023-10-30T10:48:40.230660924Z" level=info msg="ignoring event" container=6614fb644b5fd63a775ffe35aa35c4ff51fbea4426461c4d50e5ea0e5046d731 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:40 addons-305325 dockerd[1096]: time="2023-10-30T10:48:40.427253531Z" level=info msg="ignoring event" container=77ff6fd65ac9a680a58e2b5def29bbf20300704d226641bd10f6c1ba4e0c7fde module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:40 addons-305325 dockerd[1096]: time="2023-10-30T10:48:40.443340272Z" level=info msg="ignoring event" container=a59163388bcc5f51c42c57b23bcc8a7151cc8c0251a3d5b7bd70e4f050e22323 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:40 addons-305325 cri-dockerd[1307]: time="2023-10-30T10:48:40Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/88d881fd51cd4471f69574387662e8e72f6417ceb733fd8a4d76bff1a1f004bf/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
	Oct 30 10:48:41 addons-305325 cri-dockerd[1307]: time="2023-10-30T10:48:41Z" level=info msg="Stop pulling image gcr.io/google-samples/hello-app:1.0: Status: Downloaded newer image for gcr.io/google-samples/hello-app:1.0"
	Oct 30 10:48:42 addons-305325 dockerd[1096]: time="2023-10-30T10:48:42.188525024Z" level=info msg="ignoring event" container=5c90e32ee0c3cbad150a61c523ae5da55c8b2d687ec44d127274532a269c27e9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:43 addons-305325 dockerd[1096]: time="2023-10-30T10:48:43.046690384Z" level=info msg="ignoring event" container=c04e36f10f549f228afb6856fe63e9b4ec0cc0418e8e58736bc1fe7dc0d7e85c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:55 addons-305325 dockerd[1096]: time="2023-10-30T10:48:55.704167872Z" level=info msg="ignoring event" container=c958361270d65900903366db979cf53270afd4b849f16465190350cfbc2e5a99 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:57 addons-305325 dockerd[1096]: time="2023-10-30T10:48:57.610219057Z" level=info msg="ignoring event" container=c6b1cb0822a3f2b4749a5f435acb2cc77e52076ce0f6352cb8d6f79d589aee6a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:59 addons-305325 dockerd[1096]: time="2023-10-30T10:48:59.692136659Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d
	Oct 30 10:48:59 addons-305325 dockerd[1096]: time="2023-10-30T10:48:59.758006247Z" level=info msg="ignoring event" container=71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:48:59 addons-305325 dockerd[1096]: time="2023-10-30T10:48:59.878425026Z" level=info msg="ignoring event" container=4d26ba1f29a8f5895d5cc8c8a5e427338d2b5218e178af5ff17221deb031d2a6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                                        CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	c6b1cb0822a3f       6896cbb783033                                                                                                                7 seconds ago        Exited              hello-world-app           2                   88d881fd51cd4       hello-world-app-5d77478584-68xlk
	15af298de79a1       nginx@sha256:db353d0f0c479c91bd15e01fc68ed0f33d9c4c52f3415e63332c3d0bf7a4bb77                                                32 seconds ago       Running             nginx                     0                   59df3e127508c       nginx
	118961f11bc6c       ghcr.io/headlamp-k8s/headlamp@sha256:db0310cf5abef3ffd5aa87509b1f61a150ee705808c5b29704149101653d418b                        About a minute ago   Running             headlamp                  0                   f118a85bc6628       headlamp-94b766c-44bgc
	d7c81c130312a       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf                 About a minute ago   Running             gcp-auth                  0                   e9ead12565235       gcp-auth-d4c87556c-dxrbd
	be2922607f8ff       af594c6a879f2                                                                                                                2 minutes ago        Exited              patch                     1                   81273d3855ac5       ingress-nginx-admission-patch-7vzpg
	f3230d5c4e520       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a7943503b45d552785aa3b5e457f169a5661fb94d82b8a3373bcd9ebaf9aac80   2 minutes ago        Exited              create                    0                   fe5ecc0366972       ingress-nginx-admission-create-fz6m6
	9395925bfed0a       ba04bb24b9575                                                                                                                3 minutes ago        Running             storage-provisioner       0                   f3bdd17b197e2       storage-provisioner
	ea69206b1e158       97e04611ad434                                                                                                                3 minutes ago        Running             coredns                   0                   c312e6cf9ed65       coredns-5dd5756b68-t4n9l
	3b3a92f510306       a5dd5cdd6d3ef                                                                                                                3 minutes ago        Running             kube-proxy                0                   c4b6e508ecdff       kube-proxy-mp7j9
	3ab008a385e78       42a4e73724daa                                                                                                                3 minutes ago        Running             kube-scheduler            0                   9b3d5d1490704       kube-scheduler-addons-305325
	112899a2346e9       8276439b4f237                                                                                                                3 minutes ago        Running             kube-controller-manager   0                   42ab4a10b68d1       kube-controller-manager-addons-305325
	e77921b914b40       9cdd6470f48c8                                                                                                                3 minutes ago        Running             etcd                      0                   fc2c395fd03b9       etcd-addons-305325
	a7a96b8a9f6e9       537e9a59ee2fd                                                                                                                3 minutes ago        Running             kube-apiserver            0                   724e33cd31f5f       kube-apiserver-addons-305325
	
	* 
	* ==> coredns [ea69206b1e15] <==
	* [INFO] 10.244.0.18:33554 - 44663 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.004313497s
	[INFO] 10.244.0.18:38647 - 53284 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000087483s
	[INFO] 10.244.0.18:38647 - 36278 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001704234s
	[INFO] 10.244.0.18:33554 - 42648 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00422622s
	[INFO] 10.244.0.18:38647 - 15443 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.002434346s
	[INFO] 10.244.0.18:33554 - 27563 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000266164s
	[INFO] 10.244.0.18:38647 - 62966 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000099831s
	[INFO] 10.244.0.18:49546 - 47251 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000108586s
	[INFO] 10.244.0.18:49546 - 40797 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000068102s
	[INFO] 10.244.0.18:49546 - 61088 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000053013s
	[INFO] 10.244.0.18:49546 - 39835 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000064517s
	[INFO] 10.244.0.18:49546 - 45781 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000064435s
	[INFO] 10.244.0.18:49546 - 24902 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000076036s
	[INFO] 10.244.0.18:49546 - 2960 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001111204s
	[INFO] 10.244.0.18:49546 - 38136 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00096595s
	[INFO] 10.244.0.18:49546 - 33447 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000064763s
	[INFO] 10.244.0.18:34368 - 13609 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000064377s
	[INFO] 10.244.0.18:34368 - 12869 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000046121s
	[INFO] 10.244.0.18:34368 - 39230 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00004713s
	[INFO] 10.244.0.18:34368 - 14889 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000040993s
	[INFO] 10.244.0.18:34368 - 16969 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000040345s
	[INFO] 10.244.0.18:34368 - 838 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000044193s
	[INFO] 10.244.0.18:34368 - 3560 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001110926s
	[INFO] 10.244.0.18:34368 - 62351 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000848503s
	[INFO] 10.244.0.18:34368 - 33534 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000050108s
	
	* 
	* ==> describe nodes <==
	* Name:               addons-305325
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-305325
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=99c50ab9af570595672bd37bf6c89e1874e94ce6
	                    minikube.k8s.io/name=addons-305325
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_10_30T10_45_34_0700
	                    minikube.k8s.io/version=v1.32.0-beta.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-305325
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 30 Oct 2023 10:45:31 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-305325
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 30 Oct 2023 10:48:58 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 30 Oct 2023 10:48:39 +0000   Mon, 30 Oct 2023 10:45:27 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 30 Oct 2023 10:48:39 +0000   Mon, 30 Oct 2023 10:45:27 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 30 Oct 2023 10:48:39 +0000   Mon, 30 Oct 2023 10:45:27 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 30 Oct 2023 10:48:39 +0000   Mon, 30 Oct 2023 10:45:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-305325
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022500Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022500Ki
	  pods:               110
	System Info:
	  Machine ID:                 8c1d6ee83d8a448e86a428da04907c57
	  System UUID:                d697396e-f838-4901-ae79-22b753df120f
	  Boot ID:                    9c87d0b1-da45-47b6-b0d3-2db75e0c20f8
	  Kernel Version:             5.15.0-1048-aws
	  OS Image:                   Ubuntu 22.04.3 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.7
	  Kubelet Version:            v1.28.3
	  Kube-Proxy Version:         v1.28.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5d77478584-68xlk         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         36s
	  gcp-auth                    gcp-auth-d4c87556c-dxrbd                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m6s
	  headlamp                    headlamp-94b766c-44bgc                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s
	  kube-system                 coredns-5dd5756b68-t4n9l                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     3m18s
	  kube-system                 etcd-addons-305325                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         3m31s
	  kube-system                 kube-apiserver-addons-305325             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m31s
	  kube-system                 kube-controller-manager-addons-305325    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m31s
	  kube-system                 kube-proxy-mp7j9                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m18s
	  kube-system                 kube-scheduler-addons-305325             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m31s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m12s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)
	  memory             170Mi (2%!)(MISSING)  170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 3m16s                  kube-proxy       
	  Normal  Starting                 3m39s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  3m39s (x8 over 3m39s)  kubelet          Node addons-305325 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m39s (x8 over 3m39s)  kubelet          Node addons-305325 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m39s (x7 over 3m39s)  kubelet          Node addons-305325 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  3m39s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  Starting                 3m31s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  3m31s                  kubelet          Node addons-305325 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m31s                  kubelet          Node addons-305325 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m31s                  kubelet          Node addons-305325 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             3m31s                  kubelet          Node addons-305325 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  3m31s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                3m31s                  kubelet          Node addons-305325 status is now: NodeReady
	  Normal  RegisteredNode           3m19s                  node-controller  Node addons-305325 event: Registered Node addons-305325 in Controller
	
	* 
	* ==> dmesg <==
	* [  +0.001066] FS-Cache: O-key=[8] '53803b0000000000'
	[  +0.000746] FS-Cache: N-cookie c=00000185 [p=0000017c fl=2 nc=0 na=1]
	[  +0.000962] FS-Cache: N-cookie d=00000000a542e93b{9p.inode} n=00000000ee566308
	[  +0.001073] FS-Cache: N-key=[8] '53803b0000000000'
	[  +0.011827] FS-Cache: Duplicate cookie detected
	[  +0.000736] FS-Cache: O-cookie c=0000017f [p=0000017c fl=226 nc=0 na=1]
	[  +0.001011] FS-Cache: O-cookie d=00000000a542e93b{9p.inode} n=000000009052cd16
	[  +0.001081] FS-Cache: O-key=[8] '53803b0000000000'
	[  +0.000731] FS-Cache: N-cookie c=00000186 [p=0000017c fl=2 nc=0 na=1]
	[  +0.000969] FS-Cache: N-cookie d=00000000a542e93b{9p.inode} n=000000003ac8d41a
	[  +0.001062] FS-Cache: N-key=[8] '53803b0000000000'
	[  +3.387073] FS-Cache: Duplicate cookie detected
	[  +0.000962] FS-Cache: O-cookie c=0000017d [p=0000017c fl=226 nc=0 na=1]
	[  +0.001369] FS-Cache: O-cookie d=00000000a542e93b{9p.inode} n=00000000c8a69ee9
	[  +0.001381] FS-Cache: O-key=[8] '52803b0000000000'
	[  +0.000729] FS-Cache: N-cookie c=00000188 [p=0000017c fl=2 nc=0 na=1]
	[  +0.001097] FS-Cache: N-cookie d=00000000a542e93b{9p.inode} n=00000000725ae23c
	[  +0.001086] FS-Cache: N-key=[8] '52803b0000000000'
	[  +0.396206] FS-Cache: Duplicate cookie detected
	[  +0.000764] FS-Cache: O-cookie c=00000182 [p=0000017c fl=226 nc=0 na=1]
	[  +0.000993] FS-Cache: O-cookie d=00000000a542e93b{9p.inode} n=000000001c6b883c
	[  +0.001110] FS-Cache: O-key=[8] '58803b0000000000'
	[  +0.000753] FS-Cache: N-cookie c=00000189 [p=0000017c fl=2 nc=0 na=1]
	[  +0.000976] FS-Cache: N-cookie d=00000000a542e93b{9p.inode} n=0000000076ab024d
	[  +0.001147] FS-Cache: N-key=[8] '58803b0000000000'
	
	* 
	* ==> etcd [e77921b914b4] <==
	* {"level":"info","ts":"2023-10-30T10:45:27.240184Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2023-10-30T10:45:27.240439Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2023-10-30T10:45:27.241232Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2023-10-30T10:45:27.241385Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-10-30T10:45:27.24162Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-10-30T10:45:27.238315Z","caller":"etcdserver/server.go:738","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"aec36adc501070cc","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
	{"level":"info","ts":"2023-10-30T10:45:27.241866Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-10-30T10:45:28.215884Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-10-30T10:45:28.216126Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-10-30T10:45:28.216241Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-10-30T10:45:28.216368Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-10-30T10:45:28.216465Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-10-30T10:45:28.21657Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-10-30T10:45:28.216702Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-10-30T10:45:28.217862Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-305325 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-10-30T10:45:28.218164Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-10-30T10:45:28.21837Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-10-30T10:45:28.218954Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-10-30T10:45:28.219123Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2023-10-30T10:45:28.219274Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-10-30T10:45:28.219451Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-10-30T10:45:28.219559Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-10-30T10:45:28.219741Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-10-30T10:45:28.220886Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2023-10-30T10:45:28.226879Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	
	* 
	* ==> gcp-auth [d7c81c130312] <==
	* 2023/10/30 10:47:10 GCP Auth Webhook started!
	2023/10/30 10:47:18 Ready to marshal response ...
	2023/10/30 10:47:18 Ready to write response ...
	2023/10/30 10:47:18 Ready to marshal response ...
	2023/10/30 10:47:18 Ready to write response ...
	2023/10/30 10:47:21 Ready to marshal response ...
	2023/10/30 10:47:21 Ready to write response ...
	2023/10/30 10:47:28 Ready to marshal response ...
	2023/10/30 10:47:28 Ready to write response ...
	2023/10/30 10:47:33 Ready to marshal response ...
	2023/10/30 10:47:33 Ready to write response ...
	2023/10/30 10:47:33 Ready to marshal response ...
	2023/10/30 10:47:33 Ready to write response ...
	2023/10/30 10:47:33 Ready to marshal response ...
	2023/10/30 10:47:33 Ready to write response ...
	2023/10/30 10:47:50 Ready to marshal response ...
	2023/10/30 10:47:50 Ready to write response ...
	2023/10/30 10:48:23 Ready to marshal response ...
	2023/10/30 10:48:23 Ready to write response ...
	2023/10/30 10:48:29 Ready to marshal response ...
	2023/10/30 10:48:29 Ready to write response ...
	2023/10/30 10:48:39 Ready to marshal response ...
	2023/10/30 10:48:39 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  10:49:05 up 1 day, 19:31,  0 users,  load average: 0.79, 1.11, 1.33
	Linux addons-305325 5.15.0-1048-aws #53~20.04.1-Ubuntu SMP Wed Oct 4 16:51:38 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.3 LTS"
	
	* 
	* ==> kube-apiserver [a7a96b8a9f6e] <==
	* I1030 10:48:23.311939       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W1030 10:48:24.336891       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I1030 10:48:29.192922       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
	I1030 10:48:29.402621       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
	I1030 10:48:29.782725       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.103.120.77"}
	I1030 10:48:39.638730       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1030 10:48:39.639060       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1030 10:48:39.670141       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1030 10:48:39.670468       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1030 10:48:39.685098       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1030 10:48:39.685148       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1030 10:48:39.760131       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1030 10:48:39.760348       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1030 10:48:39.811097       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1030 10:48:39.811324       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1030 10:48:39.833903       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1030 10:48:39.837404       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1030 10:48:39.853160       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1030 10:48:39.853226       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1030 10:48:39.856600       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1030 10:48:39.857667       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1030 10:48:39.864878       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.99.24.11"}
	W1030 10:48:40.811497       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W1030 10:48:40.857604       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W1030 10:48:40.949221       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	
	* 
	* ==> kube-controller-manager [112899a2346e] <==
	* W1030 10:48:44.567351       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1030 10:48:44.567386       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I1030 10:48:44.881021       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="63.458µs"
	I1030 10:48:46.343493       1 shared_informer.go:311] Waiting for caches to sync for resource quota
	I1030 10:48:46.343530       1 shared_informer.go:318] Caches are synced for resource quota
	I1030 10:48:46.816339       1 shared_informer.go:311] Waiting for caches to sync for garbage collector
	I1030 10:48:46.816387       1 shared_informer.go:318] Caches are synced for garbage collector
	W1030 10:48:48.874287       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1030 10:48:48.874320       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1030 10:48:50.248371       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1030 10:48:50.248406       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1030 10:48:50.628059       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1030 10:48:50.628105       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I1030 10:48:56.649283       1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-create"
	I1030 10:48:56.651691       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-6f48fc54bd" duration="7.253µs"
	I1030 10:48:56.659816       1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-patch"
	W1030 10:48:56.747287       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1030 10:48:56.747331       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1030 10:48:57.260956       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1030 10:48:57.260991       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1030 10:48:57.544828       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1030 10:48:57.544863       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I1030 10:48:58.029137       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="39.712µs"
	W1030 10:49:03.107672       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1030 10:49:03.107712       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	
	* 
	* ==> kube-proxy [3b3a92f51030] <==
	* I1030 10:45:48.231135       1 server_others.go:69] "Using iptables proxy"
	I1030 10:45:48.251754       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I1030 10:45:48.297965       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I1030 10:45:48.300291       1 server_others.go:152] "Using iptables Proxier"
	I1030 10:45:48.300320       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I1030 10:45:48.300326       1 server_others.go:438] "Defaulting to no-op detect-local"
	I1030 10:45:48.300408       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I1030 10:45:48.300630       1 server.go:846] "Version info" version="v1.28.3"
	I1030 10:45:48.300639       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I1030 10:45:48.301622       1 config.go:188] "Starting service config controller"
	I1030 10:45:48.301845       1 shared_informer.go:311] Waiting for caches to sync for service config
	I1030 10:45:48.301868       1 config.go:97] "Starting endpoint slice config controller"
	I1030 10:45:48.301872       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I1030 10:45:48.304421       1 config.go:315] "Starting node config controller"
	I1030 10:45:48.304434       1 shared_informer.go:311] Waiting for caches to sync for node config
	I1030 10:45:48.409786       1 shared_informer.go:318] Caches are synced for node config
	I1030 10:45:48.409826       1 shared_informer.go:318] Caches are synced for service config
	I1030 10:45:48.409863       1 shared_informer.go:318] Caches are synced for endpoint slice config
	
	* 
	* ==> kube-scheduler [3ab008a385e7] <==
	* W1030 10:45:31.852190       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E1030 10:45:31.852218       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W1030 10:45:31.852429       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E1030 10:45:31.852453       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W1030 10:45:31.852522       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E1030 10:45:31.852619       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W1030 10:45:31.852754       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E1030 10:45:31.852776       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W1030 10:45:31.852897       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E1030 10:45:31.852917       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W1030 10:45:31.852990       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E1030 10:45:31.853035       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W1030 10:45:31.853120       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E1030 10:45:31.853139       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W1030 10:45:31.853182       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1030 10:45:31.853287       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W1030 10:45:31.853391       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E1030 10:45:31.853412       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	W1030 10:45:31.853543       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E1030 10:45:31.853564       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W1030 10:45:31.853637       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E1030 10:45:31.853655       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W1030 10:45:31.853839       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E1030 10:45:31.853958       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	I1030 10:45:33.142675       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Oct 30 10:48:44 addons-305325 kubelet[2319]: E1030 10:48:44.870977    2319 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5d77478584-68xlk_default(c625ff0f-627f-46c2-934b-0f79472819c9)\"" pod="default/hello-world-app-5d77478584-68xlk" podUID="c625ff0f-627f-46c2-934b-0f79472819c9"
	Oct 30 10:48:50 addons-305325 kubelet[2319]: I1030 10:48:50.464173    2319 scope.go:117] "RemoveContainer" containerID="b8d678ebde601c1a3b5d63a47df54057f03c05954cdc8132ed2aefbb2cae89b0"
	Oct 30 10:48:50 addons-305325 kubelet[2319]: E1030 10:48:50.464425    2319 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(38b179ab-5fe1-419c-ac69-f4f1fc6dc36b)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="38b179ab-5fe1-419c-ac69-f4f1fc6dc36b"
	Oct 30 10:48:55 addons-305325 kubelet[2319]: I1030 10:48:55.857715    2319 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kclt\" (UniqueName: \"kubernetes.io/projected/38b179ab-5fe1-419c-ac69-f4f1fc6dc36b-kube-api-access-8kclt\") pod \"38b179ab-5fe1-419c-ac69-f4f1fc6dc36b\" (UID: \"38b179ab-5fe1-419c-ac69-f4f1fc6dc36b\") "
	Oct 30 10:48:55 addons-305325 kubelet[2319]: I1030 10:48:55.859955    2319 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b179ab-5fe1-419c-ac69-f4f1fc6dc36b-kube-api-access-8kclt" (OuterVolumeSpecName: "kube-api-access-8kclt") pod "38b179ab-5fe1-419c-ac69-f4f1fc6dc36b" (UID: "38b179ab-5fe1-419c-ac69-f4f1fc6dc36b"). InnerVolumeSpecName "kube-api-access-8kclt". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Oct 30 10:48:55 addons-305325 kubelet[2319]: I1030 10:48:55.958365    2319 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-8kclt\" (UniqueName: \"kubernetes.io/projected/38b179ab-5fe1-419c-ac69-f4f1fc6dc36b-kube-api-access-8kclt\") on node \"addons-305325\" DevicePath \"\""
	Oct 30 10:48:55 addons-305325 kubelet[2319]: I1030 10:48:55.975826    2319 scope.go:117] "RemoveContainer" containerID="b8d678ebde601c1a3b5d63a47df54057f03c05954cdc8132ed2aefbb2cae89b0"
	Oct 30 10:48:56 addons-305325 kubelet[2319]: I1030 10:48:56.472871    2319 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38b179ab-5fe1-419c-ac69-f4f1fc6dc36b" path="/var/lib/kubelet/pods/38b179ab-5fe1-419c-ac69-f4f1fc6dc36b/volumes"
	Oct 30 10:48:57 addons-305325 kubelet[2319]: I1030 10:48:57.463572    2319 scope.go:117] "RemoveContainer" containerID="c04e36f10f549f228afb6856fe63e9b4ec0cc0418e8e58736bc1fe7dc0d7e85c"
	Oct 30 10:48:58 addons-305325 kubelet[2319]: I1030 10:48:58.015126    2319 scope.go:117] "RemoveContainer" containerID="c04e36f10f549f228afb6856fe63e9b4ec0cc0418e8e58736bc1fe7dc0d7e85c"
	Oct 30 10:48:58 addons-305325 kubelet[2319]: I1030 10:48:58.015517    2319 scope.go:117] "RemoveContainer" containerID="c6b1cb0822a3f2b4749a5f435acb2cc77e52076ce0f6352cb8d6f79d589aee6a"
	Oct 30 10:48:58 addons-305325 kubelet[2319]: E1030 10:48:58.015785    2319 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5d77478584-68xlk_default(c625ff0f-627f-46c2-934b-0f79472819c9)\"" pod="default/hello-world-app-5d77478584-68xlk" podUID="c625ff0f-627f-46c2-934b-0f79472819c9"
	Oct 30 10:48:58 addons-305325 kubelet[2319]: I1030 10:48:58.471781    2319 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6661107f-6cce-4044-89c4-efdc89dfe80f" path="/var/lib/kubelet/pods/6661107f-6cce-4044-89c4-efdc89dfe80f/volumes"
	Oct 30 10:48:58 addons-305325 kubelet[2319]: I1030 10:48:58.472174    2319 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9c1a20b-31aa-4d89-9a26-d6ec087ff494" path="/var/lib/kubelet/pods/a9c1a20b-31aa-4d89-9a26-d6ec087ff494/volumes"
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.076539    2319 scope.go:117] "RemoveContainer" containerID="71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d"
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.087673    2319 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtrrg\" (UniqueName: \"kubernetes.io/projected/3548aab1-cd01-4b60-b5ad-ca1d76e90730-kube-api-access-rtrrg\") pod \"3548aab1-cd01-4b60-b5ad-ca1d76e90730\" (UID: \"3548aab1-cd01-4b60-b5ad-ca1d76e90730\") "
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.087731    2319 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3548aab1-cd01-4b60-b5ad-ca1d76e90730-webhook-cert\") pod \"3548aab1-cd01-4b60-b5ad-ca1d76e90730\" (UID: \"3548aab1-cd01-4b60-b5ad-ca1d76e90730\") "
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.090944    2319 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3548aab1-cd01-4b60-b5ad-ca1d76e90730-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3548aab1-cd01-4b60-b5ad-ca1d76e90730" (UID: "3548aab1-cd01-4b60-b5ad-ca1d76e90730"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.093361    2319 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3548aab1-cd01-4b60-b5ad-ca1d76e90730-kube-api-access-rtrrg" (OuterVolumeSpecName: "kube-api-access-rtrrg") pod "3548aab1-cd01-4b60-b5ad-ca1d76e90730" (UID: "3548aab1-cd01-4b60-b5ad-ca1d76e90730"). InnerVolumeSpecName "kube-api-access-rtrrg". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.103882    2319 scope.go:117] "RemoveContainer" containerID="71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d"
	Oct 30 10:49:00 addons-305325 kubelet[2319]: E1030 10:49:00.104975    2319 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d" containerID="71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d"
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.105029    2319 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d"} err="failed to get container status \"71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d\": rpc error: code = Unknown desc = Error response from daemon: No such container: 71f4c01b9fbe8b132f564b287bfff5499af22ef2cd5a0a31dd10fe57ef35d36d"
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.188285    2319 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-rtrrg\" (UniqueName: \"kubernetes.io/projected/3548aab1-cd01-4b60-b5ad-ca1d76e90730-kube-api-access-rtrrg\") on node \"addons-305325\" DevicePath \"\""
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.188338    2319 reconciler_common.go:300] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3548aab1-cd01-4b60-b5ad-ca1d76e90730-webhook-cert\") on node \"addons-305325\" DevicePath \"\""
	Oct 30 10:49:00 addons-305325 kubelet[2319]: I1030 10:49:00.473952    2319 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3548aab1-cd01-4b60-b5ad-ca1d76e90730" path="/var/lib/kubelet/pods/3548aab1-cd01-4b60-b5ad-ca1d76e90730/volumes"
	
	* 
	* ==> storage-provisioner [9395925bfed0] <==
	* I1030 10:45:55.110360       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1030 10:45:55.129099       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1030 10:45:55.129193       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1030 10:45:55.150466       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1030 10:45:55.150660       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-305325_688bd3f5-1ab7-41c9-9130-c423c806d807!
	I1030 10:45:55.151634       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e90bcc16-f25c-46be-a6ae-38ff8bb05278", APIVersion:"v1", ResourceVersion:"635", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-305325_688bd3f5-1ab7-41c9-9130-c423c806d807 became leader
	I1030 10:45:55.252491       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-305325_688bd3f5-1ab7-41c9-9130-c423c806d807!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-305325 -n addons-305325
helpers_test.go:261: (dbg) Run:  kubectl --context addons-305325 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (37.41s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (58.36s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:206: (dbg) Run:  kubectl --context ingress-addon-legacy-405700 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:206: (dbg) Done: kubectl --context ingress-addon-legacy-405700 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (11.411290686s)
addons_test.go:231: (dbg) Run:  kubectl --context ingress-addon-legacy-405700 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:244: (dbg) Run:  kubectl --context ingress-addon-legacy-405700 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:249: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [1ed47b74-3235-4d04-982b-2c68e0338fc7] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [1ed47b74-3235-4d04-982b-2c68e0338fc7] Running
addons_test.go:249: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 10.022848928s
addons_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-405700 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:285: (dbg) Run:  kubectl --context ingress-addon-legacy-405700 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-405700 ip
addons_test.go:296: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:296: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.025081892s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:298: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:302: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:305: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-405700 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:305: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-405700 addons disable ingress-dns --alsologtostderr -v=1: (10.97550464s)
addons_test.go:310: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-405700 addons disable ingress --alsologtostderr -v=1
addons_test.go:310: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-405700 addons disable ingress --alsologtostderr -v=1: (7.527593193s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-405700
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-405700:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "ba9ef6f429ba0add63e1faaa7894c2bf4908a29e29dd1f1e6db6eae8fae91cca",
	        "Created": "2023-10-30T10:54:42.152467035Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1089197,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-10-30T10:54:42.490932998Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:eaa28633b306b28bfcc42e43d12d56f9c0e18264fba46e5664387f4f16279f20",
	        "ResolvConfPath": "/var/lib/docker/containers/ba9ef6f429ba0add63e1faaa7894c2bf4908a29e29dd1f1e6db6eae8fae91cca/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/ba9ef6f429ba0add63e1faaa7894c2bf4908a29e29dd1f1e6db6eae8fae91cca/hostname",
	        "HostsPath": "/var/lib/docker/containers/ba9ef6f429ba0add63e1faaa7894c2bf4908a29e29dd1f1e6db6eae8fae91cca/hosts",
	        "LogPath": "/var/lib/docker/containers/ba9ef6f429ba0add63e1faaa7894c2bf4908a29e29dd1f1e6db6eae8fae91cca/ba9ef6f429ba0add63e1faaa7894c2bf4908a29e29dd1f1e6db6eae8fae91cca-json.log",
	        "Name": "/ingress-addon-legacy-405700",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ingress-addon-legacy-405700:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "ingress-addon-legacy-405700",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/3380727ed5e6433d0007cd080133d28742ec3829b29024bcea4966c35891a417-init/diff:/var/lib/docker/overlay2/6920698f3346b3432ee81cea1fd7786c03f9eb8a308b22649a01a181a8116dbb/diff",
	                "MergedDir": "/var/lib/docker/overlay2/3380727ed5e6433d0007cd080133d28742ec3829b29024bcea4966c35891a417/merged",
	                "UpperDir": "/var/lib/docker/overlay2/3380727ed5e6433d0007cd080133d28742ec3829b29024bcea4966c35891a417/diff",
	                "WorkDir": "/var/lib/docker/overlay2/3380727ed5e6433d0007cd080133d28742ec3829b29024bcea4966c35891a417/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-405700",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-405700/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-405700",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-405700",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-405700",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "1bf367e723cfa592de4db92327ab65114f0ddce6e853332dcfc8d7869f092a57",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39425"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39424"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39421"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39423"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "39422"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/1bf367e723cf",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-405700": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "ba9ef6f429ba",
	                        "ingress-addon-legacy-405700"
	                    ],
	                    "NetworkID": "6668d51bd347685db3d75f0c7fcc88127d6921f7381af9b5423d0e0ec0259266",
	                    "EndpointID": "a3d8aa4b52839c0a4229c42375b04a726e46082191816208008ac12fec083d1e",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p ingress-addon-legacy-405700 -n ingress-addon-legacy-405700
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-405700 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-405700 logs -n 25: (1.04684938s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------------------------------------------------|-----------------------------|---------|----------------|---------------------|---------------------|
	| Command |                                   Args                                   |           Profile           |  User   |    Version     |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------------------------|-----------------------------|---------|----------------|---------------------|---------------------|
	| image   | functional-798279 image ls                                               | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	| image   | functional-798279 image load                                             | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	|         | /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar |                             |         |                |                     |                     |
	|         | --alsologtostderr                                                        |                             |         |                |                     |                     |
	| image   | functional-798279 image ls                                               | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	| image   | functional-798279 image save --daemon                                    | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	|         | gcr.io/google-containers/addon-resizer:functional-798279                 |                             |         |                |                     |                     |
	|         | --alsologtostderr                                                        |                             |         |                |                     |                     |
	| image   | functional-798279                                                        | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	|         | image ls --format yaml                                                   |                             |         |                |                     |                     |
	|         | --alsologtostderr                                                        |                             |         |                |                     |                     |
	| image   | functional-798279                                                        | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	|         | image ls --format short                                                  |                             |         |                |                     |                     |
	|         | --alsologtostderr                                                        |                             |         |                |                     |                     |
	| ssh     | functional-798279 ssh pgrep                                              | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC |                     |
	|         | buildkitd                                                                |                             |         |                |                     |                     |
	| image   | functional-798279                                                        | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	|         | image ls --format json                                                   |                             |         |                |                     |                     |
	|         | --alsologtostderr                                                        |                             |         |                |                     |                     |
	| image   | functional-798279                                                        | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	|         | image ls --format table                                                  |                             |         |                |                     |                     |
	|         | --alsologtostderr                                                        |                             |         |                |                     |                     |
	| image   | functional-798279 image build -t                                         | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	|         | localhost/my-image:functional-798279                                     |                             |         |                |                     |                     |
	|         | testdata/build --alsologtostderr                                         |                             |         |                |                     |                     |
	| image   | functional-798279 image ls                                               | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	| delete  | -p functional-798279                                                     | functional-798279           | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:53 UTC |
	| start   | -p image-941043                                                          | image-941043                | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:53 UTC | 30 Oct 23 10:54 UTC |
	|         | --driver=docker                                                          |                             |         |                |                     |                     |
	|         | --container-runtime=docker                                               |                             |         |                |                     |                     |
	| image   | build -t aaa:latest                                                      | image-941043                | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:54 UTC | 30 Oct 23 10:54 UTC |
	|         | ./testdata/image-build/test-normal                                       |                             |         |                |                     |                     |
	|         | -p image-941043                                                          |                             |         |                |                     |                     |
	| image   | build -t aaa:latest                                                      | image-941043                | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:54 UTC | 30 Oct 23 10:54 UTC |
	|         | --build-opt=build-arg=ENV_A=test_env_str                                 |                             |         |                |                     |                     |
	|         | --build-opt=no-cache                                                     |                             |         |                |                     |                     |
	|         | ./testdata/image-build/test-arg -p                                       |                             |         |                |                     |                     |
	|         | image-941043                                                             |                             |         |                |                     |                     |
	| image   | build -t aaa:latest                                                      | image-941043                | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:54 UTC | 30 Oct 23 10:54 UTC |
	|         | ./testdata/image-build/test-normal                                       |                             |         |                |                     |                     |
	|         | --build-opt=no-cache -p                                                  |                             |         |                |                     |                     |
	|         | image-941043                                                             |                             |         |                |                     |                     |
	| image   | build -t aaa:latest                                                      | image-941043                | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:54 UTC | 30 Oct 23 10:54 UTC |
	|         | -f inner/Dockerfile                                                      |                             |         |                |                     |                     |
	|         | ./testdata/image-build/test-f                                            |                             |         |                |                     |                     |
	|         | -p image-941043                                                          |                             |         |                |                     |                     |
	| delete  | -p image-941043                                                          | image-941043                | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:54 UTC | 30 Oct 23 10:54 UTC |
	| start   | -p ingress-addon-legacy-405700                                           | ingress-addon-legacy-405700 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:54 UTC | 30 Oct 23 10:55 UTC |
	|         | --kubernetes-version=v1.18.20                                            |                             |         |                |                     |                     |
	|         | --memory=4096 --wait=true                                                |                             |         |                |                     |                     |
	|         | --alsologtostderr                                                        |                             |         |                |                     |                     |
	|         | -v=5 --driver=docker                                                     |                             |         |                |                     |                     |
	|         | --container-runtime=docker                                               |                             |         |                |                     |                     |
	| addons  | ingress-addon-legacy-405700                                              | ingress-addon-legacy-405700 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:55 UTC | 30 Oct 23 10:55 UTC |
	|         | addons enable ingress                                                    |                             |         |                |                     |                     |
	|         | --alsologtostderr -v=5                                                   |                             |         |                |                     |                     |
	| addons  | ingress-addon-legacy-405700                                              | ingress-addon-legacy-405700 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:55 UTC | 30 Oct 23 10:55 UTC |
	|         | addons enable ingress-dns                                                |                             |         |                |                     |                     |
	|         | --alsologtostderr -v=5                                                   |                             |         |                |                     |                     |
	| ssh     | ingress-addon-legacy-405700                                              | ingress-addon-legacy-405700 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:56 UTC | 30 Oct 23 10:56 UTC |
	|         | ssh curl -s http://127.0.0.1/                                            |                             |         |                |                     |                     |
	|         | -H 'Host: nginx.example.com'                                             |                             |         |                |                     |                     |
	| ip      | ingress-addon-legacy-405700 ip                                           | ingress-addon-legacy-405700 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:56 UTC | 30 Oct 23 10:56 UTC |
	| addons  | ingress-addon-legacy-405700                                              | ingress-addon-legacy-405700 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:56 UTC | 30 Oct 23 10:56 UTC |
	|         | addons disable ingress-dns                                               |                             |         |                |                     |                     |
	|         | --alsologtostderr -v=1                                                   |                             |         |                |                     |                     |
	| addons  | ingress-addon-legacy-405700                                              | ingress-addon-legacy-405700 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:56 UTC | 30 Oct 23 10:56 UTC |
	|         | addons disable ingress                                                   |                             |         |                |                     |                     |
	|         | --alsologtostderr -v=1                                                   |                             |         |                |                     |                     |
	|---------|--------------------------------------------------------------------------|-----------------------------|---------|----------------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/10/30 10:54:26
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.21.3 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1030 10:54:26.875867 1088729 out.go:296] Setting OutFile to fd 1 ...
	I1030 10:54:26.876096 1088729 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:54:26.876124 1088729 out.go:309] Setting ErrFile to fd 2...
	I1030 10:54:26.876146 1088729 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:54:26.876457 1088729 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
	I1030 10:54:26.876891 1088729 out.go:303] Setting JSON to false
	I1030 10:54:26.877910 1088729 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":157011,"bootTime":1698506256,"procs":240,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1048-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I1030 10:54:26.878010 1088729 start.go:138] virtualization:  
	I1030 10:54:26.882430 1088729 out.go:177] * [ingress-addon-legacy-405700] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	I1030 10:54:26.884776 1088729 out.go:177]   - MINIKUBE_LOCATION=17523
	I1030 10:54:26.886950 1088729 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 10:54:26.884950 1088729 notify.go:220] Checking for updates...
	I1030 10:54:26.891544 1088729 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	I1030 10:54:26.893789 1088729 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	I1030 10:54:26.896104 1088729 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1030 10:54:26.898324 1088729 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 10:54:26.900309 1088729 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 10:54:26.924972 1088729 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1030 10:54:26.925090 1088729 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:54:27.023898 1088729 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:26 OomKillDisable:true NGoroutines:35 SystemTime:2023-10-30 10:54:27.013773399 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:54:27.024006 1088729 docker.go:295] overlay module found
	I1030 10:54:27.026721 1088729 out.go:177] * Using the docker driver based on user configuration
	I1030 10:54:27.028521 1088729 start.go:298] selected driver: docker
	I1030 10:54:27.028547 1088729 start.go:902] validating driver "docker" against <nil>
	I1030 10:54:27.028565 1088729 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 10:54:27.029225 1088729 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:54:27.100057 1088729 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:26 OomKillDisable:true NGoroutines:35 SystemTime:2023-10-30 10:54:27.090091987 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:54:27.100217 1088729 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 10:54:27.100452 1088729 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 10:54:27.102647 1088729 out.go:177] * Using Docker driver with root privileges
	I1030 10:54:27.104715 1088729 cni.go:84] Creating CNI manager for ""
	I1030 10:54:27.104740 1088729 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 10:54:27.104751 1088729 start_flags.go:323] config:
	{Name:ingress-addon-legacy-405700 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-405700 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:doc
ker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:54:27.107397 1088729 out.go:177] * Starting control plane node ingress-addon-legacy-405700 in cluster ingress-addon-legacy-405700
	I1030 10:54:27.109245 1088729 cache.go:121] Beginning downloading kic base image for docker with docker
	I1030 10:54:27.110887 1088729 out.go:177] * Pulling base image ...
	I1030 10:54:27.112595 1088729 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1030 10:54:27.112655 1088729 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local docker daemon
	I1030 10:54:27.130431 1088729 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local docker daemon, skipping pull
	I1030 10:54:27.130457 1088729 cache.go:144] gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 exists in daemon, skipping load
	I1030 10:54:27.177054 1088729 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I1030 10:54:27.177076 1088729 cache.go:56] Caching tarball of preloaded images
	I1030 10:54:27.177250 1088729 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1030 10:54:27.179696 1088729 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I1030 10:54:27.181589 1088729 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1030 10:54:27.291109 1088729 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4?checksum=md5:c8c260b886393123ce9d312d8ac2379e -> /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I1030 10:54:34.822362 1088729 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1030 10:54:34.822489 1088729 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1030 10:54:35.952904 1088729 cache.go:59] Finished verifying existence of preloaded tar for  v1.18.20 on docker
	I1030 10:54:35.953282 1088729 profile.go:148] Saving config to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/config.json ...
	I1030 10:54:35.953315 1088729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/config.json: {Name:mk78213aa291998f23e15d203e1961e74db05c7b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:54:35.953515 1088729 cache.go:194] Successfully downloaded all kic artifacts
	I1030 10:54:35.953557 1088729 start.go:365] acquiring machines lock for ingress-addon-legacy-405700: {Name:mkbb7a0acc2528502e69e8c5fcdfec685a2a2fa5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 10:54:35.953621 1088729 start.go:369] acquired machines lock for "ingress-addon-legacy-405700" in 48.697µs
	I1030 10:54:35.953647 1088729 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-405700 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-405700 Namespace:default APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 10:54:35.953744 1088729 start.go:125] createHost starting for "" (driver="docker")
	I1030 10:54:35.956463 1088729 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I1030 10:54:35.956688 1088729 start.go:159] libmachine.API.Create for "ingress-addon-legacy-405700" (driver="docker")
	I1030 10:54:35.956713 1088729 client.go:168] LocalClient.Create starting
	I1030 10:54:35.956765 1088729 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem
	I1030 10:54:35.956800 1088729 main.go:141] libmachine: Decoding PEM data...
	I1030 10:54:35.956819 1088729 main.go:141] libmachine: Parsing certificate...
	I1030 10:54:35.956877 1088729 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem
	I1030 10:54:35.956901 1088729 main.go:141] libmachine: Decoding PEM data...
	I1030 10:54:35.956912 1088729 main.go:141] libmachine: Parsing certificate...
	I1030 10:54:35.957261 1088729 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-405700 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W1030 10:54:35.974994 1088729 cli_runner.go:211] docker network inspect ingress-addon-legacy-405700 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I1030 10:54:35.975083 1088729 network_create.go:281] running [docker network inspect ingress-addon-legacy-405700] to gather additional debugging logs...
	I1030 10:54:35.975104 1088729 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-405700
	W1030 10:54:35.991408 1088729 cli_runner.go:211] docker network inspect ingress-addon-legacy-405700 returned with exit code 1
	I1030 10:54:35.991440 1088729 network_create.go:284] error running [docker network inspect ingress-addon-legacy-405700]: docker network inspect ingress-addon-legacy-405700: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-405700 not found
	I1030 10:54:35.991454 1088729 network_create.go:286] output of [docker network inspect ingress-addon-legacy-405700]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-405700 not found
	
	** /stderr **
	I1030 10:54:35.991556 1088729 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1030 10:54:36.010802 1088729 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400214a530}
	I1030 10:54:36.010846 1088729 network_create.go:124] attempt to create docker network ingress-addon-legacy-405700 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I1030 10:54:36.010909 1088729 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-405700 ingress-addon-legacy-405700
	I1030 10:54:36.082483 1088729 network_create.go:108] docker network ingress-addon-legacy-405700 192.168.49.0/24 created
	I1030 10:54:36.082519 1088729 kic.go:121] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-405700" container
	I1030 10:54:36.082606 1088729 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I1030 10:54:36.101847 1088729 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-405700 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-405700 --label created_by.minikube.sigs.k8s.io=true
	I1030 10:54:36.120887 1088729 oci.go:103] Successfully created a docker volume ingress-addon-legacy-405700
	I1030 10:54:36.120985 1088729 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-405700-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-405700 --entrypoint /usr/bin/test -v ingress-addon-legacy-405700:/var gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 -d /var/lib
	I1030 10:54:37.498545 1088729 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-405700-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-405700 --entrypoint /usr/bin/test -v ingress-addon-legacy-405700:/var gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 -d /var/lib: (1.377512427s)
	I1030 10:54:37.498585 1088729 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-405700
	I1030 10:54:37.498604 1088729 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1030 10:54:37.498624 1088729 kic.go:194] Starting extracting preloaded images to volume ...
	I1030 10:54:37.498708 1088729 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-405700:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 -I lz4 -xf /preloaded.tar -C /extractDir
	I1030 10:54:42.060295 1088729 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-405700:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 -I lz4 -xf /preloaded.tar -C /extractDir: (4.561536063s)
	I1030 10:54:42.060327 1088729 kic.go:203] duration metric: took 4.561700 seconds to extract preloaded images to volume
	W1030 10:54:42.060491 1088729 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I1030 10:54:42.060609 1088729 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I1030 10:54:42.134827 1088729 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-405700 --name ingress-addon-legacy-405700 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-405700 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-405700 --network ingress-addon-legacy-405700 --ip 192.168.49.2 --volume ingress-addon-legacy-405700:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612
	I1030 10:54:42.498056 1088729 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-405700 --format={{.State.Running}}
	I1030 10:54:42.526196 1088729 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-405700 --format={{.State.Status}}
	I1030 10:54:42.552924 1088729 cli_runner.go:164] Run: docker exec ingress-addon-legacy-405700 stat /var/lib/dpkg/alternatives/iptables
	I1030 10:54:42.623009 1088729 oci.go:144] the created container "ingress-addon-legacy-405700" has a running status.
	I1030 10:54:42.623035 1088729 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa...
	I1030 10:54:43.403008 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I1030 10:54:43.403100 1088729 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I1030 10:54:43.431086 1088729 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-405700 --format={{.State.Status}}
	I1030 10:54:43.452649 1088729 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I1030 10:54:43.452667 1088729 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-405700 chown docker:docker /home/docker/.ssh/authorized_keys]
	I1030 10:54:43.524613 1088729 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-405700 --format={{.State.Status}}
	I1030 10:54:43.556997 1088729 machine.go:88] provisioning docker machine ...
	I1030 10:54:43.557026 1088729 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-405700"
	I1030 10:54:43.557092 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:43.582969 1088729 main.go:141] libmachine: Using SSH client type: native
	I1030 10:54:43.583394 1088729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39425 <nil> <nil>}
	I1030 10:54:43.583407 1088729 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-405700 && echo "ingress-addon-legacy-405700" | sudo tee /etc/hostname
	I1030 10:54:43.741894 1088729 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-405700
	
	I1030 10:54:43.742016 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:43.770423 1088729 main.go:141] libmachine: Using SSH client type: native
	I1030 10:54:43.770882 1088729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39425 <nil> <nil>}
	I1030 10:54:43.770912 1088729 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-405700' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-405700/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-405700' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1030 10:54:43.906738 1088729 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1030 10:54:43.906763 1088729 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17523-1035706/.minikube CaCertPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17523-1035706/.minikube}
	I1030 10:54:43.906790 1088729 ubuntu.go:177] setting up certificates
	I1030 10:54:43.906798 1088729 provision.go:83] configureAuth start
	I1030 10:54:43.906858 1088729 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-405700
	I1030 10:54:43.924174 1088729 provision.go:138] copyHostCerts
	I1030 10:54:43.924209 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.pem
	I1030 10:54:43.924237 1088729 exec_runner.go:144] found /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.pem, removing ...
	I1030 10:54:43.924244 1088729 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.pem
	I1030 10:54:43.924318 1088729 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.pem (1082 bytes)
	I1030 10:54:43.924394 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17523-1035706/.minikube/cert.pem
	I1030 10:54:43.924409 1088729 exec_runner.go:144] found /home/jenkins/minikube-integration/17523-1035706/.minikube/cert.pem, removing ...
	I1030 10:54:43.924413 1088729 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17523-1035706/.minikube/cert.pem
	I1030 10:54:43.924438 1088729 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17523-1035706/.minikube/cert.pem (1123 bytes)
	I1030 10:54:43.924485 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17523-1035706/.minikube/key.pem
	I1030 10:54:43.924500 1088729 exec_runner.go:144] found /home/jenkins/minikube-integration/17523-1035706/.minikube/key.pem, removing ...
	I1030 10:54:43.924504 1088729 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17523-1035706/.minikube/key.pem
	I1030 10:54:43.924530 1088729 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17523-1035706/.minikube/key.pem (1679 bytes)
	I1030 10:54:43.924571 1088729 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-405700 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-405700]
	I1030 10:54:44.083306 1088729 provision.go:172] copyRemoteCerts
	I1030 10:54:44.083377 1088729 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1030 10:54:44.083420 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:44.100918 1088729 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39425 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa Username:docker}
	I1030 10:54:44.199911 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I1030 10:54:44.199971 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I1030 10:54:44.226982 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server.pem -> /etc/docker/server.pem
	I1030 10:54:44.227042 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)
	I1030 10:54:44.253837 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I1030 10:54:44.253899 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I1030 10:54:44.280869 1088729 provision.go:86] duration metric: configureAuth took 374.057459ms
	I1030 10:54:44.280895 1088729 ubuntu.go:193] setting minikube options for container-runtime
	I1030 10:54:44.281091 1088729 config.go:182] Loaded profile config "ingress-addon-legacy-405700": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1030 10:54:44.281148 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:44.298657 1088729 main.go:141] libmachine: Using SSH client type: native
	I1030 10:54:44.299069 1088729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39425 <nil> <nil>}
	I1030 10:54:44.299097 1088729 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I1030 10:54:44.431012 1088729 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I1030 10:54:44.431082 1088729 ubuntu.go:71] root file system type: overlay
	I1030 10:54:44.431251 1088729 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I1030 10:54:44.431355 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:44.448767 1088729 main.go:141] libmachine: Using SSH client type: native
	I1030 10:54:44.449173 1088729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39425 <nil> <nil>}
	I1030 10:54:44.449253 1088729 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I1030 10:54:44.592163 1088729 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I1030 10:54:44.592335 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:44.611931 1088729 main.go:141] libmachine: Using SSH client type: native
	I1030 10:54:44.612338 1088729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ae610] 0x3b0d80 <nil>  [] 0s} 127.0.0.1 39425 <nil> <nil>}
	I1030 10:54:44.612360 1088729 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I1030 10:54:45.439338 1088729 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-10-26 09:06:20.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-10-30 10:54:44.587732149 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I1030 10:54:45.439374 1088729 machine.go:91] provisioned docker machine in 1.882356528s
	I1030 10:54:45.439386 1088729 client.go:171] LocalClient.Create took 9.482666759s
	I1030 10:54:45.439400 1088729 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-405700" took 9.482711986s
	I1030 10:54:45.439408 1088729 start.go:300] post-start starting for "ingress-addon-legacy-405700" (driver="docker")
	I1030 10:54:45.439417 1088729 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1030 10:54:45.439483 1088729 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1030 10:54:45.439537 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:45.459768 1088729 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39425 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa Username:docker}
	I1030 10:54:45.556296 1088729 ssh_runner.go:195] Run: cat /etc/os-release
	I1030 10:54:45.560362 1088729 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I1030 10:54:45.560428 1088729 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I1030 10:54:45.560447 1088729 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I1030 10:54:45.560460 1088729 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I1030 10:54:45.560484 1088729 filesync.go:126] Scanning /home/jenkins/minikube-integration/17523-1035706/.minikube/addons for local assets ...
	I1030 10:54:45.560546 1088729 filesync.go:126] Scanning /home/jenkins/minikube-integration/17523-1035706/.minikube/files for local assets ...
	I1030 10:54:45.560647 1088729 filesync.go:149] local asset: /home/jenkins/minikube-integration/17523-1035706/.minikube/files/etc/ssl/certs/10411212.pem -> 10411212.pem in /etc/ssl/certs
	I1030 10:54:45.560656 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/files/etc/ssl/certs/10411212.pem -> /etc/ssl/certs/10411212.pem
	I1030 10:54:45.560755 1088729 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I1030 10:54:45.570631 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/files/etc/ssl/certs/10411212.pem --> /etc/ssl/certs/10411212.pem (1708 bytes)
	I1030 10:54:45.597481 1088729 start.go:303] post-start completed in 158.053648ms
	I1030 10:54:45.597912 1088729 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-405700
	I1030 10:54:45.616036 1088729 profile.go:148] Saving config to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/config.json ...
	I1030 10:54:45.616313 1088729 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1030 10:54:45.616367 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:45.633664 1088729 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39425 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa Username:docker}
	I1030 10:54:45.723438 1088729 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I1030 10:54:45.728921 1088729 start.go:128] duration metric: createHost completed in 9.775157148s
	I1030 10:54:45.728944 1088729 start.go:83] releasing machines lock for "ingress-addon-legacy-405700", held for 9.775309565s
	I1030 10:54:45.729014 1088729 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-405700
	I1030 10:54:45.746430 1088729 ssh_runner.go:195] Run: cat /version.json
	I1030 10:54:45.746492 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:45.746546 1088729 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1030 10:54:45.746613 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:54:45.773994 1088729 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39425 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa Username:docker}
	I1030 10:54:45.777403 1088729 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39425 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa Username:docker}
	I1030 10:54:45.866431 1088729 ssh_runner.go:195] Run: systemctl --version
	I1030 10:54:46.005389 1088729 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I1030 10:54:46.011386 1088729 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I1030 10:54:46.041770 1088729 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I1030 10:54:46.041889 1088729 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I1030 10:54:46.062030 1088729 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I1030 10:54:46.083137 1088729 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I1030 10:54:46.083164 1088729 start.go:472] detecting cgroup driver to use...
	I1030 10:54:46.083214 1088729 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I1030 10:54:46.083334 1088729 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1030 10:54:46.102742 1088729 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I1030 10:54:46.114192 1088729 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1030 10:54:46.126171 1088729 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I1030 10:54:46.126259 1088729 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1030 10:54:46.137576 1088729 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1030 10:54:46.149266 1088729 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1030 10:54:46.161271 1088729 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1030 10:54:46.174845 1088729 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1030 10:54:46.186324 1088729 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1030 10:54:46.198219 1088729 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1030 10:54:46.208287 1088729 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1030 10:54:46.218410 1088729 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1030 10:54:46.317611 1088729 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1030 10:54:46.425611 1088729 start.go:472] detecting cgroup driver to use...
	I1030 10:54:46.425714 1088729 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I1030 10:54:46.425800 1088729 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I1030 10:54:46.440746 1088729 cruntime.go:279] skipping containerd shutdown because we are bound to it
	I1030 10:54:46.440870 1088729 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1030 10:54:46.457363 1088729 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock
	" | sudo tee /etc/crictl.yaml"
	I1030 10:54:46.478345 1088729 ssh_runner.go:195] Run: which cri-dockerd
	I1030 10:54:46.483027 1088729 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I1030 10:54:46.494381 1088729 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I1030 10:54:46.523892 1088729 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I1030 10:54:46.644860 1088729 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I1030 10:54:46.756574 1088729 docker.go:555] configuring docker to use "cgroupfs" as cgroup driver...
	I1030 10:54:46.756757 1088729 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I1030 10:54:46.783367 1088729 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1030 10:54:46.875036 1088729 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1030 10:54:47.150807 1088729 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1030 10:54:47.176942 1088729 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1030 10:54:47.205955 1088729 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 24.0.7 ...
	I1030 10:54:47.206072 1088729 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-405700 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1030 10:54:47.223247 1088729 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I1030 10:54:47.227520 1088729 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1030 10:54:47.240318 1088729 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1030 10:54:47.240396 1088729 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1030 10:54:47.261014 1088729 docker.go:693] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I1030 10:54:47.261047 1088729 docker.go:699] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I1030 10:54:47.261096 1088729 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1030 10:54:47.271603 1088729 ssh_runner.go:195] Run: which lz4
	I1030 10:54:47.275750 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4
	I1030 10:54:47.275843 1088729 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I1030 10:54:47.280129 1088729 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I1030 10:54:47.280162 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (459739018 bytes)
	I1030 10:54:49.228137 1088729 docker.go:657] Took 1.952328 seconds to copy over tarball
	I1030 10:54:49.228232 1088729 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I1030 10:54:51.677447 1088729 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.449183544s)
	I1030 10:54:51.677512 1088729 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I1030 10:54:51.761154 1088729 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1030 10:54:51.772092 1088729 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)
	I1030 10:54:51.793348 1088729 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1030 10:54:51.892768 1088729 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1030 10:54:53.337754 1088729 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.444949946s)
	I1030 10:54:53.337850 1088729 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1030 10:54:53.359514 1088729 docker.go:693] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I1030 10:54:53.359533 1088729 docker.go:699] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I1030 10:54:53.359540 1088729 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I1030 10:54:53.362138 1088729 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I1030 10:54:53.362294 1088729 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I1030 10:54:53.362517 1088729 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I1030 10:54:53.362599 1088729 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I1030 10:54:53.362665 1088729 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 10:54:53.362724 1088729 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I1030 10:54:53.362847 1088729 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I1030 10:54:53.362969 1088729 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I1030 10:54:53.364323 1088729 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I1030 10:54:53.364339 1088729 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 10:54:53.364404 1088729 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	I1030 10:54:53.364435 1088729 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I1030 10:54:53.364466 1088729 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	I1030 10:54:53.364622 1088729 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	I1030 10:54:53.364738 1088729 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I1030 10:54:53.364774 1088729 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	W1030 10:54:53.742622 1088729 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I1030 10:54:53.742937 1088729 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20
	W1030 10:54:53.747090 1088729 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I1030 10:54:53.747375 1088729 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20
	W1030 10:54:53.766116 1088729 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I1030 10:54:53.766375 1088729 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20
	I1030 10:54:53.771589 1088729 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime
	I1030 10:54:53.771674 1088729 docker.go:318] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I1030 10:54:53.771747 1088729 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20
	W1030 10:54:53.778705 1088729 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing
	I1030 10:54:53.778876 1088729 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7
	I1030 10:54:53.779184 1088729 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime
	I1030 10:54:53.779217 1088729 docker.go:318] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I1030 10:54:53.779246 1088729 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20
	I1030 10:54:53.782610 1088729 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2
	W1030 10:54:53.787861 1088729 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing
	I1030 10:54:53.788119 1088729 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0
	W1030 10:54:53.792780 1088729 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I1030 10:54:53.793026 1088729 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20
	I1030 10:54:53.843176 1088729 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20
	I1030 10:54:53.843609 1088729 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime
	I1030 10:54:53.843680 1088729 docker.go:318] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I1030 10:54:53.843761 1088729 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20
	I1030 10:54:53.870424 1088729 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20
	I1030 10:54:53.870573 1088729 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime
	I1030 10:54:53.870622 1088729 docker.go:318] Removing image: registry.k8s.io/pause:3.2
	I1030 10:54:53.870694 1088729 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2
	I1030 10:54:53.870853 1088729 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime
	I1030 10:54:53.870912 1088729 docker.go:318] Removing image: registry.k8s.io/coredns:1.6.7
	I1030 10:54:53.870972 1088729 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7
	I1030 10:54:53.880514 1088729 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime
	I1030 10:54:53.880696 1088729 docker.go:318] Removing image: registry.k8s.io/etcd:3.4.3-0
	I1030 10:54:53.880634 1088729 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime
	I1030 10:54:53.880761 1088729 docker.go:318] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I1030 10:54:53.880854 1088729 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I1030 10:54:53.880829 1088729 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0
	I1030 10:54:53.896164 1088729 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20
	I1030 10:54:53.935077 1088729 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2
	I1030 10:54:53.939300 1088729 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7
	I1030 10:54:53.942312 1088729 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0
	I1030 10:54:53.942654 1088729 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20
	W1030 10:54:54.043055 1088729 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I1030 10:54:54.043223 1088729 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 10:54:54.064033 1088729 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I1030 10:54:54.064082 1088729 docker.go:318] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 10:54:54.064133 1088729 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 10:54:54.098918 1088729 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I1030 10:54:54.099004 1088729 cache_images.go:92] LoadImages completed in 739.451863ms
	W1030 10:54:54.099084 1088729 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20: no such file or directory
	I1030 10:54:54.099156 1088729 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I1030 10:54:54.164935 1088729 cni.go:84] Creating CNI manager for ""
	I1030 10:54:54.164962 1088729 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 10:54:54.164998 1088729 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I1030 10:54:54.165024 1088729 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-405700 NodeName:ingress-addon-legacy-405700 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.
crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I1030 10:54:54.165165 1088729 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /var/run/dockershim.sock
	  name: "ingress-addon-legacy-405700"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1030 10:54:54.165230 1088729 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-405700 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-405700 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I1030 10:54:54.165298 1088729 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I1030 10:54:54.176067 1088729 binaries.go:44] Found k8s binaries, skipping transfer
	I1030 10:54:54.176144 1088729 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1030 10:54:54.186397 1088729 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (354 bytes)
	I1030 10:54:54.206893 1088729 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I1030 10:54:54.227784 1088729 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2124 bytes)
	I1030 10:54:54.248134 1088729 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I1030 10:54:54.252655 1088729 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1030 10:54:54.265445 1088729 certs.go:56] Setting up /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700 for IP: 192.168.49.2
	I1030 10:54:54.265486 1088729 certs.go:190] acquiring lock for shared ca certs: {Name:mk35ac8fef6dbcf5959ebe65369e3fe30a1c5574 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:54:54.265620 1088729 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.key
	I1030 10:54:54.265669 1088729 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.key
	I1030 10:54:54.265765 1088729 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.key
	I1030 10:54:54.265799 1088729 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt with IP's: []
	I1030 10:54:54.737655 1088729 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt ...
	I1030 10:54:54.737699 1088729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: {Name:mk384f5023c63828b2451eadbfd9cc0ad1994811 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:54:54.737922 1088729 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.key ...
	I1030 10:54:54.737940 1088729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.key: {Name:mk9355e4956366b2c19560d5fcfe28e78e7ecf89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:54:54.738039 1088729 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.key.dd3b5fb2
	I1030 10:54:54.738055 1088729 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I1030 10:54:54.857631 1088729 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.crt.dd3b5fb2 ...
	I1030 10:54:54.857660 1088729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.crt.dd3b5fb2: {Name:mk8270c02bca35456d22a05289739c158419ac5c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:54:54.857845 1088729 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.key.dd3b5fb2 ...
	I1030 10:54:54.857858 1088729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.key.dd3b5fb2: {Name:mk93c21b1d9552a399da1a93797bc6e9ed267121 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:54:54.857940 1088729 certs.go:337] copying /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.crt
	I1030 10:54:54.858016 1088729 certs.go:341] copying /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.key
	I1030 10:54:54.858072 1088729 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.key
	I1030 10:54:54.858094 1088729 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.crt with IP's: []
	I1030 10:54:55.347385 1088729 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.crt ...
	I1030 10:54:55.347418 1088729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.crt: {Name:mk795e37768dd5b30b56f5e19ca42955cdf7b36b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:54:55.347611 1088729 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.key ...
	I1030 10:54:55.347625 1088729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.key: {Name:mkb80dfdc0950ea7001191249b9aa8c2304d7eec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:54:55.347707 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I1030 10:54:55.347728 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I1030 10:54:55.347740 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I1030 10:54:55.347755 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I1030 10:54:55.347774 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I1030 10:54:55.347790 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I1030 10:54:55.347805 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I1030 10:54:55.347816 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I1030 10:54:55.347871 1088729 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/1041121.pem (1338 bytes)
	W1030 10:54:55.347912 1088729 certs.go:433] ignoring /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/1041121_empty.pem, impossibly tiny 0 bytes
	I1030 10:54:55.347926 1088729 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca-key.pem (1679 bytes)
	I1030 10:54:55.347960 1088729 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/ca.pem (1082 bytes)
	I1030 10:54:55.347994 1088729 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/cert.pem (1123 bytes)
	I1030 10:54:55.348017 1088729 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/certs/key.pem (1679 bytes)
	I1030 10:54:55.348066 1088729 certs.go:437] found cert: /home/jenkins/minikube-integration/17523-1035706/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17523-1035706/.minikube/files/etc/ssl/certs/10411212.pem (1708 bytes)
	I1030 10:54:55.348095 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/1041121.pem -> /usr/share/ca-certificates/1041121.pem
	I1030 10:54:55.348112 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/files/etc/ssl/certs/10411212.pem -> /usr/share/ca-certificates/10411212.pem
	I1030 10:54:55.348125 1088729 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I1030 10:54:55.348774 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I1030 10:54:55.376332 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I1030 10:54:55.404228 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1030 10:54:55.432028 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I1030 10:54:55.460269 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1030 10:54:55.488991 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I1030 10:54:55.516842 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1030 10:54:55.545487 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I1030 10:54:55.573944 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/certs/1041121.pem --> /usr/share/ca-certificates/1041121.pem (1338 bytes)
	I1030 10:54:55.602317 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/files/etc/ssl/certs/10411212.pem --> /usr/share/ca-certificates/10411212.pem (1708 bytes)
	I1030 10:54:55.629461 1088729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1030 10:54:55.657078 1088729 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
	I1030 10:54:55.677099 1088729 ssh_runner.go:195] Run: openssl version
	I1030 10:54:55.684279 1088729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10411212.pem && ln -fs /usr/share/ca-certificates/10411212.pem /etc/ssl/certs/10411212.pem"
	I1030 10:54:55.695831 1088729 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10411212.pem
	I1030 10:54:55.700378 1088729 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Oct 30 10:50 /usr/share/ca-certificates/10411212.pem
	I1030 10:54:55.700447 1088729 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10411212.pem
	I1030 10:54:55.708722 1088729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/10411212.pem /etc/ssl/certs/3ec20f2e.0"
	I1030 10:54:55.720152 1088729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1030 10:54:55.731458 1088729 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1030 10:54:55.736429 1088729 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Oct 30 10:45 /usr/share/ca-certificates/minikubeCA.pem
	I1030 10:54:55.736547 1088729 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1030 10:54:55.745172 1088729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1030 10:54:55.756556 1088729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1041121.pem && ln -fs /usr/share/ca-certificates/1041121.pem /etc/ssl/certs/1041121.pem"
	I1030 10:54:55.767727 1088729 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1041121.pem
	I1030 10:54:55.773084 1088729 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Oct 30 10:50 /usr/share/ca-certificates/1041121.pem
	I1030 10:54:55.773156 1088729 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1041121.pem
	I1030 10:54:55.781502 1088729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1041121.pem /etc/ssl/certs/51391683.0"
	I1030 10:54:55.793022 1088729 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I1030 10:54:55.797426 1088729 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I1030 10:54:55.797477 1088729 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-405700 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-405700 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMe
trics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:54:55.797602 1088729 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1030 10:54:55.817080 1088729 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1030 10:54:55.827712 1088729 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1030 10:54:55.838360 1088729 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I1030 10:54:55.838459 1088729 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1030 10:54:55.848781 1088729 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1030 10:54:55.848826 1088729 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I1030 10:54:55.902375 1088729 kubeadm.go:322] W1030 10:54:55.901801    1663 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I1030 10:54:56.060823 1088729 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
	I1030 10:54:56.123900 1088729 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03
	I1030 10:54:56.124175 1088729 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1048-aws\n", err: exit status 1
	I1030 10:54:56.208955 1088729 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1030 10:55:04.760978 1088729 kubeadm.go:322] W1030 10:55:04.760542    1663 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I1030 10:55:04.765374 1088729 kubeadm.go:322] W1030 10:55:04.762686    1663 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I1030 10:55:19.250718 1088729 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I1030 10:55:19.250775 1088729 kubeadm.go:322] [preflight] Running pre-flight checks
	I1030 10:55:19.250910 1088729 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I1030 10:55:19.250982 1088729 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1048-aws
	I1030 10:55:19.251043 1088729 kubeadm.go:322] DOCKER_VERSION: 24.0.7
	I1030 10:55:19.251091 1088729 kubeadm.go:322] OS: Linux
	I1030 10:55:19.251152 1088729 kubeadm.go:322] CGROUPS_CPU: enabled
	I1030 10:55:19.251207 1088729 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I1030 10:55:19.251261 1088729 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I1030 10:55:19.251307 1088729 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I1030 10:55:19.251363 1088729 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I1030 10:55:19.251408 1088729 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I1030 10:55:19.251475 1088729 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1030 10:55:19.251563 1088729 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1030 10:55:19.251648 1088729 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1030 10:55:19.251745 1088729 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1030 10:55:19.251826 1088729 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1030 10:55:19.251863 1088729 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I1030 10:55:19.251921 1088729 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1030 10:55:19.254083 1088729 out.go:204]   - Generating certificates and keys ...
	I1030 10:55:19.254164 1088729 kubeadm.go:322] [certs] Using existing ca certificate authority
	I1030 10:55:19.254224 1088729 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I1030 10:55:19.254286 1088729 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I1030 10:55:19.254339 1088729 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I1030 10:55:19.254395 1088729 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I1030 10:55:19.254442 1088729 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I1030 10:55:19.254492 1088729 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I1030 10:55:19.254620 1088729 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-405700 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I1030 10:55:19.254669 1088729 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I1030 10:55:19.254798 1088729 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-405700 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I1030 10:55:19.254860 1088729 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I1030 10:55:19.254919 1088729 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I1030 10:55:19.254960 1088729 kubeadm.go:322] [certs] Generating "sa" key and public key
	I1030 10:55:19.255017 1088729 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1030 10:55:19.255064 1088729 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1030 10:55:19.255114 1088729 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1030 10:55:19.255175 1088729 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1030 10:55:19.255229 1088729 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1030 10:55:19.255291 1088729 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1030 10:55:19.257236 1088729 out.go:204]   - Booting up control plane ...
	I1030 10:55:19.257350 1088729 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1030 10:55:19.257452 1088729 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1030 10:55:19.257560 1088729 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1030 10:55:19.257656 1088729 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1030 10:55:19.257855 1088729 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1030 10:55:19.257954 1088729 kubeadm.go:322] [apiclient] All control plane components are healthy after 13.004090 seconds
	I1030 10:55:19.258068 1088729 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1030 10:55:19.258203 1088729 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I1030 10:55:19.258265 1088729 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I1030 10:55:19.258403 1088729 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-405700 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I1030 10:55:19.258463 1088729 kubeadm.go:322] [bootstrap-token] Using token: gdg21o.ffs6pb0bhfs9519e
	I1030 10:55:19.260642 1088729 out.go:204]   - Configuring RBAC rules ...
	I1030 10:55:19.260752 1088729 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1030 10:55:19.260843 1088729 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1030 10:55:19.260989 1088729 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1030 10:55:19.261126 1088729 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1030 10:55:19.261245 1088729 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1030 10:55:19.261333 1088729 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1030 10:55:19.261471 1088729 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1030 10:55:19.261519 1088729 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I1030 10:55:19.261569 1088729 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I1030 10:55:19.261577 1088729 kubeadm.go:322] 
	I1030 10:55:19.261637 1088729 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I1030 10:55:19.261646 1088729 kubeadm.go:322] 
	I1030 10:55:19.261836 1088729 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I1030 10:55:19.261846 1088729 kubeadm.go:322] 
	I1030 10:55:19.261924 1088729 kubeadm.go:322]   mkdir -p $HOME/.kube
	I1030 10:55:19.261989 1088729 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1030 10:55:19.262043 1088729 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1030 10:55:19.262051 1088729 kubeadm.go:322] 
	I1030 10:55:19.262104 1088729 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I1030 10:55:19.262182 1088729 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1030 10:55:19.262254 1088729 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1030 10:55:19.262262 1088729 kubeadm.go:322] 
	I1030 10:55:19.262346 1088729 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I1030 10:55:19.262426 1088729 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I1030 10:55:19.262439 1088729 kubeadm.go:322] 
	I1030 10:55:19.262529 1088729 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token gdg21o.ffs6pb0bhfs9519e \
	I1030 10:55:19.262639 1088729 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:ce9a292b1ae26f9fbe2c4b69b1075579d7565513efa42432b5fb2190effcab02 \
	I1030 10:55:19.262666 1088729 kubeadm.go:322]     --control-plane 
	I1030 10:55:19.262674 1088729 kubeadm.go:322] 
	I1030 10:55:19.262759 1088729 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I1030 10:55:19.262767 1088729 kubeadm.go:322] 
	I1030 10:55:19.262849 1088729 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token gdg21o.ffs6pb0bhfs9519e \
	I1030 10:55:19.262966 1088729 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:ce9a292b1ae26f9fbe2c4b69b1075579d7565513efa42432b5fb2190effcab02 
	I1030 10:55:19.262977 1088729 cni.go:84] Creating CNI manager for ""
	I1030 10:55:19.262991 1088729 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 10:55:19.263014 1088729 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1030 10:55:19.263272 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:19.263346 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.32.0-beta.0 minikube.k8s.io/commit=99c50ab9af570595672bd37bf6c89e1874e94ce6 minikube.k8s.io/name=ingress-addon-legacy-405700 minikube.k8s.io/updated_at=2023_10_30T10_55_19_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:19.869599 1088729 ops.go:34] apiserver oom_adj: -16
	I1030 10:55:19.869714 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:19.964130 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:20.568220 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:21.067841 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:21.567707 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:22.068207 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:22.568653 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:23.068603 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:23.568210 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:24.067714 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:24.568161 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:25.067669 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:25.568440 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:26.068661 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:26.568403 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:27.068128 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:27.568409 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:28.067689 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:28.568598 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:29.067658 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:29.568242 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:30.068261 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:30.568086 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:31.068145 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:31.567995 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:32.068633 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:32.567829 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:33.067670 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:33.568410 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:34.068093 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:34.567753 1088729 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1030 10:55:34.682174 1088729 kubeadm.go:1081] duration metric: took 15.418965668s to wait for elevateKubeSystemPrivileges.
	I1030 10:55:34.682210 1088729 kubeadm.go:406] StartCluster complete in 38.88473733s
	I1030 10:55:34.682227 1088729 settings.go:142] acquiring lock: {Name:mk9300d27314fbb0c685d690de8daf59e1e7eaad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:55:34.682289 1088729 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17523-1035706/kubeconfig
	I1030 10:55:34.682986 1088729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17523-1035706/kubeconfig: {Name:mk499c0a7679b260b6d0f05a73cda6c48a73e416 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 10:55:34.683756 1088729 kapi.go:59] client config for ingress-addon-legacy-405700: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt", KeyFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.key", CAFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16bdf70), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1030 10:55:34.685278 1088729 config.go:182] Loaded profile config "ingress-addon-legacy-405700": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1030 10:55:34.685338 1088729 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I1030 10:55:34.685421 1088729 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false]
	I1030 10:55:34.685530 1088729 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-405700"
	I1030 10:55:34.685551 1088729 addons.go:231] Setting addon storage-provisioner=true in "ingress-addon-legacy-405700"
	I1030 10:55:34.685606 1088729 host.go:66] Checking if "ingress-addon-legacy-405700" exists ...
	I1030 10:55:34.686120 1088729 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-405700 --format={{.State.Status}}
	I1030 10:55:34.686685 1088729 cert_rotation.go:137] Starting client certificate rotation controller
	I1030 10:55:34.686723 1088729 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-405700"
	I1030 10:55:34.686742 1088729 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-405700"
	I1030 10:55:34.687012 1088729 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-405700 --format={{.State.Status}}
	I1030 10:55:34.735184 1088729 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-405700" context rescaled to 1 replicas
	I1030 10:55:34.735222 1088729 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 10:55:34.737331 1088729 out.go:177] * Verifying Kubernetes components...
	I1030 10:55:34.739151 1088729 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1030 10:55:34.749257 1088729 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 10:55:34.747787 1088729 kapi.go:59] client config for ingress-addon-legacy-405700: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt", KeyFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.key", CAFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16bdf70), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1030 10:55:34.751547 1088729 addons.go:231] Setting addon default-storageclass=true in "ingress-addon-legacy-405700"
	I1030 10:55:34.751589 1088729 host.go:66] Checking if "ingress-addon-legacy-405700" exists ...
	I1030 10:55:34.752084 1088729 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-405700 --format={{.State.Status}}
	I1030 10:55:34.752333 1088729 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1030 10:55:34.752351 1088729 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1030 10:55:34.752395 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:55:34.802232 1088729 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39425 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa Username:docker}
	I1030 10:55:34.809372 1088729 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I1030 10:55:34.809397 1088729 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1030 10:55:34.809473 1088729 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-405700
	I1030 10:55:34.849475 1088729 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39425 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/ingress-addon-legacy-405700/id_rsa Username:docker}
	I1030 10:55:34.926471 1088729 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I1030 10:55:34.927140 1088729 kapi.go:59] client config for ingress-addon-legacy-405700: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt", KeyFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.key", CAFile:"/home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x16bdf70), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1030 10:55:34.927405 1088729 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-405700" to be "Ready" ...
	I1030 10:55:34.931289 1088729 node_ready.go:49] node "ingress-addon-legacy-405700" has status "Ready":"True"
	I1030 10:55:34.931314 1088729 node_ready.go:38] duration metric: took 3.885775ms waiting for node "ingress-addon-legacy-405700" to be "Ready" ...
	I1030 10:55:34.931325 1088729 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1030 10:55:34.943347 1088729 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-td2vl" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:35.009247 1088729 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1030 10:55:35.066774 1088729 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1030 10:55:35.393164 1088729 start.go:926] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I1030 10:55:35.577977 1088729 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I1030 10:55:35.579975 1088729 addons.go:502] enable addons completed in 894.546356ms: enabled=[storage-provisioner default-storageclass]
	I1030 10:55:36.960836 1088729 pod_ready.go:102] pod "coredns-66bff467f8-td2vl" in "kube-system" namespace has status "Ready":"False"
	I1030 10:55:39.453917 1088729 pod_ready.go:102] pod "coredns-66bff467f8-td2vl" in "kube-system" namespace has status "Ready":"False"
	I1030 10:55:41.454241 1088729 pod_ready.go:92] pod "coredns-66bff467f8-td2vl" in "kube-system" namespace has status "Ready":"True"
	I1030 10:55:41.454270 1088729 pod_ready.go:81] duration metric: took 6.510884077s waiting for pod "coredns-66bff467f8-td2vl" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.454282 1088729 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-405700" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.458802 1088729 pod_ready.go:92] pod "etcd-ingress-addon-legacy-405700" in "kube-system" namespace has status "Ready":"True"
	I1030 10:55:41.458829 1088729 pod_ready.go:81] duration metric: took 4.540121ms waiting for pod "etcd-ingress-addon-legacy-405700" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.458841 1088729 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-405700" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.463475 1088729 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-405700" in "kube-system" namespace has status "Ready":"True"
	I1030 10:55:41.463500 1088729 pod_ready.go:81] duration metric: took 4.650848ms waiting for pod "kube-apiserver-ingress-addon-legacy-405700" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.463512 1088729 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-405700" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.468067 1088729 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-405700" in "kube-system" namespace has status "Ready":"True"
	I1030 10:55:41.468088 1088729 pod_ready.go:81] duration metric: took 4.569282ms waiting for pod "kube-controller-manager-ingress-addon-legacy-405700" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.468100 1088729 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-ctbxt" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.472538 1088729 pod_ready.go:92] pod "kube-proxy-ctbxt" in "kube-system" namespace has status "Ready":"True"
	I1030 10:55:41.472560 1088729 pod_ready.go:81] duration metric: took 4.451293ms waiting for pod "kube-proxy-ctbxt" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.472571 1088729 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-405700" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.649972 1088729 request.go:629] Waited for 177.317994ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-405700
	I1030 10:55:41.850028 1088729 request.go:629] Waited for 197.322289ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-405700
	I1030 10:55:41.852710 1088729 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-405700" in "kube-system" namespace has status "Ready":"True"
	I1030 10:55:41.852734 1088729 pod_ready.go:81] duration metric: took 380.155783ms waiting for pod "kube-scheduler-ingress-addon-legacy-405700" in "kube-system" namespace to be "Ready" ...
	I1030 10:55:41.852744 1088729 pod_ready.go:38] duration metric: took 6.921405161s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1030 10:55:41.852763 1088729 api_server.go:52] waiting for apiserver process to appear ...
	I1030 10:55:41.852821 1088729 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1030 10:55:41.865888 1088729 api_server.go:72] duration metric: took 7.130633264s to wait for apiserver process to appear ...
	I1030 10:55:41.865909 1088729 api_server.go:88] waiting for apiserver healthz status ...
	I1030 10:55:41.865925 1088729 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I1030 10:55:41.881924 1088729 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I1030 10:55:41.882891 1088729 api_server.go:141] control plane version: v1.18.20
	I1030 10:55:41.882921 1088729 api_server.go:131] duration metric: took 17.005579ms to wait for apiserver health ...
	I1030 10:55:41.882930 1088729 system_pods.go:43] waiting for kube-system pods to appear ...
	I1030 10:55:42.050238 1088729 request.go:629] Waited for 167.242108ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I1030 10:55:42.055854 1088729 system_pods.go:59] 7 kube-system pods found
	I1030 10:55:42.055894 1088729 system_pods.go:61] "coredns-66bff467f8-td2vl" [115f6ad5-2bf2-4d72-9a52-3b079fa409e6] Running
	I1030 10:55:42.055901 1088729 system_pods.go:61] "etcd-ingress-addon-legacy-405700" [81ce3dab-a231-4e8c-9ce6-ab78f5e8d2b7] Running
	I1030 10:55:42.055907 1088729 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-405700" [95c50eb4-b8fa-4f82-a653-a7ea3d58559e] Running
	I1030 10:55:42.055912 1088729 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-405700" [a9e838d4-280f-49f8-af2f-a84c85d03a6f] Running
	I1030 10:55:42.055917 1088729 system_pods.go:61] "kube-proxy-ctbxt" [13b7f6bc-0385-4824-afaa-3095bd6da193] Running
	I1030 10:55:42.055926 1088729 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-405700" [af00f2c0-cf2d-4d0d-87f5-6cc0788f9df7] Running
	I1030 10:55:42.055931 1088729 system_pods.go:61] "storage-provisioner" [ca32181e-5d06-49a3-84be-2be43d861afa] Running
	I1030 10:55:42.055944 1088729 system_pods.go:74] duration metric: took 173.007886ms to wait for pod list to return data ...
	I1030 10:55:42.055958 1088729 default_sa.go:34] waiting for default service account to be created ...
	I1030 10:55:42.250377 1088729 request.go:629] Waited for 194.311233ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I1030 10:55:42.252744 1088729 default_sa.go:45] found service account: "default"
	I1030 10:55:42.252774 1088729 default_sa.go:55] duration metric: took 196.806166ms for default service account to be created ...
	I1030 10:55:42.252784 1088729 system_pods.go:116] waiting for k8s-apps to be running ...
	I1030 10:55:42.450186 1088729 request.go:629] Waited for 197.315774ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I1030 10:55:42.455551 1088729 system_pods.go:86] 7 kube-system pods found
	I1030 10:55:42.455582 1088729 system_pods.go:89] "coredns-66bff467f8-td2vl" [115f6ad5-2bf2-4d72-9a52-3b079fa409e6] Running
	I1030 10:55:42.455589 1088729 system_pods.go:89] "etcd-ingress-addon-legacy-405700" [81ce3dab-a231-4e8c-9ce6-ab78f5e8d2b7] Running
	I1030 10:55:42.455595 1088729 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-405700" [95c50eb4-b8fa-4f82-a653-a7ea3d58559e] Running
	I1030 10:55:42.455600 1088729 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-405700" [a9e838d4-280f-49f8-af2f-a84c85d03a6f] Running
	I1030 10:55:42.455605 1088729 system_pods.go:89] "kube-proxy-ctbxt" [13b7f6bc-0385-4824-afaa-3095bd6da193] Running
	I1030 10:55:42.455610 1088729 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-405700" [af00f2c0-cf2d-4d0d-87f5-6cc0788f9df7] Running
	I1030 10:55:42.455614 1088729 system_pods.go:89] "storage-provisioner" [ca32181e-5d06-49a3-84be-2be43d861afa] Running
	I1030 10:55:42.455622 1088729 system_pods.go:126] duration metric: took 202.832201ms to wait for k8s-apps to be running ...
	I1030 10:55:42.455639 1088729 system_svc.go:44] waiting for kubelet service to be running ....
	I1030 10:55:42.455704 1088729 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1030 10:55:42.469137 1088729 system_svc.go:56] duration metric: took 13.487146ms WaitForService to wait for kubelet.
	I1030 10:55:42.469160 1088729 kubeadm.go:581] duration metric: took 7.733914123s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I1030 10:55:42.469180 1088729 node_conditions.go:102] verifying NodePressure condition ...
	I1030 10:55:42.649461 1088729 request.go:629] Waited for 180.204826ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I1030 10:55:42.652316 1088729 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I1030 10:55:42.652348 1088729 node_conditions.go:123] node cpu capacity is 2
	I1030 10:55:42.652359 1088729 node_conditions.go:105] duration metric: took 183.174808ms to run NodePressure ...
	I1030 10:55:42.652372 1088729 start.go:228] waiting for startup goroutines ...
	I1030 10:55:42.652379 1088729 start.go:233] waiting for cluster config update ...
	I1030 10:55:42.652389 1088729 start.go:242] writing updated cluster config ...
	I1030 10:55:42.652684 1088729 ssh_runner.go:195] Run: rm -f paused
	I1030 10:55:42.715400 1088729 start.go:600] kubectl: 1.28.3, cluster: 1.18.20 (minor skew: 10)
	I1030 10:55:42.717520 1088729 out.go:177] 
	W1030 10:55:42.719464 1088729 out.go:239] ! /usr/local/bin/kubectl is version 1.28.3, which may have incompatibilities with Kubernetes 1.18.20.
	I1030 10:55:42.721144 1088729 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I1030 10:55:42.722862 1088729 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-405700" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Oct 30 10:54:53 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:54:53.311235196Z" level=info msg="Daemon has completed initialization"
	Oct 30 10:54:53 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:54:53.335711132Z" level=info msg="API listen on [::]:2376"
	Oct 30 10:54:53 ingress-addon-legacy-405700 systemd[1]: Started Docker Application Container Engine.
	Oct 30 10:54:53 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:54:53.337839225Z" level=info msg="API listen on /var/run/docker.sock"
	Oct 30 10:55:45 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:45.349181184Z" level=warning msg="reference for unknown type: " digest="sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7" remote="docker.io/jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7"
	Oct 30 10:55:46 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:46.810989001Z" level=info msg="ignoring event" container=5c6f26834f8646c828e2a7826324da7c39a4d07e0d29a40ce5ca8bf6e339a1e8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:55:46 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:46.915256578Z" level=info msg="ignoring event" container=6394085089d47b0585a0a12b3c1e0f94c001a24a4b91679fc4c52df8c051a2e5 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:55:47 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:47.071017451Z" level=info msg="ignoring event" container=cfa73bb943f02478d5bd463fa5778b0661295118ed6eab3fe8cbabe203cfbf8f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:55:47 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:47.223269604Z" level=info msg="ignoring event" container=ae18e245d2519c79e022c31af64468dc7384ca5dd1e879573e6d05079269abee module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:55:47 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:47.881208744Z" level=warning msg="reference for unknown type: " digest="sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324" remote="registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324"
	Oct 30 10:55:48 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:48.103458446Z" level=info msg="ignoring event" container=43462cd2e6cae0ff08a9f228e248ad4c0608480944860368fe406c44e11e31fd module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:55:54 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:54.345318821Z" level=warning msg="Published ports are discarded when using host network mode"
	Oct 30 10:55:54 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:54.379317270Z" level=warning msg="Published ports are discarded when using host network mode"
	Oct 30 10:55:54 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:55:54.536214726Z" level=warning msg="reference for unknown type: " digest="sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" remote="docker.io/cryptexlabs/minikube-ingress-dns@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab"
	Oct 30 10:56:00 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:00.685297510Z" level=info msg="ignoring event" container=c4b70ffc4d39f38c8f6c3c62cc230816eac31e5432d7e25234223f4d1dc24c57 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:56:01 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:01.376850807Z" level=info msg="ignoring event" container=0b8591a59ea54e24c10a24f04c00c6966cb6c0087d09a37a6e7f19ca4b0e9d51 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:56:16 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:16.960115488Z" level=info msg="ignoring event" container=17773d9deb0280e8c2850e43a2402688956495b48f1aa65ba387b9d2dbc7b248 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:56:19 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:19.524390435Z" level=info msg="ignoring event" container=61865bdde13c71710a12276bc9f9554770bcd8b32442315291ba760483293efb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:56:20 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:20.579784362Z" level=info msg="ignoring event" container=d8da2135871bf6c2d8d3c00a59570a25f3abce0ba6b8b35f6497b06cb4dfe67e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:56:32 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:32.830825582Z" level=info msg="ignoring event" container=d0cec568fd1d6396f1745065586f1d76238c4cfd114ea31769e798cca8092d8e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:56:37 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:37.946509012Z" level=info msg="ignoring event" container=d8121f56ff644c6a997725a258afe02f7dd95102f339831ffd07e41b1456a9b4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:56:45 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:45.710211658Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=c9177366fd0e9adf1faecc350d0a278b052e0bfec3658c57521bcb058030c602
	Oct 30 10:56:45 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:45.742441963Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=c9177366fd0e9adf1faecc350d0a278b052e0bfec3658c57521bcb058030c602
	Oct 30 10:56:45 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:45.792731961Z" level=info msg="ignoring event" container=c9177366fd0e9adf1faecc350d0a278b052e0bfec3658c57521bcb058030c602 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Oct 30 10:56:45 ingress-addon-legacy-405700 dockerd[1303]: time="2023-10-30T10:56:45.857958883Z" level=info msg="ignoring event" container=9ec09c9d19d1f76b053f3fcd4f4dcb5f1c2c39b612e7af6d84a196aedd101d9e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                              CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	d8121f56ff644       6896cbb783033                                                                                                      14 seconds ago       Exited              hello-world-app           2                   610200e1a79cb       hello-world-app-5f5d8b66bb-hq95t
	a93deb5dfd7c8       nginx@sha256:db353d0f0c479c91bd15e01fc68ed0f33d9c4c52f3415e63332c3d0bf7a4bb77                                      42 seconds ago       Running             nginx                     0                   0e2061dfff640       nginx
	c9177366fd0e9       registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324   59 seconds ago       Exited              controller                0                   9ec09c9d19d1f       ingress-nginx-controller-7fcf777cb7-lz5dd
	ae18e245d2519       a883f7fc35610                                                                                                      About a minute ago   Exited              patch                     1                   43462cd2e6cae       ingress-nginx-admission-patch-r6ktw
	6394085089d47       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              create                    0                   cfa73bb943f02       ingress-nginx-admission-create-mcrrs
	16b5eca93d9be       gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944    About a minute ago   Running             storage-provisioner       0                   216a983acda43       storage-provisioner
	10e79741d6a98       6e17ba78cf3eb                                                                                                      About a minute ago   Running             coredns                   0                   0354f2b106b5b       coredns-66bff467f8-td2vl
	41f9c45b586ea       565297bc6f7d4                                                                                                      About a minute ago   Running             kube-proxy                0                   5129d04a0b569       kube-proxy-ctbxt
	dd4358e2a0a9c       095f37015706d                                                                                                      About a minute ago   Running             kube-scheduler            0                   d5fa54307b7f6       kube-scheduler-ingress-addon-legacy-405700
	306ecda8a71d6       ab707b0a0ea33                                                                                                      About a minute ago   Running             etcd                      0                   355ac84a5dc4c       etcd-ingress-addon-legacy-405700
	79e9e1fb3daef       2694cf044d665                                                                                                      About a minute ago   Running             kube-apiserver            0                   561976e39927e       kube-apiserver-ingress-addon-legacy-405700
	5bbafc68280cb       68a4fac29a865                                                                                                      About a minute ago   Running             kube-controller-manager   0                   b79e608746942       kube-controller-manager-ingress-addon-legacy-405700
	
	* 
	* ==> coredns [10e79741d6a9] <==
	* [INFO] 172.17.0.1:56558 - 58077 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000038145s
	[INFO] 172.17.0.1:56558 - 33760 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032558s
	[INFO] 172.17.0.1:56558 - 39876 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032656s
	[INFO] 172.17.0.1:56558 - 58818 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000032378s
	[INFO] 172.17.0.1:56558 - 39484 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00004393s
	[INFO] 172.17.0.1:18881 - 37974 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.00004416s
	[INFO] 172.17.0.1:56558 - 32585 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001001881s
	[INFO] 172.17.0.1:56558 - 1782 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000886927s
	[INFO] 172.17.0.1:18881 - 60624 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032163s
	[INFO] 172.17.0.1:18881 - 1080 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000054802s
	[INFO] 172.17.0.1:18881 - 5153 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000028956s
	[INFO] 172.17.0.1:56558 - 28553 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000041657s
	[INFO] 172.17.0.1:18881 - 4391 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000061259s
	[INFO] 172.17.0.1:18881 - 46973 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001033889s
	[INFO] 172.17.0.1:18881 - 16302 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000824938s
	[INFO] 172.17.0.1:18881 - 24825 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000042108s
	[INFO] 172.17.0.1:31588 - 43868 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.00007405s
	[INFO] 172.17.0.1:31588 - 37218 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000074781s
	[INFO] 172.17.0.1:31588 - 33633 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000041149s
	[INFO] 172.17.0.1:31588 - 50133 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000045186s
	[INFO] 172.17.0.1:31588 - 35769 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000063647s
	[INFO] 172.17.0.1:31588 - 34961 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000066199s
	[INFO] 172.17.0.1:31588 - 13641 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001050118s
	[INFO] 172.17.0.1:31588 - 16024 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001216254s
	[INFO] 172.17.0.1:31588 - 48544 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000118309s
	
	* 
	* ==> describe nodes <==
	* Name:               ingress-addon-legacy-405700
	Roles:              master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=ingress-addon-legacy-405700
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=99c50ab9af570595672bd37bf6c89e1874e94ce6
	                    minikube.k8s.io/name=ingress-addon-legacy-405700
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_10_30T10_55_19_0700
	                    minikube.k8s.io/version=v1.32.0-beta.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 30 Oct 2023 10:55:16 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-405700
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 30 Oct 2023 10:56:42 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 30 Oct 2023 10:56:23 +0000   Mon, 30 Oct 2023 10:55:09 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 30 Oct 2023 10:56:23 +0000   Mon, 30 Oct 2023 10:55:09 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 30 Oct 2023 10:56:23 +0000   Mon, 30 Oct 2023 10:55:09 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 30 Oct 2023 10:56:23 +0000   Mon, 30 Oct 2023 10:55:32 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-405700
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022500Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022500Ki
	  pods:               110
	System Info:
	  Machine ID:                 3e144a338b6e4277877dc8cb5008321c
	  System UUID:                6a57e0d5-3fe1-4737-88bd-23ed79bd7d51
	  Boot ID:                    9c87d0b1-da45-47b6-b0d3-2db75e0c20f8
	  Kernel Version:             5.15.0-1048-aws
	  OS Image:                   Ubuntu 22.04.3 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.7
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-hq95t                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         35s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         46s
	  kube-system                 coredns-66bff467f8-td2vl                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     77s
	  kube-system                 etcd-ingress-addon-legacy-405700                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 kube-apiserver-ingress-addon-legacy-405700             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-405700    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 kube-proxy-ctbxt                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         77s
	  kube-system                 kube-scheduler-ingress-addon-legacy-405700             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         76s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)
	  memory             70Mi (0%!)(MISSING)   170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From        Message
	  ----    ------                   ----                 ----        -------
	  Normal  NodeHasSufficientMemory  103s (x4 over 103s)  kubelet     Node ingress-addon-legacy-405700 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    103s (x5 over 103s)  kubelet     Node ingress-addon-legacy-405700 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     103s (x4 over 103s)  kubelet     Node ingress-addon-legacy-405700 status is now: NodeHasSufficientPID
	  Normal  Starting                 89s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  89s                  kubelet     Node ingress-addon-legacy-405700 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    89s                  kubelet     Node ingress-addon-legacy-405700 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     89s                  kubelet     Node ingress-addon-legacy-405700 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             89s                  kubelet     Node ingress-addon-legacy-405700 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  89s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                79s                  kubelet     Node ingress-addon-legacy-405700 status is now: NodeReady
	  Normal  Starting                 76s                  kube-proxy  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +0.001081] FS-Cache: O-key=[8] '0c823b0000000000'
	[  +0.000748] FS-Cache: N-cookie c=00000197 [p=0000018e fl=2 nc=0 na=1]
	[  +0.000997] FS-Cache: N-cookie d=00000000a542e93b{9p.inode} n=00000000b42dcaca
	[  +0.001067] FS-Cache: N-key=[8] '0c823b0000000000'
	[  +0.005828] FS-Cache: Duplicate cookie detected
	[  +0.000705] FS-Cache: O-cookie c=00000191 [p=0000018e fl=226 nc=0 na=1]
	[  +0.000982] FS-Cache: O-cookie d=00000000a542e93b{9p.inode} n=000000008ba7df03
	[  +0.001131] FS-Cache: O-key=[8] '0c823b0000000000'
	[  +0.000753] FS-Cache: N-cookie c=00000198 [p=0000018e fl=2 nc=0 na=1]
	[  +0.000967] FS-Cache: N-cookie d=00000000a542e93b{9p.inode} n=00000000094a4336
	[  +0.001081] FS-Cache: N-key=[8] '0c823b0000000000'
	[  +2.051402] FS-Cache: Duplicate cookie detected
	[  +0.000733] FS-Cache: O-cookie c=0000018f [p=0000018e fl=226 nc=0 na=1]
	[  +0.001054] FS-Cache: O-cookie d=00000000a542e93b{9p.inode} n=000000001c6b883c
	[  +0.001078] FS-Cache: O-key=[8] '0b823b0000000000'
	[  +0.000717] FS-Cache: N-cookie c=0000019a [p=0000018e fl=2 nc=0 na=1]
	[  +0.000968] FS-Cache: N-cookie d=00000000a542e93b{9p.inode} n=00000000b42dcaca
	[  +0.001073] FS-Cache: N-key=[8] '0b823b0000000000'
	[  +0.534116] FS-Cache: Duplicate cookie detected
	[  +0.000747] FS-Cache: O-cookie c=00000194 [p=0000018e fl=226 nc=0 na=1]
	[  +0.001015] FS-Cache: O-cookie d=00000000a542e93b{9p.inode} n=000000009a36e0fc
	[  +0.001082] FS-Cache: O-key=[8] '14823b0000000000'
	[  +0.000726] FS-Cache: N-cookie c=0000019b [p=0000018e fl=2 nc=0 na=1]
	[  +0.000976] FS-Cache: N-cookie d=00000000a542e93b{9p.inode} n=00000000479f2ec4
	[  +0.001078] FS-Cache: N-key=[8] '14823b0000000000'
	
	* 
	* ==> etcd [306ecda8a71d] <==
	* raft2023/10/30 10:55:10 INFO: aec36adc501070cc became follower at term 0
	raft2023/10/30 10:55:10 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	raft2023/10/30 10:55:10 INFO: aec36adc501070cc became follower at term 1
	raft2023/10/30 10:55:10 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-10-30 10:55:11.002078 W | auth: simple token is not cryptographically signed
	2023-10-30 10:55:11.094287 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	2023-10-30 10:55:11.662035 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	raft2023/10/30 10:55:11 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-10-30 10:55:11.789807 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2023-10-30 10:55:11.809694 I | embed: listening for peers on 192.168.49.2:2380
	2023-10-30 10:55:11.817829 I | embed: listening for metrics on http://127.0.0.1:2381
	2023-10-30 10:55:11.841837 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	raft2023/10/30 10:55:11 INFO: aec36adc501070cc is starting a new election at term 1
	raft2023/10/30 10:55:11 INFO: aec36adc501070cc became candidate at term 2
	raft2023/10/30 10:55:11 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2023/10/30 10:55:11 INFO: aec36adc501070cc became leader at term 2
	raft2023/10/30 10:55:11 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2023-10-30 10:55:11.910734 I | etcdserver: published {Name:ingress-addon-legacy-405700 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2023-10-30 10:55:11.911142 I | embed: ready to serve client requests
	2023-10-30 10:55:11.912837 I | embed: serving client requests on 127.0.0.1:2379
	2023-10-30 10:55:11.913065 I | etcdserver: setting up the initial cluster version to 3.4
	2023-10-30 10:55:11.919116 I | embed: ready to serve client requests
	2023-10-30 10:55:11.925485 N | etcdserver/membership: set the initial cluster version to 3.4
	2023-10-30 10:55:11.925818 I | etcdserver/api: enabled capabilities for version 3.4
	2023-10-30 10:55:11.927928 I | embed: serving client requests on 192.168.49.2:2379
	
	* 
	* ==> kernel <==
	*  10:56:51 up 1 day, 19:39,  0 users,  load average: 1.15, 2.12, 1.80
	Linux ingress-addon-legacy-405700 5.15.0-1048-aws #53~20.04.1-Ubuntu SMP Wed Oct 4 16:51:38 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.3 LTS"
	
	* 
	* ==> kube-apiserver [79e9e1fb3dae] <==
	* I1030 10:55:16.139369       1 nonstructuralschema_controller.go:186] Starting NonStructuralSchemaConditionController
	I1030 10:55:16.139384       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
	I1030 10:55:16.222561       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I1030 10:55:16.222684       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I1030 10:55:16.244984       1 cache.go:39] Caches are synced for autoregister controller
	I1030 10:55:16.245915       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I1030 10:55:16.252177       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I1030 10:55:17.042390       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I1030 10:55:17.042432       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I1030 10:55:17.050926       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I1030 10:55:17.055500       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I1030 10:55:17.055524       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I1030 10:55:17.492451       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I1030 10:55:17.532556       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W1030 10:55:17.611081       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I1030 10:55:17.612237       1 controller.go:609] quota admission added evaluator for: endpoints
	I1030 10:55:17.616168       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I1030 10:55:17.999449       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I1030 10:55:18.531640       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I1030 10:55:19.080441       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I1030 10:55:19.221890       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I1030 10:55:34.245454       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I1030 10:55:34.391772       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I1030 10:55:43.649572       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I1030 10:56:05.780805       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	
	* 
	* ==> kube-controller-manager [5bbafc68280c] <==
	* I1030 10:55:34.532169       1 shared_informer.go:230] Caches are synced for PV protection 
	I1030 10:55:34.577657       1 shared_informer.go:230] Caches are synced for endpoint 
	I1030 10:55:34.583805       1 shared_informer.go:230] Caches are synced for certificate-csrapproving 
	I1030 10:55:34.600535       1 shared_informer.go:230] Caches are synced for certificate-csrsigning 
	I1030 10:55:34.724881       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"6b37701b-ed67-486b-9830-4617cfeb0889", APIVersion:"apps/v1", ResourceVersion:"355", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled down replica set coredns-66bff467f8 to 1
	I1030 10:55:34.781921       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"2550cabd-d20d-444a-af8a-5fd9d5fad303", APIVersion:"apps/v1", ResourceVersion:"356", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: coredns-66bff467f8-5gmw8
	I1030 10:55:34.785839       1 shared_informer.go:230] Caches are synced for disruption 
	I1030 10:55:34.785854       1 disruption.go:339] Sending events to api server.
	I1030 10:55:34.833484       1 shared_informer.go:230] Caches are synced for stateful set 
	I1030 10:55:34.836021       1 shared_informer.go:230] Caches are synced for resource quota 
	I1030 10:55:34.838447       1 shared_informer.go:230] Caches are synced for garbage collector 
	I1030 10:55:34.838465       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I1030 10:55:34.985013       1 shared_informer.go:223] Waiting for caches to sync for resource quota
	I1030 10:55:34.985050       1 shared_informer.go:230] Caches are synced for resource quota 
	I1030 10:55:35.634378       1 shared_informer.go:223] Waiting for caches to sync for garbage collector
	I1030 10:55:35.634423       1 shared_informer.go:230] Caches are synced for garbage collector 
	I1030 10:55:43.565873       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"3b681a72-e0be-4dcc-a84d-a6ee0396c223", APIVersion:"apps/v1", ResourceVersion:"445", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I1030 10:55:43.610433       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"c55b2bd5-54e1-4d39-93fe-95f4c1a832a6", APIVersion:"apps/v1", ResourceVersion:"446", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-lz5dd
	I1030 10:55:43.710280       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"64bf363c-8ed1-4662-a230-2a6b1dd5bf3a", APIVersion:"batch/v1", ResourceVersion:"454", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-mcrrs
	I1030 10:55:43.774364       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"3318ddd6-36a9-4bbd-ad39-850ff16c9483", APIVersion:"batch/v1", ResourceVersion:"464", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-r6ktw
	I1030 10:55:47.039287       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"64bf363c-8ed1-4662-a230-2a6b1dd5bf3a", APIVersion:"batch/v1", ResourceVersion:"465", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I1030 10:55:48.061831       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"3318ddd6-36a9-4bbd-ad39-850ff16c9483", APIVersion:"batch/v1", ResourceVersion:"472", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I1030 10:56:16.543674       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"e8d9e3a9-80ab-46a7-afba-256b962f2c19", APIVersion:"apps/v1", ResourceVersion:"583", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	I1030 10:56:16.550026       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"3a165e19-02b4-4451-8140-f8630dde2525", APIVersion:"apps/v1", ResourceVersion:"584", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-hq95t
	E1030 10:56:48.387756       1 tokens_controller.go:261] error synchronizing serviceaccount ingress-nginx/default: secrets "default-token-jrvnw" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated
	
	* 
	* ==> kube-proxy [41f9c45b586e] <==
	* W1030 10:55:35.806085       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I1030 10:55:35.817507       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I1030 10:55:35.817556       1 server_others.go:186] Using iptables Proxier.
	I1030 10:55:35.817900       1 server.go:583] Version: v1.18.20
	I1030 10:55:35.818877       1 config.go:315] Starting service config controller
	I1030 10:55:35.819056       1 shared_informer.go:223] Waiting for caches to sync for service config
	I1030 10:55:35.819275       1 config.go:133] Starting endpoints config controller
	I1030 10:55:35.819368       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I1030 10:55:35.919392       1 shared_informer.go:230] Caches are synced for service config 
	I1030 10:55:35.919601       1 shared_informer.go:230] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [dd4358e2a0a9] <==
	* W1030 10:55:16.245619       1 authentication.go:298] Continuing without authentication configuration. This may treat all requests as anonymous.
	W1030 10:55:16.245625       1 authentication.go:299] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I1030 10:55:16.274430       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I1030 10:55:16.274533       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I1030 10:55:16.276865       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
	I1030 10:55:16.277783       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1030 10:55:16.277803       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1030 10:55:16.277833       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E1030 10:55:16.290587       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E1030 10:55:16.299404       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E1030 10:55:16.299509       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1030 10:55:16.300826       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E1030 10:55:16.301086       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E1030 10:55:16.301580       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E1030 10:55:16.301703       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E1030 10:55:16.301799       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E1030 10:55:16.301888       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E1030 10:55:16.301976       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E1030 10:55:16.302081       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E1030 10:55:16.303079       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E1030 10:55:17.130731       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1030 10:55:17.148733       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E1030 10:55:17.369939       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I1030 10:55:19.977988       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	E1030 10:55:34.402194       1 factory.go:503] pod kube-system/coredns-66bff467f8-td2vl is already present in the backoff queue
	
	* 
	* ==> kubelet <==
	* Oct 30 10:56:30 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:30.798318    2911 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 17773d9deb0280e8c2850e43a2402688956495b48f1aa65ba387b9d2dbc7b248
	Oct 30 10:56:30 ingress-addon-legacy-405700 kubelet[2911]: E1030 10:56:30.798938    2911 pod_workers.go:191] Error syncing pod bdc39515-5d3f-4e5c-82a9-3d9fe9be9546 ("kube-ingress-dns-minikube_kube-system(bdc39515-5d3f-4e5c-82a9-3d9fe9be9546)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with CrashLoopBackOff: "back-off 20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(bdc39515-5d3f-4e5c-82a9-3d9fe9be9546)"
	Oct 30 10:56:32 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:32.452137    2911 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-w698s" (UniqueName: "kubernetes.io/secret/bdc39515-5d3f-4e5c-82a9-3d9fe9be9546-minikube-ingress-dns-token-w698s") pod "bdc39515-5d3f-4e5c-82a9-3d9fe9be9546" (UID: "bdc39515-5d3f-4e5c-82a9-3d9fe9be9546")
	Oct 30 10:56:32 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:32.456727    2911 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdc39515-5d3f-4e5c-82a9-3d9fe9be9546-minikube-ingress-dns-token-w698s" (OuterVolumeSpecName: "minikube-ingress-dns-token-w698s") pod "bdc39515-5d3f-4e5c-82a9-3d9fe9be9546" (UID: "bdc39515-5d3f-4e5c-82a9-3d9fe9be9546"). InnerVolumeSpecName "minikube-ingress-dns-token-w698s". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Oct 30 10:56:32 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:32.552404    2911 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-w698s" (UniqueName: "kubernetes.io/secret/bdc39515-5d3f-4e5c-82a9-3d9fe9be9546-minikube-ingress-dns-token-w698s") on node "ingress-addon-legacy-405700" DevicePath ""
	Oct 30 10:56:33 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:33.552758    2911 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 17773d9deb0280e8c2850e43a2402688956495b48f1aa65ba387b9d2dbc7b248
	Oct 30 10:56:37 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:37.798248    2911 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: d8da2135871bf6c2d8d3c00a59570a25f3abce0ba6b8b35f6497b06cb4dfe67e
	Oct 30 10:56:37 ingress-addon-legacy-405700 kubelet[2911]: W1030 10:56:37.976610    2911 container.go:412] Failed to create summary reader for "/kubepods/besteffort/podb93d10fb-db38-487c-8b03-eddaedf3110e/d8121f56ff644c6a997725a258afe02f7dd95102f339831ffd07e41b1456a9b4": none of the resources are being tracked.
	Oct 30 10:56:38 ingress-addon-legacy-405700 kubelet[2911]: W1030 10:56:38.591763    2911 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-hq95t through plugin: invalid network status for
	Oct 30 10:56:38 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:38.597305    2911 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: d8da2135871bf6c2d8d3c00a59570a25f3abce0ba6b8b35f6497b06cb4dfe67e
	Oct 30 10:56:38 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:38.598127    2911 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: d8121f56ff644c6a997725a258afe02f7dd95102f339831ffd07e41b1456a9b4
	Oct 30 10:56:38 ingress-addon-legacy-405700 kubelet[2911]: E1030 10:56:38.598586    2911 pod_workers.go:191] Error syncing pod b93d10fb-db38-487c-8b03-eddaedf3110e ("hello-world-app-5f5d8b66bb-hq95t_default(b93d10fb-db38-487c-8b03-eddaedf3110e)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-hq95t_default(b93d10fb-db38-487c-8b03-eddaedf3110e)"
	Oct 30 10:56:39 ingress-addon-legacy-405700 kubelet[2911]: W1030 10:56:39.605941    2911 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-hq95t through plugin: invalid network status for
	Oct 30 10:56:43 ingress-addon-legacy-405700 kubelet[2911]: E1030 10:56:43.682817    2911 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-lz5dd.1792dd5da14cc714", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-lz5dd", UID:"dd29018f-e294-41f3-93c3-80f1b91ed682", APIVersion:"v1", ResourceVersion:"450", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-405700"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc14800dae8875914, ext:84655250852, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc14800dae8875914, ext:84655250852, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-lz5dd.1792dd5da14cc714" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Oct 30 10:56:43 ingress-addon-legacy-405700 kubelet[2911]: E1030 10:56:43.697813    2911 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-lz5dd.1792dd5da14cc714", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-lz5dd", UID:"dd29018f-e294-41f3-93c3-80f1b91ed682", APIVersion:"v1", ResourceVersion:"450", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-405700"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc14800dae8875914, ext:84655250852, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc14800dae9058e9a, ext:84663522082, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-lz5dd.1792dd5da14cc714" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Oct 30 10:56:46 ingress-addon-legacy-405700 kubelet[2911]: W1030 10:56:46.661193    2911 pod_container_deletor.go:77] Container "9ec09c9d19d1f76b053f3fcd4f4dcb5f1c2c39b612e7af6d84a196aedd101d9e" not found in pod's containers
	Oct 30 10:56:47 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:47.783548    2911 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/dd29018f-e294-41f3-93c3-80f1b91ed682-webhook-cert") pod "dd29018f-e294-41f3-93c3-80f1b91ed682" (UID: "dd29018f-e294-41f3-93c3-80f1b91ed682")
	Oct 30 10:56:47 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:47.783596    2911 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-zj78r" (UniqueName: "kubernetes.io/secret/dd29018f-e294-41f3-93c3-80f1b91ed682-ingress-nginx-token-zj78r") pod "dd29018f-e294-41f3-93c3-80f1b91ed682" (UID: "dd29018f-e294-41f3-93c3-80f1b91ed682")
	Oct 30 10:56:47 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:47.789834    2911 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd29018f-e294-41f3-93c3-80f1b91ed682-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dd29018f-e294-41f3-93c3-80f1b91ed682" (UID: "dd29018f-e294-41f3-93c3-80f1b91ed682"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Oct 30 10:56:47 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:47.790752    2911 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd29018f-e294-41f3-93c3-80f1b91ed682-ingress-nginx-token-zj78r" (OuterVolumeSpecName: "ingress-nginx-token-zj78r") pod "dd29018f-e294-41f3-93c3-80f1b91ed682" (UID: "dd29018f-e294-41f3-93c3-80f1b91ed682"). InnerVolumeSpecName "ingress-nginx-token-zj78r". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Oct 30 10:56:47 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:47.883869    2911 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/dd29018f-e294-41f3-93c3-80f1b91ed682-webhook-cert") on node "ingress-addon-legacy-405700" DevicePath ""
	Oct 30 10:56:47 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:47.883921    2911 reconciler.go:319] Volume detached for volume "ingress-nginx-token-zj78r" (UniqueName: "kubernetes.io/secret/dd29018f-e294-41f3-93c3-80f1b91ed682-ingress-nginx-token-zj78r") on node "ingress-addon-legacy-405700" DevicePath ""
	Oct 30 10:56:48 ingress-addon-legacy-405700 kubelet[2911]: W1030 10:56:48.812455    2911 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/dd29018f-e294-41f3-93c3-80f1b91ed682/volumes" does not exist
	Oct 30 10:56:50 ingress-addon-legacy-405700 kubelet[2911]: I1030 10:56:50.806227    2911 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: d8121f56ff644c6a997725a258afe02f7dd95102f339831ffd07e41b1456a9b4
	Oct 30 10:56:50 ingress-addon-legacy-405700 kubelet[2911]: E1030 10:56:50.807157    2911 pod_workers.go:191] Error syncing pod b93d10fb-db38-487c-8b03-eddaedf3110e ("hello-world-app-5f5d8b66bb-hq95t_default(b93d10fb-db38-487c-8b03-eddaedf3110e)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-hq95t_default(b93d10fb-db38-487c-8b03-eddaedf3110e)"
	
	* 
	* ==> storage-provisioner [16b5eca93d9b] <==
	* I1030 10:55:37.545357       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1030 10:55:37.557710       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1030 10:55:37.557908       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1030 10:55:37.565547       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1030 10:55:37.565886       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-405700_cb61bf8d-e63d-4332-868e-9f4caaac8b3f!
	I1030 10:55:37.566115       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b48c84ee-c612-4613-aa9f-25d83c109e17", APIVersion:"v1", ResourceVersion:"400", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-405700_cb61bf8d-e63d-4332-868e-9f4caaac8b3f became leader
	I1030 10:55:37.666272       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-405700_cb61bf8d-e63d-4332-868e-9f4caaac8b3f!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-405700 -n ingress-addon-legacy-405700
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-405700 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (58.36s)

                                                
                                    
x
+
TestMissingContainerUpgrade (418.15s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:322: (dbg) Run:  /tmp/minikube-v1.17.0.866839466.exe start -p missing-upgrade-410110 --memory=2200 --driver=docker  --container-runtime=docker
version_upgrade_test.go:322: (dbg) Non-zero exit: /tmp/minikube-v1.17.0.866839466.exe start -p missing-upgrade-410110 --memory=2200 --driver=docker  --container-runtime=docker: exit status 80 (17.444115714s)

                                                
                                                
-- stdout --
	* [missing-upgrade-410110] minikube v1.17.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17523
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	* Starting control plane node missing-upgrade-410110 in cluster missing-upgrade-410110
	* Downloading Kubernetes v1.20.2 preload ...
	* Creating docker container (CPUs=2, Memory=2200MB) ...| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	    > preloaded-images-k8s-v8-v1....: 7.36 MiB / 514.92 MiB [>__] 1.43% ? p/s ?    > preloaded-images-k8s-v8-v1....: 16.58 MiB / 514.92 MiB [>_] 3.22% ? p/s ?    > preloaded-images-k8s-v8-v1....: 26.12 MiB / 514.92 MiB [>_] 5.07% ? p/s ?    > preloaded-images-k8s-v8-v1....: 38.52 MiB / 514.92 MiB  7.48% 51.93 MiB p    > preloaded-images-k8s-v8-v1....: 48.00 MiB / 514.92 MiB  9.32% 51.93 MiB p    > preloaded-images-k8s-v8-v1....: 48.00 MiB / 514.92 MiB  9.32% 51.93 MiB p    > preloaded-images-k8s-v8-v1....: 48.00 MiB / 514.92 MiB  9.32% 49.60 MiB p    > preloaded-images-k8s-v8-v1....: 48.00 MiB / 514.92 MiB  9.32% 49.60 MiB p    > preloaded-images-k8s-v8-v1....: 54.45 MiB / 514.92 MiB  10.58% 49.60 MiB     > preloaded-images-k8s-v8-v1....: 65.72 MiB / 514.92 MiB  12.76% 48.30 MiB     > preloaded-images-k8s-v8-v1....: 80.20 MiB / 514.92 MiB  15.58% 48.30 MiB     > preloaded-images-k8s-v8-v1....: 93.66 MiB / 514.92 MiB  18.19% 48.30 MiB     > preloaded-images-k8s-v8-v1....: 104.30 MiB / 514.92 MiB  20.2
5% 49.34 MiB    > preloaded-images-k8s-v8-v1....: 115.76 MiB / 514.92 MiB  22.48% 49.34 MiB    > preloaded-images-k8s-v8-v1....: 128.00 MiB / 514.92 MiB  24.86% 49.34 MiB    > preloaded-images-k8s-v8-v1....: 139.19 MiB / 514.92 MiB  27.03% 49.90 MiB    > preloaded-images-k8s-v8-v1....: 151.23 MiB / 514.92 MiB  29.37% 49.90 MiB    > preloaded-images-k8s-v8-v1....: 158.78 MiB / 514.92 MiB  30.84% 49.90 MiB    > preloaded-images-k8s-v8-v1....: 172.25 MiB / 514.92 MiB  33.45% 50.24 MiB    > preloaded-images-k8s-v8-v1....: 184.97 MiB / 514.92 MiB  35.92% 50.24 MiB    > preloaded-images-k8s-v8-v1....: 197.70 MiB / 514.92 MiB  38.39% 50.24 MiB    > preloaded-images-k8s-v8-v1....: 208.73 MiB / 514.92 MiB  40.54% 50.92 MiB    > preloaded-images-k8s-v8-v1....: 225.08 MiB / 514.92 MiB  43.71% 50.92 MiB    > preloaded-images-k8s-v8-v1....: 238.30 MiB / 514.92 MiB  46.28% 50.92 MiB    > preloaded-images-k8s-v8-v1....: 252.39 MiB / 514.92 MiB  49.01% 52.33 MiB    > preloaded-images-k8s-v8-v1....: 266.81 MiB / 514.92 MiB  5
1.82% 52.33 MiB    > preloaded-images-k8s-v8-v1....: 282.30 MiB / 514.92 MiB  54.82% 52.33 MiB    > preloaded-images-k8s-v8-v1....: 296.31 MiB / 514.92 MiB  57.55% 53.68 MiB    > preloaded-images-k8s-v8-v1....: 310.62 MiB / 514.92 MiB  60.32% 53.68 MiB    > preloaded-images-k8s-v8-v1....: 321.21 MiB / 514.92 MiB  62.38% 53.68 MiB    > preloaded-images-k8s-v8-v1....: 334.35 MiB / 514.92 MiB  64.93% 54.30 MiB    > preloaded-images-k8s-v8-v1....: 347.07 MiB / 514.92 MiB  67.40% 54.30 MiB    > preloaded-images-k8s-v8-v1....: 359.78 MiB / 514.92 MiB  69.87% 54.30 MiB    > preloaded-images-k8s-v8-v1....: 374.41 MiB / 514.92 MiB  72.71% 55.11 MiB    > preloaded-images-k8s-v8-v1....: 387.47 MiB / 514.92 MiB  75.25% 55.11 MiB    > preloaded-images-k8s-v8-v1....: 400.00 MiB / 514.92 MiB  77.68% 55.11 MiB    > preloaded-images-k8s-v8-v1....: 413.52 MiB / 514.92 MiB  80.31% 55.76 MiB    > preloaded-images-k8s-v8-v1....: 429.27 MiB / 514.92 MiB  83.37% 55.76 MiB    > preloaded-images-k8s-v8-v1....: 442.56 MiB / 514.92 MiB
85.95% 55.76 MiB    > preloaded-images-k8s-v8-v1....: 456.14 MiB / 514.92 MiB  88.58% 56.74 MiB    > preloaded-images-k8s-v8-v1....: 469.69 MiB / 514.92 MiB  91.21% 56.74 MiB    > preloaded-images-k8s-v8-v1....: 480.80 MiB / 514.92 MiB  93.37% 56.74 MiB    > preloaded-images-k8s-v8-v1....: 495.29 MiB / 514.92 MiB  96.19% 57.29 MiB    > preloaded-images-k8s-v8-v1....: 501.36 MiB / 514.92 MiB  97.37% 57.29 MiB    > preloaded-images-k8s-v8-v1....: 513.38 MiB / 514.92 MiB  99.70% 57.29 MiB    > preloaded-images-k8s-v8-v1....: 514.92 MiB / 514.92 MiB  100.00% 58.43 MiX Exiting due to GUEST_PROVISION: Failed to start host: can't create with that IP, address already in use
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:322: (dbg) Run:  /tmp/minikube-v1.17.0.866839466.exe start -p missing-upgrade-410110 --memory=2200 --driver=docker  --container-runtime=docker
version_upgrade_test.go:322: (dbg) Non-zero exit: /tmp/minikube-v1.17.0.866839466.exe start -p missing-upgrade-410110 --memory=2200 --driver=docker  --container-runtime=docker: exit status 80 (3m12.253210045s)

                                                
                                                
-- stdout --
	* [missing-upgrade-410110] minikube v1.17.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17523
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	* Starting control plane node missing-upgrade-410110 in cluster missing-upgrade-410110
	* docker "missing-upgrade-410110" container is missing, will recreate.
	* Creating docker container (CPUs=2, Memory=2200MB) ...| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW
/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_PROVISION: Failed to start host: can't create with that IP, address already in use
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
E1030 11:26:35.567077 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
version_upgrade_test.go:322: (dbg) Run:  /tmp/minikube-v1.17.0.866839466.exe start -p missing-upgrade-410110 --memory=2200 --driver=docker  --container-runtime=docker
E1030 11:27:03.250587 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
version_upgrade_test.go:322: (dbg) Non-zero exit: /tmp/minikube-v1.17.0.866839466.exe start -p missing-upgrade-410110 --memory=2200 --driver=docker  --container-runtime=docker: exit status 80 (3m22.913305064s)

                                                
                                                
-- stdout --
	* [missing-upgrade-410110] minikube v1.17.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17523
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	* Starting control plane node missing-upgrade-410110 in cluster missing-upgrade-410110
	* Downloading Kubernetes v1.20.2 preload ...
	* docker "missing-upgrade-410110" container is missing, will recreate.
	* Creating docker container (CPUs=2, Memory=2200MB) ...| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW| WW
/ WW- WW\ WW| WW/ WW- WW\ WW| WW/ WW- WW\ WW
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	    > preloaded-images-k8s-v8-v1....: 7.96 MiB / 514.92 MiB [>__] 1.55% ? p/s ?    > preloaded-images-k8s-v8-v1....: 16.00 MiB / 514.92 MiB [>_] 3.11% ? p/s ?    > preloaded-images-k8s-v8-v1....: 24.91 MiB / 514.92 MiB [>_] 4.84% ? p/s ?    > preloaded-images-k8s-v8-v1....: 38.48 MiB / 514.92 MiB  7.47% 50.86 MiB p    > preloaded-images-k8s-v8-v1....: 40.00 MiB / 514.92 MiB  7.77% 50.86 MiB p    > preloaded-images-k8s-v8-v1....: 52.49 MiB / 514.92 MiB  10.19% 50.86 MiB     > preloaded-images-k8s-v8-v1....: 65.64 MiB / 514.92 MiB  12.75% 50.50 MiB     > preloaded-images-k8s-v8-v1....: 80.00 MiB / 514.92 MiB  15.54% 50.50 MiB     > preloaded-images-k8s-v8-v1....: 89.11 MiB / 514.92 MiB  17.31% 50.50 MiB     > preloaded-images-k8s-v8-v1....: 104.00 MiB / 514.92 MiB  20.20% 51.37 MiB    > preloaded-images-k8s-v8-v1....: 112.61 MiB / 514.92 MiB  21.87% 51.37 MiB    > preloaded-images-k8s-v8-v1....: 126.29 MiB / 514.92 MiB  24.53% 51.37 MiB    > preloaded-images-k8s-v8-v1....: 141.28 MiB / 514.92 MiB  27.4
4% 52.06 MiB    > preloaded-images-k8s-v8-v1....: 155.52 MiB / 514.92 MiB  30.20% 52.06 MiB    > preloaded-images-k8s-v8-v1....: 161.42 MiB / 514.92 MiB  31.35% 52.06 MiB    > preloaded-images-k8s-v8-v1....: 175.97 MiB / 514.92 MiB  34.17% 52.43 MiB    > preloaded-images-k8s-v8-v1....: 191.72 MiB / 514.92 MiB  37.23% 52.43 MiB    > preloaded-images-k8s-v8-v1....: 200.00 MiB / 514.92 MiB  38.84% 52.43 MiB    > preloaded-images-k8s-v8-v1....: 216.64 MiB / 514.92 MiB  42.07% 53.42 MiB    > preloaded-images-k8s-v8-v1....: 229.36 MiB / 514.92 MiB  44.54% 53.42 MiB    > preloaded-images-k8s-v8-v1....: 245.27 MiB / 514.92 MiB  47.63% 53.42 MiB    > preloaded-images-k8s-v8-v1....: 258.90 MiB / 514.92 MiB  50.28% 54.52 MiB    > preloaded-images-k8s-v8-v1....: 272.48 MiB / 514.92 MiB  52.92% 54.52 MiB    > preloaded-images-k8s-v8-v1....: 281.55 MiB / 514.92 MiB  54.68% 54.52 MiB    > preloaded-images-k8s-v8-v1....: 294.59 MiB / 514.92 MiB  57.21% 54.84 MiB    > preloaded-images-k8s-v8-v1....: 309.94 MiB / 514.92 MiB  6
0.19% 54.84 MiB    > preloaded-images-k8s-v8-v1....: 321.94 MiB / 514.92 MiB  62.52% 54.84 MiB    > preloaded-images-k8s-v8-v1....: 336.33 MiB / 514.92 MiB  65.32% 55.79 MiB    > preloaded-images-k8s-v8-v1....: 346.91 MiB / 514.92 MiB  67.37% 55.79 MiB    > preloaded-images-k8s-v8-v1....: 357.90 MiB / 514.92 MiB  69.51% 55.79 MiB    > preloaded-images-k8s-v8-v1....: 371.41 MiB / 514.92 MiB  72.13% 55.96 MiB    > preloaded-images-k8s-v8-v1....: 384.00 MiB / 514.92 MiB  74.57% 55.96 MiB    > preloaded-images-k8s-v8-v1....: 393.11 MiB / 514.92 MiB  76.34% 55.96 MiB    > preloaded-images-k8s-v8-v1....: 404.62 MiB / 514.92 MiB  78.58% 55.92 MiB    > preloaded-images-k8s-v8-v1....: 416.19 MiB / 514.92 MiB  80.83% 55.92 MiB    > preloaded-images-k8s-v8-v1....: 431.25 MiB / 514.92 MiB  83.75% 55.92 MiB    > preloaded-images-k8s-v8-v1....: 446.75 MiB / 514.92 MiB  86.76% 56.85 MiB    > preloaded-images-k8s-v8-v1....: 456.14 MiB / 514.92 MiB  88.58% 56.85 MiB    > preloaded-images-k8s-v8-v1....: 472.48 MiB / 514.92 MiB
91.76% 56.85 MiB    > preloaded-images-k8s-v8-v1....: 486.67 MiB / 514.92 MiB  94.51% 57.47 MiB    > preloaded-images-k8s-v8-v1....: 502.39 MiB / 514.92 MiB  97.57% 57.47 MiB    > preloaded-images-k8s-v8-v1....: 514.92 MiB / 514.92 MiB  100.00% 62.95 MiX Exiting due to GUEST_PROVISION: Failed to start host: can't create with that IP, address already in use
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:328: release start failed: exit status 80
panic.go:523: *** TestMissingContainerUpgrade FAILED at 2023-10-30 11:29:59.532297348 +0000 UTC m=+2730.947082880
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestMissingContainerUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect missing-upgrade-410110
helpers_test.go:235: (dbg) docker inspect missing-upgrade-410110:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "73d77f5d25111680113f2bf71077bff10980e909c80902fc51e19176ec18f2d9",
	        "Created": "2023-10-30T11:29:52.282342544Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "created",
	            "Running": false,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 0,
	            "ExitCode": 128,
	            "Error": "Address already in use",
	            "StartedAt": "0001-01-01T00:00:00Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:9b79b8263a5873a7b57b8bb7698df1f71e90108b3174dea92dc6c576c0a9dbf9",
	        "ResolvConfPath": "",
	        "HostnamePath": "",
	        "HostsPath": "",
	        "LogPath": "",
	        "Name": "/missing-upgrade-410110",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "missing-upgrade-410110:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "missing-upgrade-410110",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 2306867200,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/5272cee64d9b03bf281bc6682a2ea7750dce6ca2e6406b7e410763a84ce43381-init/diff:/var/lib/docker/overlay2/10331d6dfabd71874abf66cdda018b6ebfbbe1e307e38fec33104ea5650f17f1/diff:/var/lib/docker/overlay2/9a27fbc21630de5fc1f5888d3609d0d531ad55bdc9c1b3367be41648e449082e/diff:/var/lib/docker/overlay2/1c4fd034279dbf979991c505d14c48b55e33f7ba0790f62f249df7c87516ade4/diff:/var/lib/docker/overlay2/2b2b139cd618d233a94f233308f94d93eebe974fc50cb38b4109963708e152e8/diff:/var/lib/docker/overlay2/f24d99619c879d416eec48d683b10f5c4859f4677313eba5cc9c3d9f96185000/diff:/var/lib/docker/overlay2/7ba10b46a2f6c87089c473fe6fe92ef222af5d6737702d24401655d1a8c91071/diff:/var/lib/docker/overlay2/53fc6a25c73d5cfeadfec225295f2422191b73e4cbc20e3426bdf8afe2151c1d/diff:/var/lib/docker/overlay2/f650e4d244a0c07bd5e32dccd6338c0f4563833ddafe4e473d25d5a30a155b0d/diff:/var/lib/docker/overlay2/fcca69191e0863c350559fdbcdfd091f1cd61b9e5ee95b9991bca65377b1bb8e/diff:/var/lib/docker/overlay2/2d6109
3c9d62e0349f7434e038b2d0bb2a619556f4241a45aa3c7d053f6f32d8/diff:/var/lib/docker/overlay2/e8fafe1838c7bae0d4778027e0ac9630da943d67ae7dd1f15fcdb275bea057a4/diff:/var/lib/docker/overlay2/346f2b2f1bc39f81cdcbe1ed5566959dfede83c6780da4a48e80d8c66c87a015/diff:/var/lib/docker/overlay2/890459ddd1edb956f3a83bdbcd0fefd894abecf2a38f6d378dbbadbf4c61d9a7/diff:/var/lib/docker/overlay2/e594719ea05c13f09e4e9277638f0bd1ab7f83514a91662992489ad0cb569c14/diff:/var/lib/docker/overlay2/feeedd7edca76d9054c30de736f1362ed91a7887c360c515dfde2a8714d99213/diff:/var/lib/docker/overlay2/5938555345c48be3c4894c009e64c39703a4c3610be4aa85bd23f2ee7c66bebf/diff:/var/lib/docker/overlay2/706d46d3e770972a61f04fdd0661728654e92b1ee4024347e05e0d132ec2c533/diff:/var/lib/docker/overlay2/99eb57d43bb0c15723eb62192dba9a79f02e53901a9e7f781aa72a07d1cfd9a2/diff:/var/lib/docker/overlay2/b6a73a0590f4151163024b5b08f692c95359740ea2e06838dd539e088f79a88d/diff:/var/lib/docker/overlay2/66f71757cd896588ace100fba4de906381ff22666c21c3f9c4abfb65b10a3d74/diff:/var/lib/d
ocker/overlay2/dfe9d4e457a871328cb883ebade4d3af2d0d1dcb72ba65f6859f96b5de1341c8/diff:/var/lib/docker/overlay2/f2e151ca8dc43776fb73e5f58ff96ddcb0cd11a0eea9d2bbcce4f768e0c9d048/diff:/var/lib/docker/overlay2/7cf3f4d4dae45aa1988cb3e1a0957bd909a1dc0a39b45271f3c142554fac131c/diff:/var/lib/docker/overlay2/5733ad64f7c7f9efc4cc6960b47ca20cf519153b3964c29a2cd95d1a9c3a0a6d/diff:/var/lib/docker/overlay2/a050f562e25936cfbc9d0e683e136992e41aa2e5a2600b3cb97ccb263d83e93e/diff:/var/lib/docker/overlay2/92c705392f93c316ef2bad74f8b68e0c78e16108cbe74121e372715bd800412b/diff:/var/lib/docker/overlay2/26274d2cca93ae6e4ce6132e08f6c2d73833bee53b0cdd6bc592e39b2b08575f/diff:/var/lib/docker/overlay2/53f61cea292091109ef2b20e5fad71fc1cb7ced0c531db1555f11fbb15333b03/diff:/var/lib/docker/overlay2/55e263609a2f67166870a83237407e1cf0567b2431f70386bc28623ec1a3d824/diff:/var/lib/docker/overlay2/ae52d50035462b5a19272836ed9b41371e546366f601eb7cf722462c59ea342a/diff:/var/lib/docker/overlay2/37de182332078372a5b4089ea04299d90792dafe5b46dc8cd012f071a21
b8baf/diff:/var/lib/docker/overlay2/bc045fd261c0492c894704f6047284d1306212cfeb086925a884b434d999a720/diff:/var/lib/docker/overlay2/1a8c119e0f4c4570d25e82533011e23b5c1d93273d1ac32355591211e5443ed4/diff:/var/lib/docker/overlay2/de9b5cae92aebd746bb040b1f2d22e7ead37ed3fa20ed257dd584a10ae8fbb5f/diff",
	                "MergedDir": "/var/lib/docker/overlay2/5272cee64d9b03bf281bc6682a2ea7750dce6ca2e6406b7e410763a84ce43381/merged",
	                "UpperDir": "/var/lib/docker/overlay2/5272cee64d9b03bf281bc6682a2ea7750dce6ca2e6406b7e410763a84ce43381/diff",
	                "WorkDir": "/var/lib/docker/overlay2/5272cee64d9b03bf281bc6682a2ea7750dce6ca2e6406b7e410763a84ce43381/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "missing-upgrade-410110",
	                "Source": "/var/lib/docker/volumes/missing-upgrade-410110/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "missing-upgrade-410110",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "missing-upgrade-410110",
	                "name.minikube.sigs.k8s.io": "missing-upgrade-410110",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {},
	            "SandboxKey": "",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "missing-upgrade-410110": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.70.255"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "73d77f5d2511",
	                        "missing-upgrade-410110"
	                    ],
	                    "NetworkID": "",
	                    "EndpointID": "",
	                    "Gateway": "",
	                    "IPAddress": "",
	                    "IPPrefixLen": 0,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p missing-upgrade-410110 -n missing-upgrade-410110
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p missing-upgrade-410110 -n missing-upgrade-410110: exit status 7 (93.329395ms)

                                                
                                                
-- stdout --
	Nonexistent

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "missing-upgrade-410110" host is not running, skipping log retrieval (state="Nonexistent")
helpers_test.go:175: Cleaning up "missing-upgrade-410110" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-410110
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-410110: (1.358690659s)
--- FAIL: TestMissingContainerUpgrade (418.15s)

                                                
                                    

Test pass (296/323)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 8.06
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.09
10 TestDownloadOnly/v1.28.3/json-events 7.16
11 TestDownloadOnly/v1.28.3/preload-exists 0
15 TestDownloadOnly/v1.28.3/LogsDuration 0.09
16 TestDownloadOnly/DeleteAll 0.24
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.16
19 TestBinaryMirror 0.62
20 TestOffline 103.16
23 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.09
24 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.09
25 TestAddons/Setup 145.47
27 TestAddons/parallel/Registry 15.5
29 TestAddons/parallel/InspektorGadget 10.91
30 TestAddons/parallel/MetricsServer 5.79
33 TestAddons/parallel/CSI 55.5
34 TestAddons/parallel/Headlamp 12.16
35 TestAddons/parallel/CloudSpanner 5.65
36 TestAddons/parallel/LocalPath 54.84
37 TestAddons/parallel/NvidiaDevicePlugin 5.57
40 TestAddons/serial/GCPAuth/Namespaces 0.2
41 TestAddons/StoppedEnableDisable 11.33
42 TestCertOptions 43.8
43 TestCertExpiration 251.26
44 TestDockerFlags 47.95
45 TestForceSystemdFlag 48.48
46 TestForceSystemdEnv 41.6
52 TestErrorSpam/setup 32.84
53 TestErrorSpam/start 0.88
54 TestErrorSpam/status 1.14
55 TestErrorSpam/pause 1.45
56 TestErrorSpam/unpause 1.59
57 TestErrorSpam/stop 2.2
60 TestFunctional/serial/CopySyncFile 0
61 TestFunctional/serial/StartWithProxy 46.72
62 TestFunctional/serial/AuditLog 0
63 TestFunctional/serial/SoftStart 39.65
64 TestFunctional/serial/KubeContext 0.06
65 TestFunctional/serial/KubectlGetPods 0.09
68 TestFunctional/serial/CacheCmd/cache/add_remote 3.09
69 TestFunctional/serial/CacheCmd/cache/add_local 1.18
70 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.09
71 TestFunctional/serial/CacheCmd/cache/list 0.07
72 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.38
73 TestFunctional/serial/CacheCmd/cache/cache_reload 1.74
74 TestFunctional/serial/CacheCmd/cache/delete 0.14
75 TestFunctional/serial/MinikubeKubectlCmd 0.17
76 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.17
77 TestFunctional/serial/ExtraConfig 38.88
78 TestFunctional/serial/ComponentHealth 0.1
79 TestFunctional/serial/LogsCmd 1.44
80 TestFunctional/serial/LogsFileCmd 1.32
81 TestFunctional/serial/InvalidService 4.89
83 TestFunctional/parallel/ConfigCmd 0.58
84 TestFunctional/parallel/DashboardCmd 9.72
85 TestFunctional/parallel/DryRun 1.02
86 TestFunctional/parallel/InternationalLanguage 0.26
87 TestFunctional/parallel/StatusCmd 1.3
91 TestFunctional/parallel/ServiceCmdConnect 10.84
92 TestFunctional/parallel/AddonsCmd 0.26
93 TestFunctional/parallel/PersistentVolumeClaim 27.11
95 TestFunctional/parallel/SSHCmd 0.78
96 TestFunctional/parallel/CpCmd 1.65
98 TestFunctional/parallel/FileSync 0.35
99 TestFunctional/parallel/CertSync 2.5
103 TestFunctional/parallel/NodeLabels 0.15
105 TestFunctional/parallel/NonActiveRuntimeDisabled 0.47
107 TestFunctional/parallel/License 0.32
109 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.68
110 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
112 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.45
113 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.1
114 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
118 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
119 TestFunctional/parallel/ServiceCmd/DeployApp 7.22
120 TestFunctional/parallel/ProfileCmd/profile_not_create 0.47
121 TestFunctional/parallel/ServiceCmd/List 0.68
122 TestFunctional/parallel/ProfileCmd/profile_list 0.53
123 TestFunctional/parallel/ServiceCmd/JSONOutput 0.7
124 TestFunctional/parallel/ProfileCmd/profile_json_output 0.54
125 TestFunctional/parallel/MountCmd/any-port 7.4
126 TestFunctional/parallel/ServiceCmd/HTTPS 0.73
127 TestFunctional/parallel/ServiceCmd/Format 0.54
128 TestFunctional/parallel/ServiceCmd/URL 0.51
129 TestFunctional/parallel/MountCmd/specific-port 2.41
130 TestFunctional/parallel/MountCmd/VerifyCleanup 3.14
131 TestFunctional/parallel/Version/short 0.1
132 TestFunctional/parallel/Version/components 1.24
133 TestFunctional/parallel/ImageCommands/ImageListShort 0.34
134 TestFunctional/parallel/ImageCommands/ImageListTable 0.31
135 TestFunctional/parallel/ImageCommands/ImageListJson 0.31
136 TestFunctional/parallel/ImageCommands/ImageListYaml 0.31
137 TestFunctional/parallel/ImageCommands/ImageBuild 2.87
138 TestFunctional/parallel/ImageCommands/Setup 2.47
139 TestFunctional/parallel/UpdateContextCmd/no_changes 0.25
140 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.28
141 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.26
142 TestFunctional/parallel/DockerEnv/bash 1.4
143 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 4.4
144 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 2.74
145 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 5.01
146 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.84
147 TestFunctional/parallel/ImageCommands/ImageRemove 0.52
148 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 1.31
149 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 1
150 TestFunctional/delete_addon-resizer_images 0.08
151 TestFunctional/delete_my-image_image 0.02
152 TestFunctional/delete_minikube_cached_images 0.02
156 TestImageBuild/serial/Setup 31.32
157 TestImageBuild/serial/NormalBuild 1.86
158 TestImageBuild/serial/BuildWithBuildArg 0.93
159 TestImageBuild/serial/BuildWithDockerIgnore 0.96
160 TestImageBuild/serial/BuildWithSpecifiedDockerfile 0.76
163 TestIngressAddonLegacy/StartLegacyK8sCluster 75.97
165 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 10.56
166 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.67
170 TestJSONOutput/start/Command 47.83
171 TestJSONOutput/start/Audit 0
173 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
174 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
176 TestJSONOutput/pause/Command 0.64
177 TestJSONOutput/pause/Audit 0
179 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
180 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
182 TestJSONOutput/unpause/Command 0.59
183 TestJSONOutput/unpause/Audit 0
185 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
186 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
188 TestJSONOutput/stop/Command 5.84
189 TestJSONOutput/stop/Audit 0
191 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
192 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
193 TestErrorJSONOutput 0.26
195 TestKicCustomNetwork/create_custom_network 32.21
196 TestKicCustomNetwork/use_default_bridge_network 39.29
197 TestKicExistingNetwork 36.22
198 TestKicCustomSubnet 34.7
199 TestKicStaticIP 37.71
200 TestMainNoArgs 0.07
201 TestMinikubeProfile 79.47
204 TestMountStart/serial/StartWithMountFirst 8.38
205 TestMountStart/serial/VerifyMountFirst 0.29
206 TestMountStart/serial/StartWithMountSecond 10.74
207 TestMountStart/serial/VerifyMountSecond 0.31
208 TestMountStart/serial/DeleteFirst 1.55
209 TestMountStart/serial/VerifyMountPostDelete 0.29
210 TestMountStart/serial/Stop 1.24
211 TestMountStart/serial/RestartStopped 8.41
212 TestMountStart/serial/VerifyMountPostStop 0.29
215 TestMultiNode/serial/FreshStart2Nodes 82.08
216 TestMultiNode/serial/DeployApp2Nodes 47.2
217 TestMultiNode/serial/PingHostFrom2Pods 1.22
218 TestMultiNode/serial/AddNode 21.66
219 TestMultiNode/serial/ProfileList 0.39
220 TestMultiNode/serial/CopyFile 11.5
221 TestMultiNode/serial/StopNode 2.4
222 TestMultiNode/serial/StartAfterStop 14.27
223 TestMultiNode/serial/RestartKeepsNodes 124.48
224 TestMultiNode/serial/DeleteNode 5.14
225 TestMultiNode/serial/StopMultiNode 21.86
226 TestMultiNode/serial/RestartMultiNode 84.58
227 TestMultiNode/serial/ValidateNameConflict 37.73
232 TestPreload 172.48
234 TestScheduledStopUnix 105.98
235 TestSkaffold 106.5
237 TestInsufficientStorage 13.9
238 TestRunningBinaryUpgrade 91.71
240 TestKubernetesUpgrade 207.31
243 TestNoKubernetes/serial/StartNoK8sWithVersion 0.12
244 TestNoKubernetes/serial/StartWithK8s 48.19
245 TestNoKubernetes/serial/StartWithStopK8s 8.38
246 TestNoKubernetes/serial/Start 10.8
247 TestNoKubernetes/serial/VerifyK8sNotRunning 0.31
248 TestNoKubernetes/serial/ProfileList 1
249 TestNoKubernetes/serial/Stop 1.26
250 TestNoKubernetes/serial/StartNoArgs 7.48
251 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.31
263 TestStoppedBinaryUpgrade/Setup 0.94
264 TestStoppedBinaryUpgrade/Upgrade 137.94
265 TestStoppedBinaryUpgrade/MinikubeLogs 1.76
274 TestPause/serial/Start 87.66
275 TestNetworkPlugins/group/auto/Start 91.13
276 TestPause/serial/SecondStartNoReconfiguration 37.3
277 TestPause/serial/Pause 1.22
278 TestPause/serial/VerifyStatus 0.6
279 TestPause/serial/Unpause 1.12
280 TestPause/serial/PauseAgain 1.18
281 TestPause/serial/DeletePaused 2.29
282 TestPause/serial/VerifyDeletedResources 0.55
283 TestNetworkPlugins/group/kindnet/Start 63.15
284 TestNetworkPlugins/group/auto/KubeletFlags 0.36
285 TestNetworkPlugins/group/auto/NetCatPod 9.41
286 TestNetworkPlugins/group/auto/DNS 0.38
287 TestNetworkPlugins/group/auto/Localhost 0.29
288 TestNetworkPlugins/group/auto/HairPin 0.31
289 TestNetworkPlugins/group/kindnet/ControllerPod 5.05
290 TestNetworkPlugins/group/kindnet/KubeletFlags 0.45
291 TestNetworkPlugins/group/kindnet/NetCatPod 15.63
292 TestNetworkPlugins/group/calico/Start 89.74
293 TestNetworkPlugins/group/kindnet/DNS 0.27
294 TestNetworkPlugins/group/kindnet/Localhost 0.25
295 TestNetworkPlugins/group/kindnet/HairPin 0.22
296 TestNetworkPlugins/group/custom-flannel/Start 70.64
297 TestNetworkPlugins/group/calico/ControllerPod 5.04
298 TestNetworkPlugins/group/calico/KubeletFlags 0.5
299 TestNetworkPlugins/group/calico/NetCatPod 11.72
300 TestNetworkPlugins/group/calico/DNS 0.3
301 TestNetworkPlugins/group/calico/Localhost 0.24
302 TestNetworkPlugins/group/calico/HairPin 0.23
303 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.41
304 TestNetworkPlugins/group/custom-flannel/NetCatPod 11.36
305 TestNetworkPlugins/group/custom-flannel/DNS 0.29
306 TestNetworkPlugins/group/custom-flannel/Localhost 0.27
307 TestNetworkPlugins/group/custom-flannel/HairPin 0.25
308 TestNetworkPlugins/group/false/Start 60.72
309 TestNetworkPlugins/group/enable-default-cni/Start 55.4
310 TestNetworkPlugins/group/false/KubeletFlags 0.35
311 TestNetworkPlugins/group/false/NetCatPod 10.37
312 TestNetworkPlugins/group/false/DNS 0.36
313 TestNetworkPlugins/group/false/Localhost 0.3
314 TestNetworkPlugins/group/false/HairPin 0.36
315 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.42
316 TestNetworkPlugins/group/enable-default-cni/NetCatPod 11.36
317 TestNetworkPlugins/group/enable-default-cni/DNS 26.77
318 TestNetworkPlugins/group/flannel/Start 68.73
319 TestNetworkPlugins/group/enable-default-cni/Localhost 0.25
320 TestNetworkPlugins/group/enable-default-cni/HairPin 0.21
321 TestNetworkPlugins/group/bridge/Start 94.5
322 TestNetworkPlugins/group/flannel/ControllerPod 5.03
323 TestNetworkPlugins/group/flannel/KubeletFlags 0.5
324 TestNetworkPlugins/group/flannel/NetCatPod 11.49
325 TestNetworkPlugins/group/flannel/DNS 0.22
326 TestNetworkPlugins/group/flannel/Localhost 0.21
327 TestNetworkPlugins/group/flannel/HairPin 0.25
328 TestNetworkPlugins/group/kubenet/Start 92.73
329 TestNetworkPlugins/group/bridge/KubeletFlags 0.43
330 TestNetworkPlugins/group/bridge/NetCatPod 12.55
331 TestNetworkPlugins/group/bridge/DNS 0.27
332 TestNetworkPlugins/group/bridge/Localhost 0.19
333 TestNetworkPlugins/group/bridge/HairPin 0.2
335 TestStartStop/group/old-k8s-version/serial/FirstStart 310.78
336 TestNetworkPlugins/group/kubenet/KubeletFlags 0.46
337 TestNetworkPlugins/group/kubenet/NetCatPod 12.62
338 TestNetworkPlugins/group/kubenet/DNS 0.22
339 TestNetworkPlugins/group/kubenet/Localhost 0.22
340 TestNetworkPlugins/group/kubenet/HairPin 0.2
342 TestStartStop/group/no-preload/serial/FirstStart 94.16
343 TestStartStop/group/no-preload/serial/DeployApp 9.51
344 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.18
345 TestStartStop/group/no-preload/serial/Stop 10.96
346 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.22
347 TestStartStop/group/no-preload/serial/SecondStart 342.87
348 TestStartStop/group/old-k8s-version/serial/DeployApp 9.49
349 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.99
350 TestStartStop/group/old-k8s-version/serial/Stop 11.01
351 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.24
352 TestStartStop/group/old-k8s-version/serial/SecondStart 432
353 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 12.03
354 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.11
355 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.45
356 TestStartStop/group/no-preload/serial/Pause 3.23
358 TestStartStop/group/embed-certs/serial/FirstStart 52.01
359 TestStartStop/group/embed-certs/serial/DeployApp 9.43
360 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.2
361 TestStartStop/group/embed-certs/serial/Stop 11.09
362 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.24
363 TestStartStop/group/embed-certs/serial/SecondStart 347.11
364 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.02
365 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.11
366 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.39
367 TestStartStop/group/old-k8s-version/serial/Pause 3.35
369 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 89.17
370 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 8.49
371 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.15
372 TestStartStop/group/default-k8s-diff-port/serial/Stop 11.06
373 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.23
374 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 345.64
375 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 12.03
376 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.11
377 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.41
378 TestStartStop/group/embed-certs/serial/Pause 3.23
380 TestStartStop/group/newest-cni/serial/FirstStart 47.68
381 TestStartStop/group/newest-cni/serial/DeployApp 0
382 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.33
383 TestStartStop/group/newest-cni/serial/Stop 9.45
384 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.24
385 TestStartStop/group/newest-cni/serial/SecondStart 33.02
386 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
387 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
388 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.41
389 TestStartStop/group/newest-cni/serial/Pause 3.45
390 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 15.03
391 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.11
392 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.37
393 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.03
x
+
TestDownloadOnly/v1.16.0/json-events (8.06s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-618370 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-618370 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker: (8.061085184s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (8.06s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.09s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-618370
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-618370: exit status 85 (87.615247ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   |    Version     |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-618370 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC |          |
	|         | -p download-only-618370        |                      |         |                |                     |          |
	|         | --force --alsologtostderr      |                      |         |                |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	|         | --driver=docker                |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	|---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/10/30 10:44:28
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.21.3 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1030 10:44:28.700810 1041126 out.go:296] Setting OutFile to fd 1 ...
	I1030 10:44:28.701071 1041126 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:44:28.701103 1041126 out.go:309] Setting ErrFile to fd 2...
	I1030 10:44:28.701124 1041126 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:44:28.701406 1041126 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
	W1030 10:44:28.701575 1041126 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17523-1035706/.minikube/config/config.json: open /home/jenkins/minikube-integration/17523-1035706/.minikube/config/config.json: no such file or directory
	I1030 10:44:28.702026 1041126 out.go:303] Setting JSON to true
	I1030 10:44:28.702917 1041126 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":156413,"bootTime":1698506256,"procs":160,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1048-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I1030 10:44:28.703015 1041126 start.go:138] virtualization:  
	I1030 10:44:28.706203 1041126 out.go:97] [download-only-618370] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	I1030 10:44:28.708355 1041126 out.go:169] MINIKUBE_LOCATION=17523
	W1030 10:44:28.706541 1041126 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball: no such file or directory
	I1030 10:44:28.706592 1041126 notify.go:220] Checking for updates...
	I1030 10:44:28.712178 1041126 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 10:44:28.713794 1041126 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	I1030 10:44:28.715496 1041126 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	I1030 10:44:28.717068 1041126 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W1030 10:44:28.720484 1041126 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1030 10:44:28.720753 1041126 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 10:44:28.745733 1041126 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1030 10:44:28.745837 1041126 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:44:28.831981 1041126 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-10-30 10:44:28.822194647 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:44:28.832083 1041126 docker.go:295] overlay module found
	I1030 10:44:28.834004 1041126 out.go:97] Using the docker driver based on user configuration
	I1030 10:44:28.834028 1041126 start.go:298] selected driver: docker
	I1030 10:44:28.834035 1041126 start.go:902] validating driver "docker" against <nil>
	I1030 10:44:28.834135 1041126 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:44:28.902613 1041126 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-10-30 10:44:28.893125685 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:44:28.902775 1041126 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 10:44:28.903059 1041126 start_flags.go:394] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I1030 10:44:28.903219 1041126 start_flags.go:916] Wait components to verify : map[apiserver:true system_pods:true]
	I1030 10:44:28.905318 1041126 out.go:169] Using Docker driver with root privileges
	I1030 10:44:28.907218 1041126 cni.go:84] Creating CNI manager for ""
	I1030 10:44:28.907238 1041126 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 10:44:28.907247 1041126 start_flags.go:323] config:
	{Name:download-only-618370 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-618370 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:44:28.909192 1041126 out.go:97] Starting control plane node download-only-618370 in cluster download-only-618370
	I1030 10:44:28.909209 1041126 cache.go:121] Beginning downloading kic base image for docker with docker
	I1030 10:44:28.911043 1041126 out.go:97] Pulling base image ...
	I1030 10:44:28.911065 1041126 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1030 10:44:28.911213 1041126 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local docker daemon
	I1030 10:44:28.928209 1041126 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 to local cache
	I1030 10:44:28.928916 1041126 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local cache directory
	I1030 10:44:28.929021 1041126 image.go:118] Writing gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 to local cache
	I1030 10:44:28.983161 1041126 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1030 10:44:28.983205 1041126 cache.go:56] Caching tarball of preloaded images
	I1030 10:44:28.983748 1041126 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1030 10:44:28.985964 1041126 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I1030 10:44:28.985989 1041126 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1030 10:44:29.097261 1041126 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1030 10:44:33.440637 1041126 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 as a tarball
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-618370"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.09s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/json-events (7.16s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-618370 --force --alsologtostderr --kubernetes-version=v1.28.3 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-618370 --force --alsologtostderr --kubernetes-version=v1.28.3 --container-runtime=docker --driver=docker  --container-runtime=docker: (7.162336966s)
--- PASS: TestDownloadOnly/v1.28.3/json-events (7.16s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/preload-exists
--- PASS: TestDownloadOnly/v1.28.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/LogsDuration (0.09s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-618370
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-618370: exit status 85 (92.548127ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   |    Version     |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-618370 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC |          |
	|         | -p download-only-618370        |                      |         |                |                     |          |
	|         | --force --alsologtostderr      |                      |         |                |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	|         | --driver=docker                |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	| start   | -o=json --download-only        | download-only-618370 | jenkins | v1.32.0-beta.0 | 30 Oct 23 10:44 UTC |          |
	|         | -p download-only-618370        |                      |         |                |                     |          |
	|         | --force --alsologtostderr      |                      |         |                |                     |          |
	|         | --kubernetes-version=v1.28.3   |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	|         | --driver=docker                |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	|---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/10/30 10:44:36
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.21.3 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1030 10:44:36.854129 1041198 out.go:296] Setting OutFile to fd 1 ...
	I1030 10:44:36.854268 1041198 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:44:36.854278 1041198 out.go:309] Setting ErrFile to fd 2...
	I1030 10:44:36.854284 1041198 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:44:36.854555 1041198 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
	W1030 10:44:36.854712 1041198 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17523-1035706/.minikube/config/config.json: open /home/jenkins/minikube-integration/17523-1035706/.minikube/config/config.json: no such file or directory
	I1030 10:44:36.854940 1041198 out.go:303] Setting JSON to true
	I1030 10:44:36.855891 1041198 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":156421,"bootTime":1698506256,"procs":157,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1048-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I1030 10:44:36.855965 1041198 start.go:138] virtualization:  
	I1030 10:44:36.858742 1041198 out.go:97] [download-only-618370] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	I1030 10:44:36.860910 1041198 out.go:169] MINIKUBE_LOCATION=17523
	I1030 10:44:36.859043 1041198 notify.go:220] Checking for updates...
	I1030 10:44:36.864299 1041198 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 10:44:36.866168 1041198 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	I1030 10:44:36.867815 1041198 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	I1030 10:44:36.869745 1041198 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W1030 10:44:36.873246 1041198 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1030 10:44:36.873831 1041198 config.go:182] Loaded profile config "download-only-618370": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W1030 10:44:36.873882 1041198 start.go:810] api.Load failed for download-only-618370: filestore "download-only-618370": Docker machine "download-only-618370" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1030 10:44:36.873971 1041198 driver.go:378] Setting default libvirt URI to qemu:///system
	W1030 10:44:36.873999 1041198 start.go:810] api.Load failed for download-only-618370: filestore "download-only-618370": Docker machine "download-only-618370" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1030 10:44:36.897322 1041198 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1030 10:44:36.897424 1041198 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:44:36.989525 1041198 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:39 SystemTime:2023-10-30 10:44:36.979451277 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:44:36.989630 1041198 docker.go:295] overlay module found
	I1030 10:44:36.991428 1041198 out.go:97] Using the docker driver based on existing profile
	I1030 10:44:36.991473 1041198 start.go:298] selected driver: docker
	I1030 10:44:36.991488 1041198 start.go:902] validating driver "docker" against &{Name:download-only-618370 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-618370 Namespace:default APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:44:36.991686 1041198 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:44:37.060136 1041198 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:39 SystemTime:2023-10-30 10:44:37.050172978 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:44:37.060620 1041198 cni.go:84] Creating CNI manager for ""
	I1030 10:44:37.060642 1041198 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 10:44:37.060654 1041198 start_flags.go:323] config:
	{Name:download-only-618370 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:download-only-618370 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:44:37.062663 1041198 out.go:97] Starting control plane node download-only-618370 in cluster download-only-618370
	I1030 10:44:37.062685 1041198 cache.go:121] Beginning downloading kic base image for docker with docker
	I1030 10:44:37.064492 1041198 out.go:97] Pulling base image ...
	I1030 10:44:37.064536 1041198 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 10:44:37.064718 1041198 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local docker daemon
	I1030 10:44:37.081647 1041198 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 to local cache
	I1030 10:44:37.081871 1041198 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local cache directory
	I1030 10:44:37.081893 1041198 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 in local cache directory, skipping pull
	I1030 10:44:37.081901 1041198 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 exists in cache, skipping pull
	I1030 10:44:37.081910 1041198 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 as a tarball
	I1030 10:44:37.125608 1041198 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.3/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4
	I1030 10:44:37.125636 1041198 cache.go:56] Caching tarball of preloaded images
	I1030 10:44:37.125812 1041198 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 10:44:37.128300 1041198 out.go:97] Downloading Kubernetes v1.28.3 preload ...
	I1030 10:44:37.128325 1041198 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4 ...
	I1030 10:44:37.244188 1041198 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.3/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4?checksum=md5:afa72052808cee1859e38c1ae6d1a426 -> /home/jenkins/minikube-integration/17523-1035706/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-arm64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-618370"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.3/LogsDuration (0.09s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.24s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:190: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.24s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.16s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:202: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-618370
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.16s)

                                                
                                    
x
+
TestBinaryMirror (0.62s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:307: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-292513 --alsologtostderr --binary-mirror http://127.0.0.1:40851 --driver=docker  --container-runtime=docker
helpers_test.go:175: Cleaning up "binary-mirror-292513" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-292513
--- PASS: TestBinaryMirror (0.62s)

                                                
                                    
x
+
TestOffline (103.16s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-arm64 start -p offline-docker-445322 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-arm64 start -p offline-docker-445322 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker: (1m40.881530307s)
helpers_test.go:175: Cleaning up "offline-docker-445322" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p offline-docker-445322
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p offline-docker-445322: (2.280483346s)
--- PASS: TestOffline (103.16s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.09s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:927: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-305325
addons_test.go:927: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-305325: exit status 85 (91.49184ms)

                                                
                                                
-- stdout --
	* Profile "addons-305325" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-305325"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.09s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.09s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:938: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-305325
addons_test.go:938: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-305325: exit status 85 (90.658754ms)

                                                
                                                
-- stdout --
	* Profile "addons-305325" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-305325"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.09s)

                                                
                                    
x
+
TestAddons/Setup (145.47s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-linux-arm64 start -p addons-305325 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns
addons_test.go:109: (dbg) Done: out/minikube-linux-arm64 start -p addons-305325 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns: (2m25.465879373s)
--- PASS: TestAddons/Setup (145.47s)

                                                
                                    
x
+
TestAddons/parallel/Registry (15.5s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:329: registry stabilized in 33.467011ms
addons_test.go:331: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-jjmtf" [9a268006-336c-4f6a-b0d0-e8c426d3d808] Running
addons_test.go:331: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.020577899s
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-4lzlk" [483bc59a-e469-4644-9780-a1670a5ea617] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.01889786s
addons_test.go:339: (dbg) Run:  kubectl --context addons-305325 delete po -l run=registry-test --now
addons_test.go:344: (dbg) Run:  kubectl --context addons-305325 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:344: (dbg) Done: kubectl --context addons-305325 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.416658331s)
addons_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 ip
2023/10/30 10:47:26 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:387: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (15.50s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.91s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:837: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-gm69x" [86f5afad-82a1-4a3e-ae17-4bb7f34cb1d4] Running
addons_test.go:837: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.014958962s
addons_test.go:840: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-305325
addons_test.go:840: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-305325: (5.890291265s)
--- PASS: TestAddons/parallel/InspektorGadget (10.91s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.79s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:406: metrics-server stabilized in 4.028871ms
addons_test.go:408: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-7c66d45ddc-d2w4f" [fc039028-9cb2-4802-ae10-6ef0f91d7dfe] Running
addons_test.go:408: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.015364827s
addons_test.go:414: (dbg) Run:  kubectl --context addons-305325 top pods -n kube-system
addons_test.go:431: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.79s)

                                                
                                    
x
+
TestAddons/parallel/CSI (55.5s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:560: csi-hostpath-driver pods stabilized in 5.02015ms
addons_test.go:563: (dbg) Run:  kubectl --context addons-305325 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:568: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:573: (dbg) Run:  kubectl --context addons-305325 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:578: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [f0f5461c-e691-4918-af10-040f6628bf74] Pending
helpers_test.go:344: "task-pv-pod" [f0f5461c-e691-4918-af10-040f6628bf74] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [f0f5461c-e691-4918-af10-040f6628bf74] Running
addons_test.go:578: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 13.023983485s
addons_test.go:583: (dbg) Run:  kubectl --context addons-305325 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:588: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-305325 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-305325 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-305325 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:593: (dbg) Run:  kubectl --context addons-305325 delete pod task-pv-pod
addons_test.go:599: (dbg) Run:  kubectl --context addons-305325 delete pvc hpvc
addons_test.go:605: (dbg) Run:  kubectl --context addons-305325 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:610: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:615: (dbg) Run:  kubectl --context addons-305325 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:620: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [2730b566-3827-4c8b-a8dc-2b59cc58dc6b] Pending
helpers_test.go:344: "task-pv-pod-restore" [2730b566-3827-4c8b-a8dc-2b59cc58dc6b] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [2730b566-3827-4c8b-a8dc-2b59cc58dc6b] Running
addons_test.go:620: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.018777309s
addons_test.go:625: (dbg) Run:  kubectl --context addons-305325 delete pod task-pv-pod-restore
addons_test.go:629: (dbg) Run:  kubectl --context addons-305325 delete pvc hpvc-restore
addons_test.go:633: (dbg) Run:  kubectl --context addons-305325 delete volumesnapshot new-snapshot-demo
addons_test.go:637: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:637: (dbg) Done: out/minikube-linux-arm64 -p addons-305325 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.984645905s)
addons_test.go:641: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:641: (dbg) Done: out/minikube-linux-arm64 -p addons-305325 addons disable volumesnapshots --alsologtostderr -v=1: (1.284267528s)
--- PASS: TestAddons/parallel/CSI (55.50s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (12.16s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:823: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-305325 --alsologtostderr -v=1
addons_test.go:823: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-305325 --alsologtostderr -v=1: (1.129082208s)
addons_test.go:828: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-94b766c-44bgc" [7705c389-301d-46ff-8dc2-9141deb21089] Pending
helpers_test.go:344: "headlamp-94b766c-44bgc" [7705c389-301d-46ff-8dc2-9141deb21089] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-94b766c-44bgc" [7705c389-301d-46ff-8dc2-9141deb21089] Running
addons_test.go:828: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 11.032629378s
--- PASS: TestAddons/parallel/Headlamp (12.16s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.65s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:856: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-56665cdfc-dh8bq" [9d09506d-9e6f-4792-b77b-b48438562e31] Running
addons_test.go:856: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.021479428s
addons_test.go:859: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-305325
--- PASS: TestAddons/parallel/CloudSpanner (5.65s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (54.84s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:872: (dbg) Run:  kubectl --context addons-305325 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:878: (dbg) Run:  kubectl --context addons-305325 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:882: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-305325 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:885: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [450c5d61-604b-422f-ac85-0147ba3a8ec4] Pending
helpers_test.go:344: "test-local-path" [450c5d61-604b-422f-ac85-0147ba3a8ec4] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [450c5d61-604b-422f-ac85-0147ba3a8ec4] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [450c5d61-604b-422f-ac85-0147ba3a8ec4] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:885: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.011210687s
addons_test.go:890: (dbg) Run:  kubectl --context addons-305325 get pvc test-pvc -o=json
addons_test.go:899: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 ssh "cat /opt/local-path-provisioner/pvc-bf7b679e-dc51-492c-8284-1be02d31f2c1_default_test-pvc/file1"
addons_test.go:911: (dbg) Run:  kubectl --context addons-305325 delete pod test-local-path
addons_test.go:915: (dbg) Run:  kubectl --context addons-305325 delete pvc test-pvc
addons_test.go:919: (dbg) Run:  out/minikube-linux-arm64 -p addons-305325 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:919: (dbg) Done: out/minikube-linux-arm64 -p addons-305325 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.446070027s)
--- PASS: TestAddons/parallel/LocalPath (54.84s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.57s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:951: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-h6j8k" [cc17c9f5-b28c-473f-9c3e-43445b999d84] Running
addons_test.go:951: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.040928914s
addons_test.go:954: (dbg) Run:  out/minikube-linux-arm64 addons disable nvidia-device-plugin -p addons-305325
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.57s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.2s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:649: (dbg) Run:  kubectl --context addons-305325 create ns new-namespace
addons_test.go:663: (dbg) Run:  kubectl --context addons-305325 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.20s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (11.33s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:171: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-305325
addons_test.go:171: (dbg) Done: out/minikube-linux-arm64 stop -p addons-305325: (10.995300712s)
addons_test.go:175: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-305325
addons_test.go:179: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-305325
addons_test.go:184: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-305325
--- PASS: TestAddons/StoppedEnableDisable (11.33s)

                                                
                                    
x
+
TestCertOptions (43.8s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-617141 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-617141 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker: (40.869380864s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-617141 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-617141 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-617141 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-617141" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-617141
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-617141: (2.159973516s)
--- PASS: TestCertOptions (43.80s)

                                                
                                    
x
+
TestCertExpiration (251.26s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-289799 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-289799 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker: (41.00446608s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-289799 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-289799 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker: (28.054947427s)
helpers_test.go:175: Cleaning up "cert-expiration-289799" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-289799
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-289799: (2.201801427s)
--- PASS: TestCertExpiration (251.26s)

                                                
                                    
x
+
TestDockerFlags (47.95s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-linux-arm64 start -p docker-flags-592989 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:51: (dbg) Done: out/minikube-linux-arm64 start -p docker-flags-592989 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (44.819305358s)
docker_test.go:56: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-592989 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:67: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-592989 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
helpers_test.go:175: Cleaning up "docker-flags-592989" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-flags-592989
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-flags-592989: (2.307578924s)
--- PASS: TestDockerFlags (47.95s)

                                                
                                    
x
+
TestForceSystemdFlag (48.48s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-695873 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-695873 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (45.576035969s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-695873 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-flag-695873" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-695873
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-695873: (2.391163297s)
--- PASS: TestForceSystemdFlag (48.48s)

                                                
                                    
x
+
TestForceSystemdEnv (41.6s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-072359 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-072359 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (38.826576275s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-072359 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-env-072359" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-072359
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-072359: (2.260062555s)
--- PASS: TestForceSystemdEnv (41.60s)

                                                
                                    
x
+
TestErrorSpam/setup (32.84s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-556578 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-556578 --driver=docker  --container-runtime=docker
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-556578 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-556578 --driver=docker  --container-runtime=docker: (32.837599981s)
--- PASS: TestErrorSpam/setup (32.84s)

                                                
                                    
x
+
TestErrorSpam/start (0.88s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 start --dry-run
--- PASS: TestErrorSpam/start (0.88s)

                                                
                                    
x
+
TestErrorSpam/status (1.14s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 status
--- PASS: TestErrorSpam/status (1.14s)

                                                
                                    
x
+
TestErrorSpam/pause (1.45s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 pause
--- PASS: TestErrorSpam/pause (1.45s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.59s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 unpause
--- PASS: TestErrorSpam/unpause (1.59s)

                                                
                                    
x
+
TestErrorSpam/stop (2.2s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 stop: (1.955230303s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-556578 --log_dir /tmp/nospam-556578 stop
--- PASS: TestErrorSpam/stop (2.20s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/17523-1035706/.minikube/files/etc/test/nested/copy/1041121/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (46.72s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-798279 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-798279 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker: (46.71911785s)
--- PASS: TestFunctional/serial/StartWithProxy (46.72s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (39.65s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-798279 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-798279 --alsologtostderr -v=8: (39.649528155s)
functional_test.go:659: soft start took 39.650817032s for "functional-798279" cluster.
--- PASS: TestFunctional/serial/SoftStart (39.65s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.06s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-798279 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 cache add registry.k8s.io/pause:3.1: (1.040118705s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 cache add registry.k8s.io/pause:3.3: (1.091039474s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.18s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-798279 /tmp/TestFunctionalserialCacheCmdcacheadd_local2879234774/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 cache add minikube-local-cache-test:functional-798279
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 cache delete minikube-local-cache-test:functional-798279
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-798279
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.18s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.07s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.38s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.38s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.74s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-798279 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (361.698634ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.74s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.17s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 kubectl -- --context functional-798279 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.17s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.17s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-798279 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.17s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (38.88s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-798279 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E1030 10:52:11.441416 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:11.447803 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:11.458043 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:11.478286 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:11.518534 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:11.598777 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:11.759261 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:12.079759 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:12.720570 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:14.001002 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:16.561775 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:21.682308 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:52:31.922543 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-798279 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (38.874267433s)
functional_test.go:757: restart took 38.874365581s for "functional-798279" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (38.88s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-798279 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.10s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.44s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 logs: (1.440845192s)
--- PASS: TestFunctional/serial/LogsCmd (1.44s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.32s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 logs --file /tmp/TestFunctionalserialLogsFileCmd977810369/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 logs --file /tmp/TestFunctionalserialLogsFileCmd977810369/001/logs.txt: (1.317843297s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.32s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.89s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-798279 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-798279
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-798279: exit status 115 (571.838541ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:31930 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-798279 delete -f testdata/invalidsvc.yaml
functional_test.go:2323: (dbg) Done: kubectl --context functional-798279 delete -f testdata/invalidsvc.yaml: (1.017068671s)
--- PASS: TestFunctional/serial/InvalidService (4.89s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-798279 config get cpus: exit status 14 (112.244767ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-798279 config get cpus: exit status 14 (94.045187ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.58s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (9.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-798279 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-798279 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 1080657: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (9.72s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (1.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-798279 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-798279 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (397.079558ms)

                                                
                                                
-- stdout --
	* [functional-798279] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17523
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 10:53:14.234689 1080137 out.go:296] Setting OutFile to fd 1 ...
	I1030 10:53:14.234877 1080137 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:53:14.234906 1080137 out.go:309] Setting ErrFile to fd 2...
	I1030 10:53:14.234927 1080137 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:53:14.235220 1080137 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
	I1030 10:53:14.236882 1080137 out.go:303] Setting JSON to false
	I1030 10:53:14.238532 1080137 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":156939,"bootTime":1698506256,"procs":291,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1048-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I1030 10:53:14.238644 1080137 start.go:138] virtualization:  
	I1030 10:53:14.241057 1080137 out.go:177] * [functional-798279] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	I1030 10:53:14.243597 1080137 out.go:177]   - MINIKUBE_LOCATION=17523
	I1030 10:53:14.243573 1080137 notify.go:220] Checking for updates...
	I1030 10:53:14.247943 1080137 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 10:53:14.250627 1080137 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	I1030 10:53:14.252281 1080137 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	I1030 10:53:14.255998 1080137 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1030 10:53:14.259182 1080137 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 10:53:14.261718 1080137 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 10:53:14.262496 1080137 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 10:53:14.305378 1080137 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1030 10:53:14.305516 1080137 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:53:14.496555 1080137 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-10-30 10:53:14.481287405 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:53:14.496664 1080137 docker.go:295] overlay module found
	I1030 10:53:14.499454 1080137 out.go:177] * Using the docker driver based on existing profile
	I1030 10:53:14.501568 1080137 start.go:298] selected driver: docker
	I1030 10:53:14.501598 1080137 start.go:902] validating driver "docker" against &{Name:functional-798279 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-798279 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:53:14.501763 1080137 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 10:53:14.505274 1080137 out.go:177] 
	W1030 10:53:14.507053 1080137 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I1030 10:53:14.509492 1080137 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-798279 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
--- PASS: TestFunctional/parallel/DryRun (1.02s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-798279 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-798279 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (259.635701ms)

                                                
                                                
-- stdout --
	* [functional-798279] minikube v1.32.0-beta.0 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17523
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 10:53:13.930966 1080070 out.go:296] Setting OutFile to fd 1 ...
	I1030 10:53:13.931140 1080070 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:53:13.931149 1080070 out.go:309] Setting ErrFile to fd 2...
	I1030 10:53:13.931155 1080070 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 10:53:13.931531 1080070 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
	I1030 10:53:13.931886 1080070 out.go:303] Setting JSON to false
	I1030 10:53:13.933959 1080070 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":156938,"bootTime":1698506256,"procs":290,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1048-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I1030 10:53:13.934041 1080070 start.go:138] virtualization:  
	I1030 10:53:13.937864 1080070 out.go:177] * [functional-798279] minikube v1.32.0-beta.0 sur Ubuntu 20.04 (arm64)
	I1030 10:53:13.939776 1080070 out.go:177]   - MINIKUBE_LOCATION=17523
	I1030 10:53:13.941424 1080070 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 10:53:13.939892 1080070 notify.go:220] Checking for updates...
	I1030 10:53:13.944935 1080070 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	I1030 10:53:13.946671 1080070 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	I1030 10:53:13.948364 1080070 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1030 10:53:13.950213 1080070 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 10:53:13.952569 1080070 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 10:53:13.953176 1080070 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 10:53:13.980529 1080070 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community
	I1030 10:53:13.980658 1080070 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 10:53:14.101330 1080070 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-10-30 10:53:14.090357277 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 10:53:14.101448 1080070 docker.go:295] overlay module found
	I1030 10:53:14.103923 1080070 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I1030 10:53:14.105921 1080070 start.go:298] selected driver: docker
	I1030 10:53:14.105940 1080070 start.go:902] validating driver "docker" against &{Name:functional-798279 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.41@sha256:dbb2380b629f0776f6e6e49b5825fe42814849b2a6ad4707fbcf87004835f612 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-798279 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 10:53:14.106043 1080070 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 10:53:14.108753 1080070 out.go:177] 
	W1030 10:53:14.110819 1080070 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I1030 10:53:14.112812 1080070 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (10.84s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-798279 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-798279 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-7799dfb7c6-h9zwr" [dd5b10ca-a26c-4d9f-aa8a-c89d995a1a77] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
E1030 10:52:52.403681 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
helpers_test.go:344: "hello-node-connect-7799dfb7c6-h9zwr" [dd5b10ca-a26c-4d9f-aa8a-c89d995a1a77] Running
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 10.018354981s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:31355
functional_test.go:1674: http://192.168.49.2:31355: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-7799dfb7c6-h9zwr

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31355
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (10.84s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (27.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [75781faa-2812-4ffe-b81d-736028697b73] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.034878181s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-798279 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-798279 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-798279 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-798279 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [78e01551-d0a8-41b6-9fed-81c4b2f4da7d] Pending
helpers_test.go:344: "sp-pod" [78e01551-d0a8-41b6-9fed-81c4b2f4da7d] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [78e01551-d0a8-41b6-9fed-81c4b2f4da7d] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 12.016108791s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-798279 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-798279 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-798279 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [560416ca-b8bb-43b9-bf9f-434de51ee369] Pending
helpers_test.go:344: "sp-pod" [560416ca-b8bb-43b9-bf9f-434de51ee369] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [560416ca-b8bb-43b9-bf9f-434de51ee369] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 8.015311127s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-798279 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (27.11s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.78s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.78s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh -n functional-798279 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 cp functional-798279:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd2087506368/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh -n functional-798279 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.65s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/1041121/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo cat /etc/test/nested/copy/1041121/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/1041121.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo cat /etc/ssl/certs/1041121.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/1041121.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo cat /usr/share/ca-certificates/1041121.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/10411212.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo cat /etc/ssl/certs/10411212.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/10411212.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo cat /usr/share/ca-certificates/10411212.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.50s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-798279 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-798279 ssh "sudo systemctl is-active crio": exit status 1 (470.278159ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.32s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-798279 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-798279 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-798279 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-798279 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 1077483: os: process already finished
helpers_test.go:502: unable to terminate pid 1077354: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.68s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-798279 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-798279 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [aab16863-df06-4589-83f5-55f8ec4b3e48] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [aab16863-df06-4589-83f5-55f8ec4b3e48] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.031737941s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.45s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-798279 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.108.208.47 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-798279 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (7.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-798279 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-798279 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-759d89bdcc-qjbc2" [ea01e2bc-2891-4d7b-88f7-3be0832ae230] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-759d89bdcc-qjbc2" [ea01e2bc-2891-4d7b-88f7-3be0832ae230] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 7.016922983s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (7.22s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.68s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1314: Took "439.46391ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1328: Took "94.93327ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 service list -o json
functional_test.go:1493: Took "695.45006ms" to run "out/minikube-linux-arm64 -p functional-798279 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1365: Took "461.670561ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1378: Took "74.31202ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdany-port3050571460/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1698663190688588194" to /tmp/TestFunctionalparallelMountCmdany-port3050571460/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1698663190688588194" to /tmp/TestFunctionalparallelMountCmdany-port3050571460/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1698663190688588194" to /tmp/TestFunctionalparallelMountCmdany-port3050571460/001/test-1698663190688588194
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Oct 30 10:53 created-by-test
-rw-r--r-- 1 docker docker 24 Oct 30 10:53 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Oct 30 10:53 test-1698663190688588194
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh cat /mount-9p/test-1698663190688588194
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-798279 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [dda7fa35-6e20-4c6b-8ae8-d8293f79a2e9] Pending
helpers_test.go:344: "busybox-mount" [dda7fa35-6e20-4c6b-8ae8-d8293f79a2e9] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [dda7fa35-6e20-4c6b-8ae8-d8293f79a2e9] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [dda7fa35-6e20-4c6b-8ae8-d8293f79a2e9] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.013276987s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-798279 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdany-port3050571460/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.40s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.49.2:31108
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.73s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:31108
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdspecific-port2374271971/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (582.217115ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdspecific-port2374271971/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-798279 ssh "sudo umount -f /mount-9p": exit status 1 (403.317391ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-798279 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdspecific-port2374271971/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.41s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (3.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2848521224/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2848521224/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2848521224/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T" /mount1: exit status 1 (1.071194651s)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-798279 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2848521224/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2848521224/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-798279 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2848521224/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (3.14s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 version --short
--- PASS: TestFunctional/parallel/Version/short (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 version -o=json --components
functional_test.go:2266: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 version -o=json --components: (1.238408843s)
--- PASS: TestFunctional/parallel/Version/components (1.24s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-798279 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.28.3
registry.k8s.io/kube-proxy:v1.28.3
registry.k8s.io/kube-controller-manager:v1.28.3
registry.k8s.io/kube-apiserver:v1.28.3
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-798279
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-798279
docker.io/kubernetesui/metrics-scraper:<none>
docker.io/kubernetesui/dashboard:<none>
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-798279 image ls --format short --alsologtostderr:
I1030 10:53:42.976857 1083372 out.go:296] Setting OutFile to fd 1 ...
I1030 10:53:42.977082 1083372 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:42.977108 1083372 out.go:309] Setting ErrFile to fd 2...
I1030 10:53:42.977127 1083372 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:42.977418 1083372 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
I1030 10:53:42.978147 1083372 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:42.978343 1083372 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:42.979004 1083372 cli_runner.go:164] Run: docker container inspect functional-798279 --format={{.State.Status}}
I1030 10:53:43.005010 1083372 ssh_runner.go:195] Run: systemctl --version
I1030 10:53:43.005071 1083372 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-798279
I1030 10:53:43.036860 1083372 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39415 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/functional-798279/id_rsa Username:docker}
I1030 10:53:43.144537 1083372 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-798279 image ls --format table --alsologtostderr:
|---------------------------------------------|-------------------|---------------|--------|
|                    Image                    |        Tag        |   Image ID    |  Size  |
|---------------------------------------------|-------------------|---------------|--------|
| docker.io/library/nginx                     | latest            | 97930d6f4eecd | 192MB  |
| registry.k8s.io/kube-proxy                  | v1.28.3           | a5dd5cdd6d3ef | 68.3MB |
| registry.k8s.io/pause                       | 3.9               | 829e9de338bd5 | 514kB  |
| gcr.io/k8s-minikube/storage-provisioner     | v5                | ba04bb24b9575 | 29MB   |
| registry.k8s.io/pause                       | 3.3               | 3d18732f8686c | 484kB  |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc      | 1611cd07b61d5 | 3.55MB |
| registry.k8s.io/echoserver-arm              | 1.8               | 72565bf5bbedf | 85MB   |
| docker.io/library/nginx                     | alpine            | aae348c9fbd40 | 48.4MB |
| registry.k8s.io/kube-apiserver              | v1.28.3           | 537e9a59ee2fd | 120MB  |
| registry.k8s.io/etcd                        | 3.5.9-0           | 9cdd6470f48c8 | 181MB  |
| docker.io/kubernetesui/dashboard            | <none>            | 20b332c9a70d8 | 244MB  |
| gcr.io/google-containers/addon-resizer      | functional-798279 | ffd4cfbbe753e | 32.9MB |
| registry.k8s.io/pause                       | 3.1               | 8057e0500773a | 525kB  |
| registry.k8s.io/pause                       | latest            | 8cb2091f603e7 | 240kB  |
| docker.io/library/minikube-local-cache-test | functional-798279 | 5729615559c80 | 30B    |
| registry.k8s.io/kube-scheduler              | v1.28.3           | 42a4e73724daa | 57.8MB |
| registry.k8s.io/coredns/coredns             | v1.10.1           | 97e04611ad434 | 51.4MB |
| registry.k8s.io/kube-controller-manager     | v1.28.3           | 8276439b4f237 | 116MB  |
| docker.io/kubernetesui/metrics-scraper      | <none>            | a422e0e982356 | 42.3MB |
|---------------------------------------------|-------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-798279 image ls --format table --alsologtostderr:
I1030 10:53:43.616693 1083501 out.go:296] Setting OutFile to fd 1 ...
I1030 10:53:43.616900 1083501 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:43.616905 1083501 out.go:309] Setting ErrFile to fd 2...
I1030 10:53:43.616911 1083501 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:43.617264 1083501 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
I1030 10:53:43.617948 1083501 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:43.618105 1083501 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:43.618637 1083501 cli_runner.go:164] Run: docker container inspect functional-798279 --format={{.State.Status}}
I1030 10:53:43.653788 1083501 ssh_runner.go:195] Run: systemctl --version
I1030 10:53:43.653844 1083501 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-798279
I1030 10:53:43.674637 1083501 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39415 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/functional-798279/id_rsa Username:docker}
I1030 10:53:43.784398 1083501 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-798279 image ls --format json --alsologtostderr:
[{"id":"5729615559c80b9aab35f5756471d8c46c44dda319d7b949911273ad3c84c49d","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-798279"],"size":"30"},{"id":"97930d6f4eecda673e2f3d7ec2983bce00b353792d1a9044b6477a3c51fcb185","repoDigests":[],"repoTags":["docker.io/library/nginx:latest"],"size":"192000000"},{"id":"537e9a59ee2fdef3cc7f5ebd14f9c4c77047176fca2bc5599db196217efeb5d7","repoDigests":[],"repoTags":["registry.k8s.io/kube-apiserver:v1.28.3"],"size":"120000000"},{"id":"a5dd5cdd6d3ef8058b7fbcecacbcee7f522fa8b9f3bb53bac6570e62ba2cbdbd","repoDigests":[],"repoTags":["registry.k8s.io/kube-proxy:v1.28.3"],"size":"68300000"},{"id":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":[],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"51400000"},{"id":"20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":[],"repoTags":["docker.io/kubernetesui/dashboard:\u003cnone\u003e"],"size":"244000000"},{"id":"1611cd07b6
1d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3550000"},{"id":"aae348c9fbd40035f9fc24e2c9ccb9ac0a8977a3f3441a997bb40f6011d45e9b","repoDigests":[],"repoTags":["docker.io/library/nginx:alpine"],"size":"48400000"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29000000"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-798279"],"size":"32900000"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"484000"},{"id":"8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"240000"},{"id":"42a4e73724daac2ee0c96eeeb79b9cf5f242fc3927ccfdc4df63b58140097314","r
epoDigests":[],"repoTags":["registry.k8s.io/kube-scheduler:v1.28.3"],"size":"57800000"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"525000"},{"id":"8276439b4f237dda1f7820b0fcef600bb5662e441aa00e7b7c45843e60f04a16","repoDigests":[],"repoTags":["registry.k8s.io/kube-controller-manager:v1.28.3"],"size":"116000000"},{"id":"9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace","repoDigests":[],"repoTags":["registry.k8s.io/etcd:3.5.9-0"],"size":"181000000"},{"id":"829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.9"],"size":"514000"},{"id":"a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":[],"repoTags":["docker.io/kubernetesui/metrics-scraper:\u003cnone\u003e"],"size":"42300000"},{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":[],"repoTags":["registry.k8s.io/echoserver-arm
:1.8"],"size":"85000000"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-798279 image ls --format json --alsologtostderr:
I1030 10:53:43.311288 1083431 out.go:296] Setting OutFile to fd 1 ...
I1030 10:53:43.311548 1083431 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:43.311573 1083431 out.go:309] Setting ErrFile to fd 2...
I1030 10:53:43.311586 1083431 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:43.311921 1083431 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
I1030 10:53:43.312700 1083431 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:43.312864 1083431 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:43.313487 1083431 cli_runner.go:164] Run: docker container inspect functional-798279 --format={{.State.Status}}
I1030 10:53:43.338651 1083431 ssh_runner.go:195] Run: systemctl --version
I1030 10:53:43.338742 1083431 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-798279
I1030 10:53:43.381852 1083431 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39415 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/functional-798279/id_rsa Username:docker}
I1030 10:53:43.479596 1083431 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-798279 image ls --format yaml --alsologtostderr:
- id: 9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace
repoDigests: []
repoTags:
- registry.k8s.io/etcd:3.5.9-0
size: "181000000"
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-798279
size: "32900000"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "484000"
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3550000"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests: []
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "85000000"
- id: 537e9a59ee2fdef3cc7f5ebd14f9c4c77047176fca2bc5599db196217efeb5d7
repoDigests: []
repoTags:
- registry.k8s.io/kube-apiserver:v1.28.3
size: "120000000"
- id: 829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.9
size: "514000"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "240000"
- id: 5729615559c80b9aab35f5756471d8c46c44dda319d7b949911273ad3c84c49d
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-798279
size: "30"
- id: aae348c9fbd40035f9fc24e2c9ccb9ac0a8977a3f3441a997bb40f6011d45e9b
repoDigests: []
repoTags:
- docker.io/library/nginx:alpine
size: "48400000"
- id: 97930d6f4eecda673e2f3d7ec2983bce00b353792d1a9044b6477a3c51fcb185
repoDigests: []
repoTags:
- docker.io/library/nginx:latest
size: "192000000"
- id: 42a4e73724daac2ee0c96eeeb79b9cf5f242fc3927ccfdc4df63b58140097314
repoDigests: []
repoTags:
- registry.k8s.io/kube-scheduler:v1.28.3
size: "57800000"
- id: 20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests: []
repoTags:
- docker.io/kubernetesui/dashboard:<none>
size: "244000000"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "525000"
- id: 8276439b4f237dda1f7820b0fcef600bb5662e441aa00e7b7c45843e60f04a16
repoDigests: []
repoTags:
- registry.k8s.io/kube-controller-manager:v1.28.3
size: "116000000"
- id: a5dd5cdd6d3ef8058b7fbcecacbcee7f522fa8b9f3bb53bac6570e62ba2cbdbd
repoDigests: []
repoTags:
- registry.k8s.io/kube-proxy:v1.28.3
size: "68300000"
- id: 97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests: []
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "51400000"
- id: a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests: []
repoTags:
- docker.io/kubernetesui/metrics-scraper:<none>
size: "42300000"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29000000"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-798279 image ls --format yaml --alsologtostderr:
I1030 10:53:42.947837 1083371 out.go:296] Setting OutFile to fd 1 ...
I1030 10:53:42.954933 1083371 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:42.954982 1083371 out.go:309] Setting ErrFile to fd 2...
I1030 10:53:42.954991 1083371 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:42.955431 1083371 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
I1030 10:53:42.956632 1083371 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:42.956819 1083371 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:42.959290 1083371 cli_runner.go:164] Run: docker container inspect functional-798279 --format={{.State.Status}}
I1030 10:53:42.995348 1083371 ssh_runner.go:195] Run: systemctl --version
I1030 10:53:42.995410 1083371 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-798279
I1030 10:53:43.025027 1083371 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39415 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/functional-798279/id_rsa Username:docker}
I1030 10:53:43.131872 1083371 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (2.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-798279 ssh pgrep buildkitd: exit status 1 (451.370983ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image build -t localhost/my-image:functional-798279 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 image build -t localhost/my-image:functional-798279 testdata/build --alsologtostderr: (2.175770415s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-798279 image build -t localhost/my-image:functional-798279 testdata/build --alsologtostderr:
I1030 10:53:43.732861 1083521 out.go:296] Setting OutFile to fd 1 ...
I1030 10:53:43.733515 1083521 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:43.733527 1083521 out.go:309] Setting ErrFile to fd 2...
I1030 10:53:43.733534 1083521 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 10:53:43.733834 1083521 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
I1030 10:53:43.734497 1083521 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:43.735233 1083521 config.go:182] Loaded profile config "functional-798279": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 10:53:43.735879 1083521 cli_runner.go:164] Run: docker container inspect functional-798279 --format={{.State.Status}}
I1030 10:53:43.754971 1083521 ssh_runner.go:195] Run: systemctl --version
I1030 10:53:43.755032 1083521 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-798279
I1030 10:53:43.773357 1083521 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39415 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/functional-798279/id_rsa Username:docker}
I1030 10:53:43.876088 1083521 build_images.go:151] Building image from path: /tmp/build.3226158650.tar
I1030 10:53:43.876171 1083521 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I1030 10:53:43.888056 1083521 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.3226158650.tar
I1030 10:53:43.892427 1083521 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.3226158650.tar: stat -c "%s %y" /var/lib/minikube/build/build.3226158650.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.3226158650.tar': No such file or directory
I1030 10:53:43.892460 1083521 ssh_runner.go:362] scp /tmp/build.3226158650.tar --> /var/lib/minikube/build/build.3226158650.tar (3072 bytes)
I1030 10:53:43.923215 1083521 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.3226158650
I1030 10:53:43.934311 1083521 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.3226158650 -xf /var/lib/minikube/build/build.3226158650.tar
I1030 10:53:43.945996 1083521 docker.go:341] Building image: /var/lib/minikube/build/build.3226158650
I1030 10:53:43.946065 1083521 ssh_runner.go:195] Run: docker build -t localhost/my-image:functional-798279 /var/lib/minikube/build/build.3226158650
#0 building with "default" instance using docker driver

                                                
                                                
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.7s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 770B / 770B done
#5 sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9 527B / 527B done
#5 sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02 1.47kB / 1.47kB done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.1s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.0s done
#5 DONE 0.4s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.4s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.0s done
#8 writing image sha256:e7b2783a546c6747241ce9fd2c7b2cd4b5379c2ba0f20dd8d5183c5f05e717bc done
#8 naming to localhost/my-image:functional-798279 done
#8 DONE 0.1s
I1030 10:53:45.778584 1083521 ssh_runner.go:235] Completed: docker build -t localhost/my-image:functional-798279 /var/lib/minikube/build/build.3226158650: (1.832489653s)
I1030 10:53:45.778720 1083521 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.3226158650
I1030 10:53:45.789625 1083521 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.3226158650.tar
I1030 10:53:45.799777 1083521 build_images.go:207] Built localhost/my-image:functional-798279 from /tmp/build.3226158650.tar
I1030 10:53:45.799805 1083521 build_images.go:123] succeeded building to: functional-798279
I1030 10:53:45.799810 1083521 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (2.87s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (2.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
2023/10/30 10:53:24 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.44345605s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-798279
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.47s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (1.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-798279 docker-env) && out/minikube-linux-arm64 status -p functional-798279"
functional_test.go:518: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-798279 docker-env) && docker images"
--- PASS: TestFunctional/parallel/DockerEnv/bash (1.40s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image load --daemon gcr.io/google-containers/addon-resizer:functional-798279 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 image load --daemon gcr.io/google-containers/addon-resizer:functional-798279 --alsologtostderr: (4.118175449s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.40s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.74s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image load --daemon gcr.io/google-containers/addon-resizer:functional-798279 --alsologtostderr
E1030 10:53:33.363890 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 image load --daemon gcr.io/google-containers/addon-resizer:functional-798279 --alsologtostderr: (2.511211186s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.74s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.566069282s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-798279
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image load --daemon gcr.io/google-containers/addon-resizer:functional-798279 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 image load --daemon gcr.io/google-containers/addon-resizer:functional-798279 --alsologtostderr: (3.158272353s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.01s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.84s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image save gcr.io/google-containers/addon-resizer:functional-798279 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.84s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.52s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image rm gcr.io/google-containers/addon-resizer:functional-798279 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.52s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:408: (dbg) Done: out/minikube-linux-arm64 -p functional-798279 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.072237855s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.31s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-798279
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-798279 image save --daemon gcr.io/google-containers/addon-resizer:functional-798279 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-798279
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (1.00s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.08s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-798279
--- PASS: TestFunctional/delete_addon-resizer_images (0.08s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-798279
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-798279
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (31.32s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -p image-941043 --driver=docker  --container-runtime=docker
image_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -p image-941043 --driver=docker  --container-runtime=docker: (31.318107195s)
--- PASS: TestImageBuild/serial/Setup (31.32s)

                                                
                                    
x
+
TestImageBuild/serial/NormalBuild (1.86s)

                                                
                                                
=== RUN   TestImageBuild/serial/NormalBuild
image_test.go:78: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-941043
image_test.go:78: (dbg) Done: out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-941043: (1.864223033s)
--- PASS: TestImageBuild/serial/NormalBuild (1.86s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithBuildArg (0.93s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithBuildArg
image_test.go:99: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-941043
--- PASS: TestImageBuild/serial/BuildWithBuildArg (0.93s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithDockerIgnore (0.96s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithDockerIgnore
image_test.go:133: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal --build-opt=no-cache -p image-941043
--- PASS: TestImageBuild/serial/BuildWithDockerIgnore (0.96s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.76s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithSpecifiedDockerfile
image_test.go:88: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest -f inner/Dockerfile ./testdata/image-build/test-f -p image-941043
--- PASS: TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.76s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (75.97s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-arm64 start -p ingress-addon-legacy-405700 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E1030 10:54:55.284731 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-arm64 start -p ingress-addon-legacy-405700 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (1m15.966277754s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (75.97s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (10.56s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-405700 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-405700 addons enable ingress --alsologtostderr -v=5: (10.561664249s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (10.56s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.67s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-405700 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.67s)

                                                
                                    
x
+
TestJSONOutput/start/Command (47.83s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-323392 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker
E1030 10:57:11.442088 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:57:39.125419 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 10:57:42.035595 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:57:42.040905 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:57:42.051202 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:57:42.071477 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:57:42.111808 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:57:42.192156 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:57:42.352576 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:57:42.673132 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-323392 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker: (47.831137587s)
--- PASS: TestJSONOutput/start/Command (47.83s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.64s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-323392 --output=json --user=testUser
E1030 10:57:43.314170 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
--- PASS: TestJSONOutput/pause/Command (0.64s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.59s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-323392 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.59s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.84s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-323392 --output=json --user=testUser
E1030 10:57:44.595070 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:57:47.155846 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-323392 --output=json --user=testUser: (5.840982538s)
--- PASS: TestJSONOutput/stop/Command (5.84s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.26s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-898046 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-898046 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (100.208594ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"5ba1f812-47bb-4f89-9c11-acefd2931f86","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-898046] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"acdb7eca-5cbc-4b68-b73e-2834fb7bfbbe","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17523"}}
	{"specversion":"1.0","id":"1f531ccc-ac02-4043-9bf9-dff578f51971","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"12846f87-171e-4a4f-ba0c-06a24d46186a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig"}}
	{"specversion":"1.0","id":"52b3b2ca-2ae7-4ed2-9529-4a26fffcc3ae","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube"}}
	{"specversion":"1.0","id":"8569bff0-6ec5-4173-9c10-9de329c7ccc0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"35cd67ac-f3e0-4afb-a594-208040d187b5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"c6d43289-3e8d-4fe9-903b-62565138d5a0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-898046" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-898046
--- PASS: TestErrorJSONOutput (0.26s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (32.21s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-798679 --network=
E1030 10:57:52.276447 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 10:58:02.516651 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-798679 --network=: (30.117832265s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-798679" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-798679
E1030 10:58:22.997738 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-798679: (2.070806828s)
--- PASS: TestKicCustomNetwork/create_custom_network (32.21s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (39.29s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-973659 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-973659 --network=bridge: (37.180926222s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-973659" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-973659
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-973659: (2.086357424s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (39.29s)

                                                
                                    
x
+
TestKicExistingNetwork (36.22s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-728589 --network=existing-network
E1030 10:59:03.957997 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-728589 --network=existing-network: (34.007809354s)
helpers_test.go:175: Cleaning up "existing-network-728589" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-728589
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-728589: (2.055221565s)
--- PASS: TestKicExistingNetwork (36.22s)

                                                
                                    
x
+
TestKicCustomSubnet (34.7s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-110600 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-110600 --subnet=192.168.60.0/24: (32.482318232s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-110600 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-110600" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-110600
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-110600: (2.189121252s)
--- PASS: TestKicCustomSubnet (34.70s)

                                                
                                    
x
+
TestKicStaticIP (37.71s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-466060 --static-ip=192.168.200.200
E1030 11:00:25.878221 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-466060 --static-ip=192.168.200.200: (35.336327702s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-466060 ip
helpers_test.go:175: Cleaning up "static-ip-466060" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-466060
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-466060: (2.193214382s)
--- PASS: TestKicStaticIP (37.71s)

                                                
                                    
x
+
TestMainNoArgs (0.07s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.07s)

                                                
                                    
x
+
TestMinikubeProfile (79.47s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-954301 --driver=docker  --container-runtime=docker
E1030 11:00:54.010791 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:54.016069 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:54.026394 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:54.046651 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:54.086896 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:54.167144 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:54.327472 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:54.647990 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:55.288905 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:56.569127 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:00:59.129610 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:01:04.250209 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:01:14.490407 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-954301 --driver=docker  --container-runtime=docker: (34.772382027s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-956648 --driver=docker  --container-runtime=docker
E1030 11:01:34.970923 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-956648 --driver=docker  --container-runtime=docker: (39.088036046s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-954301
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-956648
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-956648" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-956648
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-956648: (2.184846906s)
helpers_test.go:175: Cleaning up "first-954301" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-954301
E1030 11:02:11.442180 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-954301: (2.115754335s)
--- PASS: TestMinikubeProfile (79.47s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (8.38s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-223772 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
E1030 11:02:15.931995 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-223772 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (7.378227002s)
--- PASS: TestMountStart/serial/StartWithMountFirst (8.38s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-223772 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.29s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (10.74s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-225479 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-225479 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (9.740087268s)
--- PASS: TestMountStart/serial/StartWithMountSecond (10.74s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.31s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-225479 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.31s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.55s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-223772 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-223772 --alsologtostderr -v=5: (1.553362326s)
--- PASS: TestMountStart/serial/DeleteFirst (1.55s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-225479 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.29s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.24s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-225479
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-225479: (1.244580926s)
--- PASS: TestMountStart/serial/Stop (1.24s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (8.41s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-225479
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-225479: (7.411105377s)
E1030 11:02:42.035259 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
--- PASS: TestMountStart/serial/RestartStopped (8.41s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-225479 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.29s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (82.08s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-625706 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E1030 11:03:09.718852 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 11:03:37.852965 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p multinode-625706 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m21.438997373s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (82.08s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (47.2s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-625706 -- rollout status deployment/busybox: (2.785350379s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-g4dmm -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-w7lhl -- nslookup kubernetes.io
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-g4dmm -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-w7lhl -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-g4dmm -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-w7lhl -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (47.20s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-g4dmm -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-g4dmm -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-w7lhl -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-625706 -- exec busybox-5bc68d56bd-w7lhl -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.22s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (21.66s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-625706 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-625706 -v 3 --alsologtostderr: (20.818716797s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (21.66s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.39s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.39s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (11.5s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp testdata/cp-test.txt multinode-625706:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2651714538/001/cp-test_multinode-625706.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706:/home/docker/cp-test.txt multinode-625706-m02:/home/docker/cp-test_multinode-625706_multinode-625706-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m02 "sudo cat /home/docker/cp-test_multinode-625706_multinode-625706-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706:/home/docker/cp-test.txt multinode-625706-m03:/home/docker/cp-test_multinode-625706_multinode-625706-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m03 "sudo cat /home/docker/cp-test_multinode-625706_multinode-625706-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp testdata/cp-test.txt multinode-625706-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2651714538/001/cp-test_multinode-625706-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706-m02:/home/docker/cp-test.txt multinode-625706:/home/docker/cp-test_multinode-625706-m02_multinode-625706.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706 "sudo cat /home/docker/cp-test_multinode-625706-m02_multinode-625706.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706-m02:/home/docker/cp-test.txt multinode-625706-m03:/home/docker/cp-test_multinode-625706-m02_multinode-625706-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m03 "sudo cat /home/docker/cp-test_multinode-625706-m02_multinode-625706-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp testdata/cp-test.txt multinode-625706-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2651714538/001/cp-test_multinode-625706-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706-m03:/home/docker/cp-test.txt multinode-625706:/home/docker/cp-test_multinode-625706-m03_multinode-625706.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706 "sudo cat /home/docker/cp-test_multinode-625706-m03_multinode-625706.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 cp multinode-625706-m03:/home/docker/cp-test.txt multinode-625706-m02:/home/docker/cp-test_multinode-625706-m03_multinode-625706-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 ssh -n multinode-625706-m02 "sudo cat /home/docker/cp-test_multinode-625706-m03_multinode-625706-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (11.50s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.4s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-arm64 -p multinode-625706 node stop m03: (1.250488694s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-625706 status: exit status 7 (581.397418ms)

                                                
                                                
-- stdout --
	multinode-625706
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-625706-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-625706-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-625706 status --alsologtostderr: exit status 7 (570.923453ms)

                                                
                                                
-- stdout --
	multinode-625706
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-625706-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-625706-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 11:05:30.921496 1148388 out.go:296] Setting OutFile to fd 1 ...
	I1030 11:05:30.921647 1148388 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 11:05:30.921653 1148388 out.go:309] Setting ErrFile to fd 2...
	I1030 11:05:30.921659 1148388 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 11:05:30.921999 1148388 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
	I1030 11:05:30.922229 1148388 out.go:303] Setting JSON to false
	I1030 11:05:30.922356 1148388 notify.go:220] Checking for updates...
	I1030 11:05:30.923374 1148388 mustload.go:65] Loading cluster: multinode-625706
	I1030 11:05:30.923886 1148388 config.go:182] Loaded profile config "multinode-625706": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 11:05:30.923906 1148388 status.go:255] checking status of multinode-625706 ...
	I1030 11:05:30.926378 1148388 cli_runner.go:164] Run: docker container inspect multinode-625706 --format={{.State.Status}}
	I1030 11:05:30.944958 1148388 status.go:330] multinode-625706 host status = "Running" (err=<nil>)
	I1030 11:05:30.944983 1148388 host.go:66] Checking if "multinode-625706" exists ...
	I1030 11:05:30.945313 1148388 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-625706
	I1030 11:05:30.964492 1148388 host.go:66] Checking if "multinode-625706" exists ...
	I1030 11:05:30.964796 1148388 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1030 11:05:30.964837 1148388 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-625706
	I1030 11:05:30.991925 1148388 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39485 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/multinode-625706/id_rsa Username:docker}
	I1030 11:05:31.084742 1148388 ssh_runner.go:195] Run: systemctl --version
	I1030 11:05:31.090757 1148388 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1030 11:05:31.104364 1148388 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1030 11:05:31.190136 1148388 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:44 OomKillDisable:true NGoroutines:55 SystemTime:2023-10-30 11:05:31.180014247 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1048-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215040000 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523 Expected:61f9fd88f79f081d64d6fa3bb1a0dc71ec870523} RuncCommit:{ID:v1.1.9-0-gccaecfc Expected:v1.1.9-0-gccaecfc} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}
	I1030 11:05:31.190785 1148388 kubeconfig.go:92] found "multinode-625706" server: "https://192.168.58.2:8443"
	I1030 11:05:31.190811 1148388 api_server.go:166] Checking apiserver status ...
	I1030 11:05:31.190907 1148388 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1030 11:05:31.204377 1148388 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/2106/cgroup
	I1030 11:05:31.215765 1148388 api_server.go:182] apiserver freezer: "10:freezer:/docker/2177d6dbb5eafdfdcc91ea2ed77c81c38cac54caeb7f0b8478d9d96df0dba474/kubepods/burstable/pod9800fe9ef5ba89b92aa56b7c5728e5b0/ef31f78b1f6f152ce393cd1e0c434bf41d11f67592c24e07c86fc981079c3828"
	I1030 11:05:31.215850 1148388 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/2177d6dbb5eafdfdcc91ea2ed77c81c38cac54caeb7f0b8478d9d96df0dba474/kubepods/burstable/pod9800fe9ef5ba89b92aa56b7c5728e5b0/ef31f78b1f6f152ce393cd1e0c434bf41d11f67592c24e07c86fc981079c3828/freezer.state
	I1030 11:05:31.226500 1148388 api_server.go:204] freezer state: "THAWED"
	I1030 11:05:31.226526 1148388 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I1030 11:05:31.235471 1148388 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I1030 11:05:31.235500 1148388 status.go:421] multinode-625706 apiserver status = Running (err=<nil>)
	I1030 11:05:31.235511 1148388 status.go:257] multinode-625706 status: &{Name:multinode-625706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1030 11:05:31.235530 1148388 status.go:255] checking status of multinode-625706-m02 ...
	I1030 11:05:31.235854 1148388 cli_runner.go:164] Run: docker container inspect multinode-625706-m02 --format={{.State.Status}}
	I1030 11:05:31.254000 1148388 status.go:330] multinode-625706-m02 host status = "Running" (err=<nil>)
	I1030 11:05:31.254029 1148388 host.go:66] Checking if "multinode-625706-m02" exists ...
	I1030 11:05:31.254326 1148388 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-625706-m02
	I1030 11:05:31.273075 1148388 host.go:66] Checking if "multinode-625706-m02" exists ...
	I1030 11:05:31.273373 1148388 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1030 11:05:31.273414 1148388 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-625706-m02
	I1030 11:05:31.292715 1148388 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39490 SSHKeyPath:/home/jenkins/minikube-integration/17523-1035706/.minikube/machines/multinode-625706-m02/id_rsa Username:docker}
	I1030 11:05:31.383882 1148388 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1030 11:05:31.397297 1148388 status.go:257] multinode-625706-m02 status: &{Name:multinode-625706-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I1030 11:05:31.397329 1148388 status.go:255] checking status of multinode-625706-m03 ...
	I1030 11:05:31.397641 1148388 cli_runner.go:164] Run: docker container inspect multinode-625706-m03 --format={{.State.Status}}
	I1030 11:05:31.420561 1148388 status.go:330] multinode-625706-m03 host status = "Stopped" (err=<nil>)
	I1030 11:05:31.420585 1148388 status.go:343] host is not running, skipping remaining checks
	I1030 11:05:31.420594 1148388 status.go:257] multinode-625706-m03 status: &{Name:multinode-625706-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.40s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (14.27s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Done: out/minikube-linux-arm64 -p multinode-625706 node start m03 --alsologtostderr: (13.390793503s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (14.27s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (124.48s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-625706
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-625706
E1030 11:05:54.010638 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
multinode_test.go:290: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-625706: (22.767239767s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-625706 --wait=true -v=8 --alsologtostderr
E1030 11:06:21.693268 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:07:11.441639 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:07:42.035455 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-arm64 start -p multinode-625706 --wait=true -v=8 --alsologtostderr: (1m41.534925119s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-625706
--- PASS: TestMultiNode/serial/RestartKeepsNodes (124.48s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.14s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 node delete m03
multinode_test.go:394: (dbg) Done: out/minikube-linux-arm64 -p multinode-625706 node delete m03: (4.406143153s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.14s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (21.86s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 stop
multinode_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p multinode-625706 stop: (21.640175383s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-625706 status: exit status 7 (108.148967ms)

                                                
                                                
-- stdout --
	multinode-625706
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-625706-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-625706 status --alsologtostderr: exit status 7 (109.168208ms)

                                                
                                                
-- stdout --
	multinode-625706
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-625706-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 11:08:17.123809 1164382 out.go:296] Setting OutFile to fd 1 ...
	I1030 11:08:17.124041 1164382 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 11:08:17.124066 1164382 out.go:309] Setting ErrFile to fd 2...
	I1030 11:08:17.124087 1164382 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 11:08:17.124405 1164382 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17523-1035706/.minikube/bin
	I1030 11:08:17.124619 1164382 out.go:303] Setting JSON to false
	I1030 11:08:17.124692 1164382 mustload.go:65] Loading cluster: multinode-625706
	I1030 11:08:17.124773 1164382 notify.go:220] Checking for updates...
	I1030 11:08:17.125192 1164382 config.go:182] Loaded profile config "multinode-625706": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 11:08:17.125227 1164382 status.go:255] checking status of multinode-625706 ...
	I1030 11:08:17.125785 1164382 cli_runner.go:164] Run: docker container inspect multinode-625706 --format={{.State.Status}}
	I1030 11:08:17.145232 1164382 status.go:330] multinode-625706 host status = "Stopped" (err=<nil>)
	I1030 11:08:17.145296 1164382 status.go:343] host is not running, skipping remaining checks
	I1030 11:08:17.145305 1164382 status.go:257] multinode-625706 status: &{Name:multinode-625706 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1030 11:08:17.145336 1164382 status.go:255] checking status of multinode-625706-m02 ...
	I1030 11:08:17.145658 1164382 cli_runner.go:164] Run: docker container inspect multinode-625706-m02 --format={{.State.Status}}
	I1030 11:08:17.164903 1164382 status.go:330] multinode-625706-m02 host status = "Stopped" (err=<nil>)
	I1030 11:08:17.164933 1164382 status.go:343] host is not running, skipping remaining checks
	I1030 11:08:17.164942 1164382 status.go:257] multinode-625706-m02 status: &{Name:multinode-625706-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (21.86s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (84.58s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-625706 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E1030 11:08:34.486481 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
multinode_test.go:354: (dbg) Done: out/minikube-linux-arm64 start -p multinode-625706 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m23.821275181s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-arm64 -p multinode-625706 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (84.58s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (37.73s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-625706
multinode_test.go:452: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-625706-m02 --driver=docker  --container-runtime=docker
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-625706-m02 --driver=docker  --container-runtime=docker: exit status 14 (108.933839ms)

                                                
                                                
-- stdout --
	* [multinode-625706-m02] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17523
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-625706-m02' is duplicated with machine name 'multinode-625706-m02' in profile 'multinode-625706'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-625706-m03 --driver=docker  --container-runtime=docker
multinode_test.go:460: (dbg) Done: out/minikube-linux-arm64 start -p multinode-625706-m03 --driver=docker  --container-runtime=docker: (34.958768203s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-625706
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-625706: exit status 80 (381.087109ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-625706
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-625706-m03 already exists in multinode-625706-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_1.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-625706-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-625706-m03: (2.210079777s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (37.73s)

                                                
                                    
x
+
TestPreload (172.48s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-173643 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4
E1030 11:10:54.011225 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-173643 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4: (1m43.488367201s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-173643 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-173643 image pull gcr.io/k8s-minikube/busybox: (1.28382093s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-173643
E1030 11:12:11.442371 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-173643: (10.919966596s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-173643 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker
E1030 11:12:42.035020 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-173643 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker: (54.275006919s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-173643 image list
helpers_test.go:175: Cleaning up "test-preload-173643" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-173643
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-173643: (2.272184266s)
--- PASS: TestPreload (172.48s)

                                                
                                    
x
+
TestScheduledStopUnix (105.98s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-442373 --memory=2048 --driver=docker  --container-runtime=docker
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-442373 --memory=2048 --driver=docker  --container-runtime=docker: (32.354015835s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-442373 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-442373 -n scheduled-stop-442373
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-442373 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-442373 --cancel-scheduled
E1030 11:14:05.079359 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-442373 -n scheduled-stop-442373
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-442373
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-442373 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-442373
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-442373: exit status 7 (128.175474ms)

                                                
                                                
-- stdout --
	scheduled-stop-442373
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-442373 -n scheduled-stop-442373
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-442373 -n scheduled-stop-442373: exit status 7 (102.590637ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-442373" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-442373
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-442373: (1.774105145s)
--- PASS: TestScheduledStopUnix (105.98s)

                                                
                                    
x
+
TestSkaffold (106.5s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /tmp/skaffold.exe3358773484 version
skaffold_test.go:63: skaffold version: v2.8.0
skaffold_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p skaffold-724114 --memory=2600 --driver=docker  --container-runtime=docker
skaffold_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p skaffold-724114 --memory=2600 --driver=docker  --container-runtime=docker: (30.960309519s)
skaffold_test.go:86: copying out/minikube-linux-arm64 to /home/jenkins/workspace/Docker_Linux_docker_arm64/out/minikube
skaffold_test.go:105: (dbg) Run:  /tmp/skaffold.exe3358773484 run --minikube-profile skaffold-724114 --kube-context skaffold-724114 --status-check=true --port-forward=false --interactive=false
E1030 11:15:54.015897 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
skaffold_test.go:105: (dbg) Done: /tmp/skaffold.exe3358773484 run --minikube-profile skaffold-724114 --kube-context skaffold-724114 --status-check=true --port-forward=false --interactive=false: (1m0.392955271s)
skaffold_test.go:111: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-app" in namespace "default" ...
helpers_test.go:344: "leeroy-app-6cc6795f5d-mlnk5" [0bd37db2-2ba0-4bd6-8e40-d43ca8df1316] Running
skaffold_test.go:111: (dbg) TestSkaffold: app=leeroy-app healthy within 5.023667384s
skaffold_test.go:114: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-web" in namespace "default" ...
helpers_test.go:344: "leeroy-web-6484b9d454-2ftm2" [a952a463-2205-444e-bef6-1178c51aa107] Running
skaffold_test.go:114: (dbg) TestSkaffold: app=leeroy-web healthy within 5.009863167s
helpers_test.go:175: Cleaning up "skaffold-724114" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p skaffold-724114
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p skaffold-724114: (2.88692841s)
--- PASS: TestSkaffold (106.50s)

                                                
                                    
x
+
TestInsufficientStorage (13.9s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-511347 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-511347 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker: exit status 26 (11.375408754s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"a38065ed-11ce-4f3b-8560-c3d73b767342","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-511347] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"3f194805-315d-4d06-830c-e4be8556fcb1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17523"}}
	{"specversion":"1.0","id":"2843d0f9-01a8-4305-b3a5-a5e9b2d87909","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"4e55657e-9488-4ac3-82a5-8fdb71e74a99","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig"}}
	{"specversion":"1.0","id":"4a564d9e-c24a-48aa-ad92-8eebdf7f667d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube"}}
	{"specversion":"1.0","id":"a99804bf-b6c0-4bad-8807-7b9b0734dcd5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"42604f19-d759-49da-8993-f4e1b113318e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"fc0d8d90-4138-4d7a-93ec-a586d0fd2af6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"eb584ad9-4dc1-4282-a2a7-8b55d485f5c2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"ce88717a-9be9-45ad-a5d8-25fe1851b532","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"1e1acf76-cd64-47a0-b167-e250c7dbb549","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"395c776f-9b0a-40dc-98f3-33bf462da473","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-511347 in cluster insufficient-storage-511347","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"e3408a01-27f8-40e4-acbe-9715f21b7bd7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"6bdd0fc2-b484-460d-8885-9b88f8583468","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"5f2a30ca-6b2e-43ae-98eb-dfa6178bda09","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-511347 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-511347 --output=json --layout=cluster: exit status 7 (378.134493ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-511347","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.32.0-beta.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-511347","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E1030 11:17:00.235898 1200459 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-511347" does not appear in /home/jenkins/minikube-integration/17523-1035706/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-511347 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-511347 --output=json --layout=cluster: exit status 7 (360.336128ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-511347","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.32.0-beta.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-511347","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E1030 11:17:00.597826 1200511 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-511347" does not appear in /home/jenkins/minikube-integration/17523-1035706/kubeconfig
	E1030 11:17:00.610878 1200511 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/insufficient-storage-511347/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-511347" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-511347
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-511347: (1.787098209s)
--- PASS: TestInsufficientStorage (13.90s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (91.71s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:133: (dbg) Run:  /tmp/minikube-v1.17.0.128275570.exe start -p running-upgrade-626416 --memory=2200 --vm-driver=docker  --container-runtime=docker
E1030 11:27:42.034924 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
version_upgrade_test.go:133: (dbg) Done: /tmp/minikube-v1.17.0.128275570.exe start -p running-upgrade-626416 --memory=2200 --vm-driver=docker  --container-runtime=docker: (50.111255276s)
version_upgrade_test.go:143: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-626416 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:143: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-626416 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (38.315063563s)
helpers_test.go:175: Cleaning up "running-upgrade-626416" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-626416
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-626416: (2.155794441s)
--- PASS: TestRunningBinaryUpgrade (91.71s)

                                                
                                    
x
+
TestKubernetesUpgrade (207.31s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:235: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-659753 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1030 11:24:19.409659 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
version_upgrade_test.go:235: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-659753 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m3.268250296s)
version_upgrade_test.go:240: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-659753
version_upgrade_test.go:240: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-659753: (10.205029956s)
version_upgrade_test.go:245: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-659753 status --format={{.Host}}
version_upgrade_test.go:245: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-659753 status --format={{.Host}}: exit status 7 (92.108658ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:247: status error: exit status 7 (may be ok)
version_upgrade_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-659753 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1030 11:25:14.487423 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:25:54.011042 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
version_upgrade_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-659753 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m31.685803673s)
version_upgrade_test.go:261: (dbg) Run:  kubectl --context kubernetes-upgrade-659753 version --output=json
version_upgrade_test.go:280: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:282: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-659753 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker
version_upgrade_test.go:282: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-659753 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker: exit status 106 (113.927807ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-659753] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17523
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.28.3 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-659753
	    minikube start -p kubernetes-upgrade-659753 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-6597532 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.28.3, by running:
	    
	    minikube start -p kubernetes-upgrade-659753 --kubernetes-version=v1.28.3
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:286: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:288: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-659753 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:288: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-659753 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (39.330994117s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-659753" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-659753
E1030 11:27:11.442009 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-659753: (2.503070173s)
--- PASS: TestKubernetesUpgrade (207.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.12s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-511291 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-511291 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker: exit status 14 (121.480134ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-511291] minikube v1.32.0-beta.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=17523
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/17523-1035706/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17523-1035706/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.12s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (48.19s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-511291 --driver=docker  --container-runtime=docker
E1030 11:17:11.441468 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:17:17.054042 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:17:42.035638 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-511291 --driver=docker  --container-runtime=docker: (47.71702272s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-511291 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (48.19s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (8.38s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-511291 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-511291 --no-kubernetes --driver=docker  --container-runtime=docker: (6.149987926s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-511291 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-511291 status -o json: exit status 2 (380.153564ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-511291","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-511291
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-511291: (1.851990402s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (8.38s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (10.8s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-511291 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-511291 --no-kubernetes --driver=docker  --container-runtime=docker: (10.79787799s)
--- PASS: TestNoKubernetes/serial/Start (10.80s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-511291 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-511291 "sudo systemctl is-active --quiet service kubelet": exit status 1 (311.114596ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.00s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.26s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-511291
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-511291: (1.260086364s)
--- PASS: TestNoKubernetes/serial/Stop (1.26s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.48s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-511291 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-511291 --driver=docker  --container-runtime=docker: (7.47619148s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.48s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-511291 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-511291 "sudo systemctl is-active --quiet service kubelet": exit status 1 (309.450404ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.31s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.94s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.94s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (137.94s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:196: (dbg) Run:  /tmp/minikube-v1.17.0.3971784040.exe start -p stopped-upgrade-172479 --memory=2200 --vm-driver=docker  --container-runtime=docker
E1030 11:20:54.010987 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:21:35.566275 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:35.571494 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:35.581802 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:35.602380 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:35.642624 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:35.723551 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:35.883665 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:36.204595 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:36.845758 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:38.126563 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:40.687698 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:45.807996 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:21:56.048732 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
version_upgrade_test.go:196: (dbg) Done: /tmp/minikube-v1.17.0.3971784040.exe start -p stopped-upgrade-172479 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m25.302524852s)
version_upgrade_test.go:205: (dbg) Run:  /tmp/minikube-v1.17.0.3971784040.exe -p stopped-upgrade-172479 stop
E1030 11:22:11.442132 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:22:16.528916 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
version_upgrade_test.go:205: (dbg) Done: /tmp/minikube-v1.17.0.3971784040.exe -p stopped-upgrade-172479 stop: (10.839031179s)
version_upgrade_test.go:211: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-172479 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1030 11:22:42.035561 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 11:22:57.489404 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
version_upgrade_test.go:211: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-172479 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (41.799346919s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (137.94s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.76s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:219: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-172479
version_upgrade_test.go:219: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-172479: (1.764280124s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.76s)

                                                
                                    
x
+
TestPause/serial/Start (87.66s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-319277 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-319277 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker: (1m27.655551754s)
--- PASS: TestPause/serial/Start (87.66s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (91.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker: (1m31.132683661s)
--- PASS: TestNetworkPlugins/group/auto/Start (91.13s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (37.3s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-319277 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E1030 11:30:45.080468 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-319277 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (37.265712451s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (37.30s)

                                                
                                    
x
+
TestPause/serial/Pause (1.22s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-319277 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-319277 --alsologtostderr -v=5: (1.219611092s)
--- PASS: TestPause/serial/Pause (1.22s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.6s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-319277 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-319277 --output=json --layout=cluster: exit status 2 (599.181135ms)

                                                
                                                
-- stdout --
	{"Name":"pause-319277","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 12 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.32.0-beta.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-319277","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.60s)

                                                
                                    
x
+
TestPause/serial/Unpause (1.12s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-319277 --alsologtostderr -v=5
pause_test.go:121: (dbg) Done: out/minikube-linux-arm64 unpause -p pause-319277 --alsologtostderr -v=5: (1.119151497s)
--- PASS: TestPause/serial/Unpause (1.12s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.18s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-319277 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-319277 --alsologtostderr -v=5: (1.183728491s)
--- PASS: TestPause/serial/PauseAgain (1.18s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.29s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-319277 --alsologtostderr -v=5
E1030 11:30:54.011470 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-319277 --alsologtostderr -v=5: (2.286601617s)
--- PASS: TestPause/serial/DeletePaused (2.29s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.55s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-319277
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-319277: exit status 1 (18.859752ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-319277: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (63.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker: (1m3.152827872s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (63.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (9.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-318879 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-wqxwj" [a765fc2e-7d55-4687-a8e5-29a89ed3f481] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1030 11:31:35.566818 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
helpers_test.go:344: "netcat-56589dfd74-wqxwj" [a765fc2e-7d55-4687-a8e5-29a89ed3f481] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.017919302s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-318879 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.05s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-lszrc" [bc306c5d-d5e5-4438-8cda-b84996874359] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.045669716s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.05s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (15.63s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-318879 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-2vlgg" [e1c6aabd-0ca8-40ab-8bbd-96877838bb78] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-2vlgg" [e1c6aabd-0ca8-40ab-8bbd-96877838bb78] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 15.010598872s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (15.63s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (89.74s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker
E1030 11:32:11.442515 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker: (1m29.740373705s)
--- PASS: TestNetworkPlugins/group/calico/Start (89.74s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-318879 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (70.64s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker: (1m10.639057492s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (70.64s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-blv9r" [40272e07-8e2f-4adb-a60f-f135f6e8e8db] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.033666651s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.5s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.50s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.72s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-318879 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-789ct" [20ee8514-e277-46be-8a6b-36e153947bdf] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-789ct" [20ee8514-e277-46be-8a6b-36e153947bdf] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.020337783s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.72s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-318879 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (11.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-318879 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-zxm8f" [77526413-6174-4218-b2eb-c6fb337df83e] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-zxm8f" [77526413-6174-4218-b2eb-c6fb337df83e] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 11.01233189s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (11.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-318879 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (60.72s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p false-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p false-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker: (1m0.721045714s)
--- PASS: TestNetworkPlugins/group/false/Start (60.72s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (55.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker: (55.401249823s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (55.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/KubeletFlags (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p false-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/false/KubeletFlags (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/NetCatPod (10.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context false-318879 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-cpm6q" [2870f40d-5f8f-4856-b63f-9f7ac47792a4] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-cpm6q" [2870f40d-5f8f-4856-b63f-9f7ac47792a4] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: app=netcat healthy within 10.013535173s
--- PASS: TestNetworkPlugins/group/false/NetCatPod (10.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/DNS (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/DNS
net_test.go:175: (dbg) Run:  kubectl --context false-318879 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/false/DNS (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Localhost (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Localhost
net_test.go:194: (dbg) Run:  kubectl --context false-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/false/Localhost (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/HairPin (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/HairPin
net_test.go:264: (dbg) Run:  kubectl --context false-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/false/HairPin (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.42s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.42s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-318879 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-p4crf" [517ce8cc-dfbc-4150-b31c-0e3c2d24f4b6] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-p4crf" [517ce8cc-dfbc-4150-b31c-0e3c2d24f4b6] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 11.012247171s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (26.77s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-318879 exec deployment/netcat -- nslookup kubernetes.default
E1030 11:35:54.011149 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
net_test.go:175: (dbg) Non-zero exit: kubectl --context enable-default-cni-318879 exec deployment/netcat -- nslookup kubernetes.default: exit status 1 (15.285709208s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	command terminated with exit code 1

                                                
                                                
** /stderr **
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-318879 exec deployment/netcat -- nslookup kubernetes.default
net_test.go:175: (dbg) Done: kubectl --context enable-default-cni-318879 exec deployment/netcat -- nslookup kubernetes.default: (10.310070672s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (26.77s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (68.73s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker: (1m8.727680768s)
--- PASS: TestNetworkPlugins/group/flannel/Start (68.73s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (94.5s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker
E1030 11:36:43.110530 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:36:53.351701 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:36:59.587464 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:36:59.592683 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:36:59.602907 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:36:59.623131 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:36:59.663340 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:36:59.744158 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:36:59.904453 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:37:00.224917 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:37:00.865252 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:37:02.145579 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:37:04.706125 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker: (1m34.499371961s)
--- PASS: TestNetworkPlugins/group/bridge/Start (94.50s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-nnpwm" [5b75d913-7f1b-437f-84dd-73ba61ccec85] Running
E1030 11:37:09.826378 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.026502232s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.5s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.50s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (11.49s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-318879 replace --force -f testdata/netcat-deployment.yaml
E1030 11:37:11.441612 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-b5js9" [ae17056c-6852-414e-bd05-612169a470f7] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1030 11:37:13.832143 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
helpers_test.go:344: "netcat-56589dfd74-b5js9" [ae17056c-6852-414e-bd05-612169a470f7] Running
E1030 11:37:20.067402 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 11.019593828s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (11.49s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-318879 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (92.73s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kubenet-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker
E1030 11:37:54.792293 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:37:58.610845 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kubenet-318879 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker: (1m32.733852234s)
--- PASS: TestNetworkPlugins/group/kubenet/Start (92.73s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (12.55s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-318879 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-8wnfq" [7914b2ab-7021-48a8-b9cb-625e952177fd] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1030 11:38:21.508405 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
helpers_test.go:344: "netcat-56589dfd74-8wnfq" [7914b2ab-7021-48a8-b9cb-625e952177fd] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 12.021795868s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (12.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-318879 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (310.78s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-265111 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E1030 11:38:58.204161 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
E1030 11:39:00.547681 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:00.552981 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:00.563208 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:00.583430 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:00.623662 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:00.703939 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:00.864282 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:01.184769 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:01.825331 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:03.106168 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:05.667142 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:10.788262 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:39:16.713122 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:39:18.684693 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
E1030 11:39:21.028507 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-265111 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (5m10.780440175s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (310.78s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/KubeletFlags (0.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kubenet-318879 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kubenet/KubeletFlags (0.46s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/NetCatPod (12.62s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kubenet-318879 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-9qbhq" [77f2695f-81b5-4695-a7da-d0515159c622] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-9qbhq" [77f2695f-81b5-4695-a7da-d0515159c622] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: app=netcat healthy within 12.020275409s
--- PASS: TestNetworkPlugins/group/kubenet/NetCatPod (12.62s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kubenet-318879 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kubenet/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kubenet-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kubenet/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kubenet-318879 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kubenet/HairPin (0.20s)
E1030 11:57:05.543010 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:57:11.442042 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:57:42.034883 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 11:58:16.326487 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:58:28.586785 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:58:34.487976 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:58:37.712276 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
E1030 11:59:00.547982 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:59:04.033408 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:59:22.173768 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (94.16s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-420705 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1030 11:39:59.645211 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
E1030 11:40:22.469762 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:40:23.408002 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:23.413318 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:23.423571 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:23.443869 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:23.484168 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:23.564428 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:23.724742 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:24.045722 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:24.685944 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:25.966844 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:28.527058 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:33.647936 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:36.018848 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:36.024113 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:36.034380 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:36.054694 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:36.095189 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:36.175449 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:36.336182 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:36.656604 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:37.297036 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:38.577858 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:41.138112 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:43.888637 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:40:46.258881 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:40:54.011222 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:40:56.499533 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:41:04.369416 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:41:16.980647 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:41:21.566317 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
E1030 11:41:32.865995 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-420705 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (1m34.160458535s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (94.16s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (9.51s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-420705 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [2f67e913-6ece-42b5-a38d-0c73363ab4bc] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
E1030 11:41:35.567042 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
helpers_test.go:344: "busybox" [2f67e913-6ece-42b5-a38d-0c73363ab4bc] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.031442171s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-420705 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.51s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-420705 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-420705 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.069875045s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-420705 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (10.96s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-420705 --alsologtostderr -v=3
E1030 11:41:44.390672 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:41:45.330135 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:41:54.487782 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-420705 --alsologtostderr -v=3: (10.959336914s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (10.96s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-420705 -n no-preload-420705
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-420705 -n no-preload-420705: exit status 7 (87.852419ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-420705 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.22s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (342.87s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-420705 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1030 11:41:57.941459 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:41:59.588218 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:42:00.553603 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:42:05.542806 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:05.548226 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:05.558508 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:05.578879 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:05.619160 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:05.699451 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:05.860093 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:06.180762 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:06.821770 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:08.102023 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:10.662882 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:11.441607 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:42:15.783572 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:26.024048 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:42:27.269642 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:42:42.035681 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 11:42:46.505148 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:43:07.250367 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:43:16.326341 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:16.331866 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:16.342098 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:16.362458 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:16.402779 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:16.483112 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:16.643531 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:16.964100 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:17.604377 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:18.885357 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:19.861598 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:43:21.446138 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:26.567144 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:27.465285 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:43:36.807552 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:43:37.711727 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
E1030 11:43:57.287708 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:44:00.548453 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-420705 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (5m42.332578109s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-420705 -n no-preload-420705
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (342.87s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.49s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-265111 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [b660e51d-35b4-48fd-920f-15b192dae077] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
E1030 11:44:05.407323 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
helpers_test.go:344: "busybox" [b660e51d-35b4-48fd-920f-15b192dae077] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.032204591s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-265111 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.49s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.99s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-265111 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-265111 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.99s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (11.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-265111 --alsologtostderr -v=3
E1030 11:44:22.173732 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:22.178990 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:22.189247 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:22.209550 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:22.249801 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:22.330087 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:22.490528 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:22.811057 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:23.451194 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:24.731412 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-265111 --alsologtostderr -v=3: (11.005171072s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (11.01s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-265111 -n old-k8s-version-265111
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-265111 -n old-k8s-version-265111: exit status 7 (98.161924ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-265111 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (432s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-265111 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E1030 11:44:27.291609 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:28.231383 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:44:32.412056 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:38.248606 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:44:42.652493 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:44:49.385491 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:45:03.133639 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:45:23.408513 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:45:36.018578 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:45:44.094644 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:45:51.090586 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:45:54.011394 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:46:00.169123 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:46:03.702294 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:46:32.866943 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:46:35.567318 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:46:59.587800 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:47:05.542274 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:47:06.014849 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:47:11.442077 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:47:25.081114 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 11:47:33.226325 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-265111 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (7m11.550656636s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-265111 -n old-k8s-version-265111
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (432.00s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (12.03s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-ntxqh" [6db7deda-3b5c-456a-90e8-fce92151d15e] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
E1030 11:47:42.035217 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-ntxqh" [6db7deda-3b5c-456a-90e8-fce92151d15e] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 12.029233081s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (12.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-ntxqh" [6db7deda-3b5c-456a-90e8-fce92151d15e] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.010735583s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-420705 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.45s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p no-preload-420705 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.45s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.23s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-420705 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-420705 -n no-preload-420705
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-420705 -n no-preload-420705: exit status 2 (365.97683ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-420705 -n no-preload-420705
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-420705 -n no-preload-420705: exit status 2 (383.674952ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-420705 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-420705 -n no-preload-420705
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-420705 -n no-preload-420705
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.23s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (52.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-546585 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1030 11:48:16.326980 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:48:37.712228 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
E1030 11:48:44.009320 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-546585 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (52.012065997s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (52.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.43s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-546585 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [374e7223-a726-4ef1-9a73-b6d7a27f493b] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [374e7223-a726-4ef1-9a73-b6d7a27f493b] Running
E1030 11:49:00.548023 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.027108613s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-546585 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.43s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.2s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-546585 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-546585 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.084431338s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-546585 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.20s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (11.09s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-546585 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-546585 --alsologtostderr -v=3: (11.086468695s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (11.09s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-546585 -n embed-certs-546585
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-546585 -n embed-certs-546585: exit status 7 (91.574113ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-546585 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (347.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-546585 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1030 11:49:22.173536 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:49:49.855041 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:50:23.408299 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:50:36.018884 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:50:37.055347 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:50:54.011488 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
E1030 11:51:32.866034 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:51:33.315280 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:33.320653 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:33.330965 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:33.351206 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:33.391528 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:33.471909 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:33.632299 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:33.953041 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:34.593921 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:51:35.566435 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:51:35.874546 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-546585 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (5m46.548163773s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-546585 -n embed-certs-546585
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (347.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.02s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-km77m" [753f6a7a-5eea-46f1-8ad7-e63ad5f0edec] Running
E1030 11:51:38.435476 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.02310372s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.02s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-km77m" [753f6a7a-5eea-46f1-8ad7-e63ad5f0edec] Running
E1030 11:51:43.556590 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.009241033s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-265111 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p old-k8s-version-265111 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.39s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.35s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-265111 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-265111 -n old-k8s-version-265111
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-265111 -n old-k8s-version-265111: exit status 2 (450.04354ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-265111 -n old-k8s-version-265111
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-265111 -n old-k8s-version-265111: exit status 2 (365.494868ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-265111 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-265111 -n old-k8s-version-265111
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-265111 -n old-k8s-version-265111
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.35s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (89.17s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-749333 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1030 11:51:59.587409 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
E1030 11:52:05.543125 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/flannel-318879/client.crt: no such file or directory
E1030 11:52:11.441805 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/addons-305325/client.crt: no such file or directory
E1030 11:52:14.277654 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:52:42.035367 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/functional-798279/client.crt: no such file or directory
E1030 11:52:55.238406 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:52:55.914216 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:53:16.326561 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
E1030 11:53:22.630212 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-749333 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (1m29.165019999s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (89.17s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.49s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-749333 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [748eca06-061c-448c-b65a-60d20dee15e7] Pending
helpers_test.go:344: "busybox" [748eca06-061c-448c-b65a-60d20dee15e7] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [748eca06-061c-448c-b65a-60d20dee15e7] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.031363591s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-749333 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.49s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.15s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-749333 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-749333 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.022233824s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-749333 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.15s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (11.06s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-749333 --alsologtostderr -v=3
E1030 11:53:37.712259 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-749333 --alsologtostderr -v=3: (11.059470051s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (11.06s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333: exit status 7 (89.255598ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-749333 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (345.64s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-749333 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1030 11:54:00.547644 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/custom-flannel-318879/client.crt: no such file or directory
E1030 11:54:04.033583 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:04.038814 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:04.049049 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:04.069293 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:04.109531 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:04.189758 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:04.350187 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:04.671082 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:05.311958 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:06.592191 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:09.152313 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:14.272857 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:17.158775 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:54:22.173149 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kubenet-318879/client.crt: no such file or directory
E1030 11:54:24.513124 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:54:38.611408 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:54:44.993323 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:55:00.768109 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/calico-318879/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-749333 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (5m45.180807812s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (345.64s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (12.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-l5gnz" [8c481d59-48a2-4c21-944c-bbc65a329d05] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-l5gnz" [8c481d59-48a2-4c21-944c-bbc65a329d05] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 12.024878295s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (12.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-l5gnz" [8c481d59-48a2-4c21-944c-bbc65a329d05] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.010367246s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-546585 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.41s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p embed-certs-546585 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.41s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.23s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-546585 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-546585 -n embed-certs-546585
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-546585 -n embed-certs-546585: exit status 2 (363.966801ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-546585 -n embed-certs-546585
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-546585 -n embed-certs-546585: exit status 2 (362.538339ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-546585 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-546585 -n embed-certs-546585
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-546585 -n embed-certs-546585
E1030 11:55:23.408107 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.23s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (47.68s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-110049 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1030 11:55:36.018893 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
E1030 11:55:54.011023 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/ingress-addon-legacy-405700/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-110049 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (47.67767258s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (47.68s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.33s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-110049 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-110049 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.333969038s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.33s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (9.45s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-110049 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-110049 --alsologtostderr -v=3: (9.450722043s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (9.45s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-110049 -n newest-cni-110049
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-110049 -n newest-cni-110049: exit status 7 (94.698659ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-110049 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (33.02s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-110049 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3
E1030 11:56:32.866853 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/auto-318879/client.crt: no such file or directory
E1030 11:56:33.315318 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
E1030 11:56:35.566726 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/skaffold-724114/client.crt: no such file or directory
E1030 11:56:46.450828 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/false-318879/client.crt: no such file or directory
E1030 11:56:47.874574 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-110049 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.28.3: (32.564422879s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-110049 -n newest-cni-110049
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (33.02s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.41s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p newest-cni-110049 "sudo crictl images -o json"
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.41s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.45s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-110049 --alsologtostderr -v=1
E1030 11:56:59.062574 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/enable-default-cni-318879/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-110049 -n newest-cni-110049
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-110049 -n newest-cni-110049: exit status 2 (376.889601ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-110049 -n newest-cni-110049
E1030 11:56:59.587470 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/kindnet-318879/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-110049 -n newest-cni-110049: exit status 2 (370.570824ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-110049 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-110049 -n newest-cni-110049
E1030 11:57:00.998909 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/no-preload-420705/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-110049 -n newest-cni-110049
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.45s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (15.03s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-wztcq" [19da101e-bcf2-4151-8778-ba7ca6a53db3] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
E1030 11:59:31.715546 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/old-k8s-version-265111/client.crt: no such file or directory
E1030 11:59:39.369931 1041121 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/bridge-318879/client.crt: no such file or directory
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-wztcq" [19da101e-bcf2-4151-8778-ba7ca6a53db3] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 15.027376415s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (15.03s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-wztcq" [19da101e-bcf2-4151-8778-ba7ca6a53db3] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.011479283s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-749333 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.37s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p default-k8s-diff-port-749333 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.37s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.03s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-749333 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333: exit status 2 (366.583075ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333: exit status 2 (368.145616ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-749333 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-749333 -n default-k8s-diff-port-749333
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.03s)

                                                
                                    

Test skip (24/323)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:155: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/kubectl
aaa_download_only_test.go:155: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.65s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:225: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-943117 --alsologtostderr --driver=docker  --container-runtime=docker
aaa_download_only_test.go:237: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-943117" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-943117
--- SKIP: TestDownloadOnlyKic (0.65s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:443: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:497: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker true linux arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild/serial/validateImageBuildWithBuildEnv (0s)

                                                
                                                
=== RUN   TestImageBuild/serial/validateImageBuildWithBuildEnv
image_test.go:114: skipping due to https://github.com/kubernetes/minikube/issues/12431
--- SKIP: TestImageBuild/serial/validateImageBuildWithBuildEnv (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (4.76s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:523: 
----------------------- debugLogs start: cilium-318879 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-318879" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/17523-1035706/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 30 Oct 2023 11:18:00 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0-beta.0
name: cluster_info
server: https://192.168.67.2:8443
name: offline-docker-445322
contexts:
- context:
cluster: offline-docker-445322
extensions:
- extension:
last-update: Mon, 30 Oct 2023 11:18:00 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0-beta.0
name: context_info
namespace: default
user: offline-docker-445322
name: offline-docker-445322
current-context: offline-docker-445322
kind: Config
preferences: {}
users:
- name: offline-docker-445322
user:
client-certificate: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/offline-docker-445322/client.crt
client-key: /home/jenkins/minikube-integration/17523-1035706/.minikube/profiles/offline-docker-445322/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-318879

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-318879" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-318879"

                                                
                                                
----------------------- debugLogs end: cilium-318879 [took: 4.558027329s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-318879" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-318879
--- SKIP: TestNetworkPlugins/group/cilium (4.76s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-589755" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-589755
--- SKIP: TestStartStop/group/disable-driver-mounts (0.20s)

                                                
                                    
Copied to clipboard